CoNLL 2009: Semantic role labeling (Spanish)

The CoNLL-2009 shared task combined dependency parsing and the task of identifying and labeling semantic arguments of verbs (and other parts of speech whenever available). Participants had to choose from two tasks: joint task (syntactic dependency parsing and semantic role labeling), or  semantic role labeling only task. The semantic role labeling task consists of three steps: disambiguating the sense of the predicate, finding the arguments of the predicate and assigning a semantic role to the arguments. For this task syntactic dependency parses are provided by the organizers, which were obtained using state-of-the art parsers. In the test data predicates are marked, but predicate disambiguation is still part of the task (determining the sense of the predicate).

Publication
Jan Hajič, Massimiliano Ciaramita, Richard Johansson, Daisuke Kawahara, Maria Antònia Martí, Lluís Màrquez, Adam Meyers, Joakim Nivre, Sebastian Padó, Jan Štěpánek, Pavel Straňák, Mihai Surdeanu, Nianwen Xue, and Yi Zhang. 2009. The CoNLL-2009 Shared Task: Syntactic and Semantic Dependencies in Multiple Languages. In Proceedings of the Thirteenth Conference on Computational Natural Language Learning (CoNLL 2009): Shared Task, pages 1–18, Boulder, Colorado. Association for Computational Linguistics.

Task results

System MacroF1 Sort ascending
Zhao 0.8046
Chen 0.8029
Meza-Ruiz 0.7791
Merlo 0.7719
Nugues 0.7652

If you have published a result better than those on the list, send a message to odesia-comunicacion@lsi.uned.es indicating the result and the DOI of the article, along with a copy of it if it is not published openly.