Complex word identification

The objective is to mark in multi-genre documents those words that can be considered complex, in the sense of difficult comprehension for the reader. This is a binary classification task where systems must label the target words in context as complex (1) or simple (0).

Publication
Jenny A. Ortiz-Zambrano, Arturo Montejo-Ráez (2020) Overview of ALexS 2020: First Workshop on Lexical Analysis at SEPLN. Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2020)
Language
Spanish
NLP topic
Abstract task
Dataset
Year
2020
Ranking metric
F1

Task results

System MacroPrecision MacroRecall MacroF1 Sort ascending
Vicomtech-1 0.1666 0.0968 0.5968
Vicomtech-3 0.1769 0.1039 0.5931
UDLAP-2 0.2725 0.3415 0.2255
UDLAP-1 0.2660 0.3347 0.2206
UDLAP-3 0.2613 0.3287 0.2169

If you have published a result better than those on the list, send a message to odesia-comunicacion@lsi.uned.es indicating the result and the DOI of the article, along with a copy of it if it is not published openly.