The aim of the task is to promote the development and evaluation of systems for identifying negation cues in Spanish. Negation cues could be simple, if they were expressed by a single token (e.g., “no” [no/not], “sin” [without]), continuous, if they were composed of a sequence of two or more contiguous tokens (e.g., “ni siquiera” [not even], “sin ningun” [without any]), or discontinuous, if they consisted of a sequence of two or more non-contiguous tokens (e.g., “no...apenas” [not...hardly], “no...nada” [not...nothing]).
Publication
Salud María Jiménez-Zafra, Noa Patricia Cruz Díaz, Roser Morante, María-Teresa Martín-Valdivia (2019) NEGES 2019 Task: Negation in Spanish. Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2019)
Competition
Language
Spanish
NLP topic
Abstract task
Dataset
Year
2019
Publication link
Ranking metric
F1
Task results
| System | Precision | Recall | F1 | CEM | Accuracy | MacroPrecision | MacroRecall | MacroF1 | RMSE Sort ascending | MicroPrecision | MicroRecall | MicroF1 | MAE | MAP | UAS | LAS | MLAS | BLEX | Pearson correlation | Spearman correlation | MeasureC | BERTScore | EMR | Exact Match | F0.5 | Hierarchical F | ICM | MeasureC | Propensity F | Reliability | Sensitivity | Sentiment Graph F1 | WAC | b2 | erde30 | sent | weighted f1 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CLiC | 0.8967 | 0.7940 | 0.8409 | 0.0000 | |||||||||||||||||||||||||||||||||
| UNED | 0.9182 | 0.7598 | 0.8299 | 0.0000 | |||||||||||||||||||||||||||||||||
| IBI | 0.9122 | 0.7216 | 0.8050 | 0.0000 | |||||||||||||||||||||||||||||||||
| Aspie96 | 0.1880 | 0.2834 | 0.2258 | 0.0000 |
