DETEST-Dis 2024: Stereotype detection

The objective of this task is to determine whether a comment or phrase contains any stereotypes, considering the full distribution of labels provided by the annotators.

Publication
Schmeisser-Nieto et al. (2024). Overview of DETESTS-Dis at IberLEF 2024: DETEction and classification of racial STereotypes in Spanish - Learning with Disagreement. Procesamiento del Lenguaje Natural, Revista, 73: 323-333.

Task results

System F1 Sort ascending
Brigada Lenguaje I 0.7240
I2C-Huelva 0.7120
EUA II 0.6910
BETO 0.6630
UC3M-SAS II 0.6410

If you have published a result better than those on the list, send a message to odesia-comunicacion@lsi.uned.es indicating the result and the DOI of the article, along with a copy of it if it is not published openly.