DETEST-Dis 2024: Implicitness Identification

The objective of this task is to address a hierarchical binary classification problem to identify whether the stereotypes in the text are explicit or implicit. Implicit stereotypes require inference, as they are not directly expressed.

Publication
Schmeisser-Nieto et al. (2024). Overview of DETESTS-Dis at IberLEF 2024: DETEction and classification of racial STereotypes in Spanish - Learning with Disagreement. Procesamiento del Lenguaje Natural, Revista, 73: 323-333.
Competition
DETESTS-Dis: DETEction and classification of racial STereotypes in Spanish - Learning with Disagreement
Language
Spanish
URL Task
https://detests-dis.github.io/
NLP topic
hate detection
Dataset
DETEST-Dis
Year
2024
Publication link
http://journal.sepln.org/sepl…
Ranking metric
ICM

Task results

System ICM
BETO 0.1260
EUA II 0.0650
Brigada Lenguaje I -0.2400
TFIDF+SVC -0.2750
FastText+SVC -0.4120

If you have published a result better than those on the list, send a message to odesia-comunicacion@lsi.uned.es indicating the result and the DOI of the article, along with a copy of it if it is not published openly.