This is a binary classification task where the goal is to decide whether a given tweet contains sexist expressions or behaviors (i.e., it is sexist in itself, describes a sexist situation, or criticizes sexist behavior). This task includes a soft-soft evaluation, where the predicted label probabilities are compared with the probabilities defined based on the disagreement in the annotation within the gold standard.
Publication
Plaza, L. et al. (2024).EXIST 2024: sEXism Identification in Social neTworks and Memes. Experimental IR Meets Multilinguality, Multimodality, and Interaction. CLEF 2024. Lecture Notes in Computer Science, volume 14612
Language
Spanish
English
URL Task
NLP topic
Dataset
Year
2024
Publication link
Ranking metric
ICMSoft
Task results
| System | ICM Soft Sort ascending |
|---|---|
| NYCU-NLP_1 | 1.0944 |
| NYCU-NLP_2 | 1.0866 |
| NYCU-NLP_3 | 1.0810 |
| ABCD Team_3 | 0.9291 |
| CIMAT-CS-NLP_3 | 0.9285 |

