his is a binary classification task that involves deciding whether a given meme contains sexist expressions or behaviors (i.e., it is sexist in itself, describes a sexist situation, or criticizes a sexist behavior). This task includes a soft-soft evaluation, where the predicted label probabilities from the system are compared with the probabilities defined based on the disagreement in the annotation in the gold standard.
Publication
Plaza, L. et al. (2024).EXIST 2024: sEXism Identification in Social neTworks and Memes. Experimental IR Meets Multilinguality, Multimodality, and Interaction. CLEF 2024. Lecture Notes in Computer Science, volume 14612
Language
Spanish
English
URL Task
NLP topic
Dataset
Year
2024
Publication link
Ranking metric
ICMSoft
Task results
| System | ICM Soft Sort ascending |
|---|---|
| Victor-UNED_1 | -0.3135 |
| Victor-UNED_2 | -0.3225 |
| Elias&Sergio_1 | -0.3263 |
| I2C-Huelva_3 | -0.3390 |
| I2C-Huelva_1 | -1.2453 |
