This is a binary classification task that involves determining whether a meme contains sexist expressions or behaviors (i.e., it is sexist in itself, describes a sexist situation, or criticizes a sexist behavior). This task includes a hard-hard evaluation, where the labels predicted by the system are compared with the labels from the gold standard.
Publication
Plaza, L. et al. (2024).EXIST 2024: sEXism Identification in Social neTworks and Memes. Experimental IR Meets Multilinguality, Multimodality, and Interaction. CLEF 2024. Lecture Notes in Computer Science, volume 14612
Language
Spanish
English
URL Task
NLP topic
Dataset
Year
2024
Publication link
Ranking metric
ICM
Task results
| System | ICM Sort ascending |
|---|---|
| RoJiNG-CL_3 | 0.3182 |
| RoJiNG-CL_2 | 0.2272 |
| RoJiNG-CL_1 | 0.1863 |
| I2C-Huelva_2 | 0.1313 |
| I2C-Huelva_1 | 0.1166 |

