EXIST-2024: Sexism categorization in tweets (soft-soft)

Many aspects of a woman's life can be subject to sexist attitudes, such as domestic and parental roles, professional opportunities, sexual image, and life expectations, to name a few. Automatically detecting which of these aspects of women are most frequently attacked on social media will help develop policies to combat sexism. In this task, each sexist tweet must be classified into one or more of the following categories: IDEOLOGICAL AND INEQUALITY, STEREOTYPING AND DOMINANCE, OBJECTIFICATION, SEXUAL VIOLENCE, MISOGYNY AND NON-SEXUAL VIOLENCE. This task includes a soft-soft evaluation, where the probability of each label predicted by the system is compared with the probability defined based on the annotation disagreement in the gold standard.

Publication
Plaza, L. et al. (2024).EXIST 2024: sEXism Identification in Social neTworks and Memes. Experimental IR Meets Multilinguality, Multimodality, and Interaction. CLEF 2024. Lecture Notes in Computer Science, volume 14612
Language
Spanish
English
NLP topic
Dataset
Year
2024
Ranking metric
ICMSoft

Task results

System ICM Soft Sort ascending
NYCU-NLP_1 -1.1762
NYCU-NLP_2 -1.2169
NYCU-NLP_3 -1.4555
Medusa_1 -2.2055
Medusa_2 -2.4010

If you have published a result better than those on the list, send a message to odesia-comunicacion@lsi.uned.es indicating the result and the DOI of the article, along with a copy of it if it is not published openly.