EXIST-2024: Source Intention in tweets (hard-hard)

This task aims to classify sexist tweets according to the author's intention, helping to understand the role social media plays in the expression and spread of sexist messages. This task proposes a ternary classification: direct, reported, judgmental. A hard-hard evaluation is included in this task, where the labels predicted by the system are compared with the gold standard labels.

Publication
Plaza, L. et al. (2024).EXIST 2024: sEXism Identification in Social neTworks and Memes. Experimental IR Meets Multilinguality, Multimodality, and Interaction. CLEF 2024. Lecture Notes in Computer Science, volume 14612
Language
Spanish
English
NLP topic
Dataset
Year
2024
Ranking metric
ICM

Task results

System ICM Sort ascending
ABCD Team_1 0.4059
NYCU-NLP_3 0.3522
NYCU-NLP_1 0.3383
NYCU-NLP_2 0.3073
CUET-SSTM_1 0.2883

If you have published a result better than those on the list, send a message to odesia-comunicacion@lsi.uned.es indicating the result and the DOI of the article, along with a copy of it if it is not published openly.