This is a binary classification consisting on deciding whether or not a given tweet contains sexist expressions or behaviours (i.e., it is sexist itself, describes a sexist situation or criticizes a sexist behaviour).
This task includes a soft-soft evaluation in which the probability of each label predicted by the system is compared with the probability defined from the disagreement in the gold standard annotation.
Publication
Plaza, L. et al. (2023). Overview of EXIST 2023 – Learning with Disagreement for Sexism Identification and Characterization. In: Arampatzis, A., et al. Experimental IR Meets Multilinguality, Multimodality, and Interaction. CLEF 2023. Lecture Notes in Computer Science, vol 14163. Springer, Cham. https://doi.org/10.1007/978-3-031-42448-9_23
Competition
Language
Spanish
URL Task
NLP topic
Abstract task
Dataset
Year
2023
Publication link
Ranking metric
ICM
Task results
| System | ICM Sort ascending |
|---|---|
| Mario_1 | 0.6995 |
| Mario_3 | 0.6959 |
| Mario_2 | 0.6552 |
| roh-neil_1 | 0.5912 |
| roh-neil_2 | 0.5912 |
| CLassifiers_2 | 0.5659 |
| CIC-SDS.KN_3 | 0.5605 |
| CIC-SDS.KN_2 | 0.5600 |
| CLassifiers_3 | 0.5583 |
| roh-neil_3 | 0.5505 |
