Two-class (or binary) classification task where the system has to predict whether a tweet in English or in Spanish with a given target (women or immigrants) contains hate speech (HS) or not.
Publication
"Valerio Basile, Cristina Bosco, Elisabetta Fersini, Debora Nozza, Viviana Patti, Francisco Manuel Rangel Pardo, Paolo Rosso, Manuela Sanguinetti (2019) Proceedings of the 13th International Workshop on Semantic Evaluation (SemEval-2019), pages 54–63, Minneapolis, Minnesota, USA, June 6–7, 2019. SemEval-2019 Task 5: Multilingual Detection of Hate Speech Against Immigrants and Women in Twitter. Proceedings of the 13th International Workshop on Semantic Evaluation (SemEval-2019), pages 54–63, Minneapolis, Minnesota, USA, June 6–7, 2019"
Language
Spanish
English
NLP topic
Abstract task
Dataset
Year
2019
Publication link
Ranking metric
Macro F1
Task results
| System | Precision | Recall | F1 | CEM | Accuracy | MacroPrecision | MacroRecall | MacroF1 Sort ascending | RMSE | MicroPrecision | MicroRecall | MicroF1 | MAE | MAP | UAS | LAS | MLAS | BLEX | Pearson correlation | Spearman correlation | MeasureC | BERTScore | EMR | Exact Match | F0.5 | Hierarchical F | ICM | MeasureC | Propensity F | Reliability | Sensitivity | Sentiment Graph F1 | WAC | b2 | erde30 | sent | weighted f1 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Atalaya | 0.7300 | ||||||||||||||||||||||||||||||||||||
| MineriaUNAM | 0.7300 | ||||||||||||||||||||||||||||||||||||
| MITRE | 0.7290 | ||||||||||||||||||||||||||||||||||||
| CIC-2 | 0.7270 | ||||||||||||||||||||||||||||||||||||
| GSI-UPM | 0.7250 |
