Contextual classification of offensive comments -MEX

Classification of  comments into different categories with contextual information. Information about the comment (information about targeted users and the related social media) is provided. 

The following categories are considered:

  • Offensive, target is a person (OFP). Offensive text targeting a specific individual.
  • Offensive, target is a group of people or collective (OFG). Offensive text targeting a group of people belonging to the same ethnic group, gender or sexual orientation, political ideology, religious belief or other common characteristic.
  • Offensive, target is different from a person or a group (OFO). Offensive text where the target does not belong to any of the previous categories, e.g., an organization, an event, a place, an issue.
  • Non-offensive, but with expletive language (NOE). A text that contains rude words, blasphemes or swearwords but without the aim of offending, and usually with a positive connotation.
  • Non-offensive (NO). Text that is neither offensive nor contains expletive language.
Publication
Flor Miriam Plaza-del-Arco, Marco Casavantes, Hugo Jair Escalante, M. Teresa Martín-Valdivia, Arturo Montejo-Ráez, Manuel Montes-y-Gómez, Horacio Jarquín-Vásquez, Luis Villaseñor-Pineda (2021) Overview of MeOffendEs at IberLEF 2021: Offensive Language Detection in Spanish Variants.Procesamiento del Lenguaje Natural, Revista nº 67, septiembre de 2021, pp. 183-194.
Language
Spanish (Mexico)
NLP topic
Abstract task
Dataset
Year
2021
Ranking metric
Micro F

Task results

System Precision Recall F1 Sort ascending
UMUTeam 0.6683 0.6705 0.6694
CIC-IPN 0.5383 0.6843 0.6026
Timen 0.4233 0.4456 0.4341

If you have published a result better than those on the list, send a message to odesia-comunicacion@lsi.uned.es indicating the result and the DOI of the article, along with a copy of it if it is not published openly.