Irony detection

In this task, systems are required to determine whether a short message in Spanish is ironic or not according to a specified context (by assigning a binary value 1 or 0).

Publication
Reynier Ortega-Bueno, Francisco Rangel, Delia Irazú Hernández Farías, Paolo Rosso, Manuel Montes-y-Gómez, José Medina-Pagola (2019) Overview of the Task on Irony Detection in Spanish Variants. Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2019
Competition
Irony Detection in Spanish Variants
Language
Spanish (Cuba)
Spanish (Mexico)
Spanish (Spain)
NLP topic
processing humor
Abstract task
Classification
Dataset
IDAT-SP-EU
IDAT-SP-MEX
IDAT-SP-CUBA
Year
2019
Publication link
http://ceur-ws.org/Vol-2421/I…
Ranking metric
Macro F1

Task results

System MacroF1
ELiRF-UPV 0.7167
CICLiku 0.6875
VRAIN 0.6842
ELiRF-UPV 0.6803
CIMAT 0.6709
Jzaragoza 0.6703
SCoMoDI 0.6652
LASTUS-UPF method1 0.6606
CIMAT 0.6596
ELiRF-UPV 0.6527

If you have published a result better than those on the list, send a message to odesia-comunicacion@lsi.uned.es indicating the result and the DOI of the article, along with a copy of it if it is not published openly.