Stance detection

The task consists in determining whether a given tweet expresses an AGAINST, FAVOR or NEUTRAL (NONE) stance towards vaccines. 

Publication
Rodrigo Agerri, Roberto Centeno, María Espinosa, Joseba Fernández de Landa, Álvaro Rodrigo (2021) VaxxStance@IberLEF 2021: Overview of the Task on Going Beyond Text in Cross-Lingual Stance Detection. Procesamiento del Lenguaje Natural, Revista nº 67, septiembre de 2021, pp. 173-181
Language
Spanish
NLP topic
Abstract task
Dataset
Year
2021
Ranking metric
Macro F1

Task results

System MacroF1 Sort ascending MAE
WordUp 02 89.4700 0.6600
WordUp 02 89.1300 0.6600
WordUp 01 87.7700 0.6600
WordUp 02 80.9200 0.6600
MultiAztertest 01 79.3100 0.6600
WordUp 01 79.0600 0.6600
MultiAztertest 01 74.1000 0.6600
SQYQP 01 73.1700 0.6600
MultiAztertest 02 70.5500 0.6600
SQYQP 01 67.3800 0.6600

If you have published a result better than those on the list, send a message to odesia-comunicacion@lsi.uned.es indicating the result and the DOI of the article, along with a copy of it if it is not published openly.