Given a set of Telegram messages, determine whether the author can be assigned to one of four classes: suffer+aginst, suffer+in favour, suffer+other, control, which are related to suffering depression.
Publication
Alba María Mármol-Romero, Adrián Moreno-Muñoz, Flor Miriam Plaza-del-Arco, María Dolores Molina-González, Maria Teresa Martín-Valdivia, Luis Alfonso Ureña-López, Arturo Montejo-Raéz (2023) Overview of MentalRiskES at IberLEF 2023: Early Detection of Mental Disorders Risk in Spanish. Procesamiento del Lenguaje Natural, Revista nº 71, septiembre de 2023, pp. 329-35
Language
Spanish
NLP topic
Abstract task
Dataset
Year
2023
Publication link
Task results
| System | Precision | Recall | F1 | CEM | Accuracy | MacroPrecision | MacroRecall | MacroF1 | RMSE | MicroPrecision | MicroRecall | MicroF1 | MAE | MAP | UAS | LAS | MLAS | BLEX | Pearson correlation | Spearman correlation | MeasureC | BERTScore | EMR | Exact Match | F0.5 | Hierarchical F | ICM | MeasureC | Propensity F | Reliability | Sensitivity | Sentiment Graph F1 | WAC | b2 | erde30 | sent | weighted f1 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SPIN | 0.25 | ||||||||||||||||||||||||||||||||||||
| SPIN-2 | 0.25 | ||||||||||||||||||||||||||||||||||||
| SPIN-1 | 0.24 | ||||||||||||||||||||||||||||||||||||
| PLN-CMM | 0.23 | ||||||||||||||||||||||||||||||||||||
| DepNLP UC3M GURUDAS | 0.23 | ||||||||||||||||||||||||||||||||||||
| DepNLP UC3M GURUDASI-1 | 0.23 | ||||||||||||||||||||||||||||||||||||
| DepNLP UC3M GURUDASi-2 | 0.23 | ||||||||||||||||||||||||||||||||||||
| NLP-UNED | 0.21 | ||||||||||||||||||||||||||||||||||||
| NLP-UNED-1 | 0.20 | ||||||||||||||||||||||||||||||||||||
| I2C-UHU | 0.20 |
