Detection of abbreviation mentions in terms of their coresponding character offsets together with the resolution of their corresponding abbreviation definitions. Compare predicted definitions to manual definitions by automatically comparing the tokens of both the definitions (predicted and manual), ignoring upper/lowercase and hyphenated characters.
Publication
Ander Intxaurrondo, Montserrat Marimon, Aitor Gonzalez-Agirre, Jose Antonio Lopez-Martin, Heidy Rodriguez, Jesus Santamaria, Marta Villegas, Martin Krallinger (2018) Finding mentions of abbreviations and their
definitions in Spanish Clinical Cases: the BARR2 shared task evaluation results. Proceedings of the Third Workshop on Evaluation of Human Language Technologies for Iberian Languages (IberEval 2018).
definitions in Spanish Clinical Cases: the BARR2 shared task evaluation results. Proceedings of the Third Workshop on Evaluation of Human Language Technologies for Iberian Languages (IberEval 2018).
Language
Spanish
NLP topic
Abstract task
Dataset
Year
2018
Publication link
Ranking metric
Micro F
Task results
| System | MicroPrecision | MicroRecall | MicroF1 Sort ascending |
|---|---|---|---|
| Fsanchez-1 | 0.8534 | 0.8111 | 0.8317 |
| Hospital-italiano-3ul | 0.8890 | 0.7129 | 0.7913 |
| Hospital-italiano-4ul | 0.8708 | 0.7164 | 0.7861 |
| Hospital-italiano-4ul-sinpl | 0.8695 | 0.7154 | 0.7850 |
| Vicomtech-ML | 0.8757 | 0.7020 | 0.7793 |
