DIANN 2018: Disability detection

DIANN is a named entity recognition task which focuses on the detection of disabilities in biomedical scientific literature.

Publication
Hermenegildo Fabregat, Juan Martínez-Romo, Lourdes Araujo (2018) Overview of the DIANN Task: Disability Annotation Task. Proceedings of the Third Workshop on Evaluation of Human Language Technologies for Iberian Languages (IberEval 2018).
Competition
Disability annotation on documents from the biomedical domain (DIANN)
Language
Spanish
URL Task
http://nlp.uned.es/diann/
NLP topic
(named) entity recognition
Abstract task
Sequence labeling
Dataset
DIANN-2018-ES
Year
2018
Publication link
http://ceur-ws.org/Vol-2150/o…
Ranking metric
Macro F1

Task results

System MacroPrecision MacroRecall MacroF1
IxaMed R1 0.7460 0.7950 0.7700
UC3M 1 R1 0.7690 0.5680 0.6530
UPC 3 R2 0.7720 0.5630 0.6520
UPC 3 R1 0.7790 0.5550 0.6480
UC3M 1 R2 0.7490 0.5590 0.6400

If you have published a result better than those on the list, send a message to odesia-comunicacion@lsi.uned.es indicating the result and the DOI of the article, along with a copy of it if it is not published openly.