MultiCardioNER Task at BioASQ 2024 (CardioDis subtrack)

The MultiCardioNER shared task builds on previous clinical named entity recognition (NER) tasks in Spanish, such as DisTEMIST (diseases), MedProcNER/ProcTEMIST (procedures), and SympTEMIST (signs and symptoms). Unlike these general-domain tasks, MultiCardioNER focuses specifically on detecting diseases and drugs in cardiology-related texts. Participants worked with the DisTEMIST and DrugTEMIST corpora (which annotate diseases and drugs in diverse clinical case reports) and were additionally provided with the CardioCCC corpus, which contains cardiology-specific documents. The CardioDis subtrack focuses on the adaptation of disease recognition systems to the cardiology domain in Spanish.

Publication
Nentidis et al. (2024). Overview of BioASQ 2024: The Twelfth BioASQ Challenge on Large-Scale Biomedical Semantic Indexing and Question Answering. Experimental IR Meets Multilinguality, Multimodality, and Interaction. CLEF 2024. Lecture Notes in Computer Science, volume 14612
Language
Spanish
English
Italian
Dataset
Year
2024
Ranking metric
Micro F

Task results

System MicroF1 Sort ascending
BIT.UA_1 0.8199
BIT.UA_2 0.8145
Enigma 3 0.8049
Enigma 2 0.8030
PICUSLab 0.7910

If you have published a result better than those on the list, send a message to odesia-comunicacion@lsi.uned.es indicating the result and the DOI of the article, along with a copy of it if it is not published openly.