In this task, systems are required to automatically propose a factual tag for each event in a text. Event are annotated and three possible categories of factuality are considered:
- Facts: current and past situations in the world that are presented as real.
- Counterfacts: current and past situations that the writer presents as not having happened.
- Possibilities, future situations, predictions, hypothesis and other options: situations presented as uncertain since the writer does not commit openly to the truth-value either because they have not happened yet or because the author does not know.
Publication
Aiala Rosá, Irene Castellón, Luis Chiruzzo, Hortensia Curell, Mathias Etcheverry, Ana Fernández, Gloria Vázquez, Dina Wonsever (2019) Overview of FACT at IberLEF 2019: Factuality Analysis and Classification Task. Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2019)
Language
Spanish
NLP topic
Abstract task
Dataset
Year
2019
Publication link
Ranking metric
Macro F1
Task results
System | MacroF1 Sort ascending |
---|---|
Amrita CEN | 0.5610 |
Aspie96 | 0.5540 |
jimblair | 0.4890 |
macro128 | 0.3620 |