Factuality classification

In this task, systems are required to automatically propose a factual tag for each event in a text. Event are annotated and three possible categories of factuality are considered:

  • Facts: current and past situations in the world that are presented as real.
  • Counterfacts: current and past situations that the writer presents as not having happened.
  • Possibilities, future situations, predictions, hypothesis and other options: situations presented as uncertain since the writer does not commit openly to the truth-value either because they have not happened yet or because the author does not know.
Publication
Aiala Rosá, Irene Castellón, Luis Chiruzzo, Hortensia Curell, Mathias Etcheverry, Ana Fernández, Gloria Vázquez, Dina Wonsever (2019) Overview of FACT at IberLEF 2019: Factuality Analysis and Classification Task. Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2019)
Language
Spanish
Abstract task
Dataset
Year
2019
Ranking metric
Macro F1

Task results

If you have published a result better than those on the list, send a message to odesia-comunicacion@lsi.uned.es indicating the result and the DOI of the article, along with a copy of it if it is not published openly.