The goal of this task is to assess whether a given statement, in a tweet or from a political debate, is worth fact-checking A text snippet alone, either from a tweet or from a political debate or speech, has to be assessed for check-worthiness.
Publication
Barrón-Cedeño, A. et al. (2023). Overview of the CLEF–2023 CheckThat! Lab on Checkworthiness, Subjectivity, Political Bias, Factuality, and Authority of News Articles and Their Source. In: Arampatzis, A., et al. Experimental IR Meets Multilinguality, Multimodality, and Interaction. CLEF 2023. Lecture Notes in Computer Science, vol 14163. Springer, Cham. https://doi.org/10.1007/978-3-031-42448-9_20
Language
Spanish
Spanish (Argentina)
URL Task
NLP topic
Abstract task
Year
2023
Publication link
Ranking metric
F1
Task results
| System | Precision | Recall | F1 Sort ascending | CEM | Accuracy | MacroPrecision | MacroRecall | MacroF1 | RMSE | MicroPrecision | MicroRecall | MicroF1 | MAE | MAP | UAS | LAS | MLAS | BLEX | Pearson correlation | Spearman correlation | MeasureC | BERTScore | EMR | Exact Match | F0.5 | Hierarchical F | ICM | MeasureC | Propensity F | Reliability | Sensitivity | Sentiment Graph F1 | WAC | b2 | erde30 | sent | weighted f1 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| DSHacker | 0.6410 | ||||||||||||||||||||||||||||||||||||
| ES-VRAI | 0.6270 | ||||||||||||||||||||||||||||||||||||
| CSECU-DSG | 0.5990 |
