Given a topic and a stream of potentially related tweets, rank the tweets according to their check-worthiness for the topic.
Publication
Shaden Shaar, Maram Hasanain, Bayan Hamdan, Zien Sheikh Ali, Fatima Haouari, Alex Nikolov, Mucahid Kutlu, Yavuz Selim Kartal, Firoj Alam, Giovanni Da San Martino, Alberto Barrón-Cedeño, Ruben Miguez, Javier Beltrán, Tamer Elsayed, Preslav Nakov (2021) Overview of the CLEF-2021 CheckThat! Lab Task 1 on Check-Worthiness Estimation in Tweets and Political Debates. Proceedings CLEF 2021 – Conference and Labs of the Evaluation Forum, September 21–24, 2021, Bucharest, Romania.
Language
Spanish
English
NLP topic
Abstract task
Dataset
Year
2021
Publication link
Ranking metric
MAP
Task results
| System | MAP Sort ascending |
|---|---|
| TOBB ETU | 0.5370 |
| GPLS | 0.5290 |
| bigIR | 0.4960 |
| NLP&IR@UNED | 0.4920 |
| Accenture | 0.4910 |
