The goal of the JOKER tasks is to foster progress on the automatic interpretation, generation, and translation of wordplay. This edition focuses on puns. A pun is a form of wordplay in which a word or phrase evokes the meaning of another word or phrase with a similar or identical pronunciation. Task 1 Pun detection in Spanish is a binary classification task where the goal is to distinguish between texts containing a pun (the positive examples) and texts not containing any pun (the negative examples).
Publication
Ermakova, L., Miller, T., Bosser, AG., Palma Preciado, V.M., Sidorov, G., Jatowt, A. (2023). Overview of JOKER – CLEF-2023 Track on Automatic Wordplay Analysis. In: Arampatzis, A., et al. Experimental IR Meets Multilinguality, Multimodality, and Interaction. CLEF 2023. Lecture Notes in Computer Science, vol 14163. Springer, Cham. https://doi.org/10.1007/978-3-031-42448-9_26
Competition
Language
Spanish
NLP topic
Abstract task
Dataset
Year
2023
Publication link
Ranking metric
F1
Task results
System | F1 Sort ascending |
---|---|
LJGG_t5_large_label_es | 0.5964 |
Akranlu_seqclassification | 0.5964 |
LJGG_t5_large_no_label_es | 0.5964 |
UBO_SimpleT5 | 0.5650 |
Akranlu_sentemb | 0.5263 |
LJGG_t5_large_easy_es | 0.5215 |
Smroltra_ES_Random | 0.5192 |
Smroltra_ES_NBC | 0.5168 |
Smroltra_ES_Logistic-Regression | 0.4952 |
Smroltra_ES_TFIDF | 0.4946 |