AuTexTification: Model Generated Text Detection

This task aims to boost research on the detection of text generated automatically by text generation models. Participants must develop models that exploit clues about linguistic form and meaning to distinguish automatically generated text from human text. This subtask consists in distinguishing between human and generated text. It is framed as a binary classification task of human text (Hum) and MGT  (Gen), where text from three domains is included in the training set, and submissions are evaluated in two unseen ones.

Publication
Areg Mikael Sarvazyan, José Ángel González, Marc Franco-Salvador, Francisco Rangel, Berta Chulvi, Paolo Rosso (2023) Overview of AuTexTification at IberLEF 2023: Detection and Attribution of Machine-Generated Text in Multiple Domains. Procesamiento del Lenguaje Natural, Revista nº 71, septiembre de 2023, pp. 275-288.
Language
Spanish
NLP topic
Abstract task
Year
2023
Ranking metric
Macro F1

Task results

System MacroF1 Sort ascending
TALN-UPF 0.7077
Ling UCM 0.7060
Drocks 0.6537
GLPSI 0.6390
turing_testers 0.6277
bucharest 0.5649
ANLP 0.5138
UAEMex 0.3517
LKE_BUAP 0.3160

If you have published a result better than those on the list, send a message to odesia-comunicacion@lsi.uned.es indicating the result and the DOI of the article, along with a copy of it if it is not published openly.