Conference and Labs of the Evaluation Forum

The purpose of CLEF is to promote research, innovation and development of information access systems, placing emphasis on multilingual and multimodal information with different levels of structure.

more information >>

IberLEF is an evaluation campaign that aims to foster the research community to define new challenges and obtain cutting-edge results for the Natural Language Processing community, involving at least one of the Iberian languages: Spanish, Portugueses, Catalan, Basque or Galician. Accordingly, several shared-tasks are organised every year under the umbrella of IberLEF, the results of which are presented in conjunction with the annual conference of the Spanish Society of Natural Language Processing (SEPLN).

more information >>


Evaluation campaign for Natural Language Processing (NLP) systems in Spanish and other Iberian languages


Workshop on Evaluation of Human Language Technologies for Iberian Languages

IberEval aimed to encourage and promote the development of Human Language Technologies (HLT) for Iberian languages (Spanish, Portuguese, Catalan, Basque and Galician), through the creation of a series of evaluations and a discussion forum on communication systems. Currently it has been substituted by IberLEF.

more information >>

SemEval is a series of international natural language processing (NLP) research workshops whose mission is to advance the current state of the art in semantic analysis and help create high-quality annotated datasets on a variety of increasingly challenging problems. Each year SemEVAL features a collection of shared tasks in which computational semantic analysis systems designed by different teams are presented and compared.

more information >>


International Workshop on Semantic Evaluation


Conference on Computational Natural Language Learning

CoNLL is a yearly conference organized by SIGNLL (ACL's Special Interest Group on Natural Language Learning), focusing on theoretically, cognitively and scientifically motivated approaches to computational linguistics. Since 1999 CoNLL CoNLL has included a shared task in which training and test data is provided by the organizers, which allows participating systems to be evaluated and compared in a systematic way. Descriptions of the participating systems and an evaluation of their performances are presented both at the conference and in the proceedings.

more information >>

PAN is a series of yearly workshops and shared tasks on related to digital text forensics and stylometry. As a result of the shared tasks, the PAN community has created many corpora that are mostly publicly available.

more information >>


Series of scientific events and shared tasks on digital text forensics and stylometry

All forums