Semantic Textual Similarity ES-ES 2017

Evaluates the degree to which two Spanish sentences are semantically equivalent to each other. Similarity scores range from 0 for no overlap in meaning to 5 for equivalence of meaning. Values in between reflect interpretable levels of partial overlap in meaning.

 

Publication
Daniel Cer, Mona Diab, Eneko Agirre, Iñigo Lopez-Gazpio, and Lucia Specia. 2017. SemEval-2017 Task 1: Semantic Textual Similarity Multilingual and Crosslingual Focused Evaluation. In Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017), pages 1–14, Vancouver, Canada. Association for Computational Linguistics.
Competition
SemEval-2017 Task 1: Semantic Textual Similarity Multilingual and Crosslingual Focused Evaluation
Language
Spanish
URL Task
https://alt.qcri.org/semeval2017/task1/
NLP topic
text similarity
Abstract task
Correlation
Dataset
STS 2017-es-es
Year
2017
Publication link
https://aclanthology.org/S17-…
Ranking metric
Pearson correlation

Task results

System Pearson correlation
ECNU 0.8559
BIT 0.8499
FCICU 0.8489
FCICU 0.8484
ECNU 0.8456

If you have published a result better than those on the list, send a message to odesia-comunicacion@lsi.uned.es indicating the result and the DOI of the article, along with a copy of it if it is not published openly.