Semantic textual similarity es-en

Semantic Textual Similarity measures the meaning similarity of sentences. This task involves producing real-valued similarity scores for sentence pairs English-Spanish. Performance is measured by the Pearson correlation of machine scores with human judgments. The data in Spanish are translated to English by humans.

Publication
Daniel Cer, Mona Diab, Eneko Agirre, Iñigo Lopez-Gazpio, and Lucia Specia. 2017. SemEval-2017 Task 1: Semantic Textual Similarity Multilingual and Crosslingual Focused Evaluation. In Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017), pages 1–14, Vancouver, Canada. Association for Computational Linguistics.
Competition
SemEval-2017 Task 1: Semantic Textual Similarity Multilingual and Crosslingual Focused Evaluation
Language
Spanish
English
NLP topic
text similarity
Abstract task
Correlation
Dataset
STS 2017-es-en
Year
2017
Publication link
https://aclanthology.org/S17-…

Task results

System Pearson correlation
ECNU 0.8131
BIT 0.7828
BIT 0.7813
MITRE 0.7802
ECNU 0.7649

If you have published a result better than those on the list, send a message to odesia-comunicacion@lsi.uned.es indicating the result and the DOI of the article, along with a copy of it if it is not published openly.