The dataset is a gold benchmark for evaluating the performance of MT systems in translating text containing entities with names that are ignificantly different across a set of 10 diverse languages. First the entities of interest for the task have been selected, and then sentences containing these entities are generated with GPT-4. Each sentence is translated into 10 target languages by at least three native translators.
Language(s)
Spanish
English
Arabic
Deuch
French
Italian
Korean
Chinese
Dataset description link
Year
2025
Domain
Diverse
Text types
Pairs of sentence
Annotations
translations from English to Spanish
Annotation guide link
Data access
Public
Publication
Simone Conia, Daniel Lee, Min Li, Umar Farooq Minhas, Saloni Potdar, and Yunyao Li. 2024. Towards Cross-Cultural Machine Translation with Retrieval-Augmented Generation from Multilingual Knowledge Graphs. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 16343–16360, Miami, Florida, USA. Association for Computational Linguistics.
Publication link
NLP Topic
Number of units
6148
Test set size
5337
Development set size
811
