Predicting in multi-genre documents which words challenge non-native speakers based on the annotations collected from both native and non-native speakers. Systems must assign the probability of target words in context being complex.
Publication
Seid Muhie Yimam, Chris Biemann, Shervin Malmasi, Gustavo Paetzold, Lucia Specia, Sanja Štajner, Anaïs Tack, Marcos Zampieri (2018) A Report on the Complex Word Identification Shared Task 2018. Proceedings of the Thirteenth Workshop on Innovative Use of NLP for Building Educational Applications, pages 66-78 New Orleans, Louisiana, June 5, 2018.
Competition
Language
Spanish
NLP topic
Abstract task
Dataset
Year
2018
Publication link
Ranking metric
MAE
Task results
| System | MAE Sort ascending |
|---|---|
| Gillin Inc. | 0.2513 |
| CoastalCPH | 0.0808 |
| CoastalCPH | 0.0789 |
| ITEC | 0.0733 |
| TMU | 0.0718 |
