Machine translation and its evaluation
a study
Article Ecrit par: Zhang, Haoxi ; Dai, Hong-Ning ; Kabir, H. M. Dipu ; Ni, Kan ; Kumar Mondal, Subrota ;
Résumé: Machine translation (namely MT) has been one of the most popular fields in computational linguistics and Artificial Intelligence (AI). As one of the most promising approaches, MT can potentially break the language barrier of people from all over the world. Despite a number of studies in MT, there are few studies in summarizing and comparing MT methods. To this end, in this paper, we principally focus on presenting the two mainstream MT schemes: statistical machine translation (SMT) and neural machine translation (NMT), including their basic rationales and developments. Meanwhile, the detailed translation models are also presented, such as the word-based model, syntax-based model, and phrase-based model in statistical machine translation. Similarly, approaches in NMT, such as the recurrent neural network-based, attention mechanism-based, and transformer-based models are presented. Last but not least, the evaluation approaches also play an important role in helping developers to improve their methods better in MT. The prevailing machine translation evaluation methodologies are also presented in this article.
Langue:
Anglais
Thème
Informatique
Mots clés:
Natural language processing (Computer science)
computational linguistics
Neural machine translation
Statistical machine translation
Evaluation methods