Integrating Word Embeddings into IBM Word Alignment Models

Le, Anh Cuong and Nguyen, Tuan Phong and Tran, Quoc Long and Dao, Bao Linh (2018) Integrating Word Embeddings into IBM Word Alignment Models. In: 2018 10th International Conference on Knowledge and Systems Engineering (KSE), 1-3 November 2018, Ho Chi Minh city, Vietnam.

PDF Download (242kB)

Abstract

Wordalignmentmodelsareusedtogenerate word-aligned parallel text which is used in statistical machine translation systems. Currently, the most popular word alignment models are IBM models which have been widely applied in a large number of translation systems. The parameters of IBM models are estimated by using Maximum Likelihood principle, i.e. by counting the cooccurrence of words in the parallel text. This way of parameter estimation leads to the “ambiguity” problem when some words stand together in many sentence pairs but each of them is not translation of any other. Additionally, this method requires large amount of training data to achieve good results. However, parallel text which is used to train the IBM models is usually limited for low-resource languages. In this work, we try to solve these two problems by adding semantic information to the models. Our semantic information is derived from word embeddings which only need monolingual data to train. We deploy evaluation on a language pair that has great differences in grammar structure, English-Vietnamese. Even with this challenged task, our proposed models gain significant improvements in word alignment result and help increasing translation quality.

Item Type:	Conference or Workshop Item (Paper)
Subjects:	Information Technology (IT)
Divisions:	Faculty of Information Technology (FIT)
Depositing User:	Long Trần Quốc
Date Deposited:	14 Dec 2018 02:36
Last Modified:	14 Dec 2018 02:39
URI:	http://eprints.uet.vnu.edu.vn/eprints/id/eprint/3266

Actions (login required)

View Item