eprintid: 3266
rev_number: 9
eprint_status: archive
userid: 335
dir: disk0/00/00/32/66
datestamp: 2018-12-14 02:36:34
lastmod: 2018-12-14 02:39:32
status_changed: 2018-12-14 02:36:34
type: conference_item
metadata_visibility: show
creators_name: Le, Anh Cuong
creators_name: Nguyen, Tuan Phong
creators_name: Tran, Quoc Long
creators_name: Dao, Bao Linh
creators_id: lacuong@it.tdt.edu.vn
creators_id: tuanphong94@gmail.com
creators_id: tqlong@vnu.edu.vn
creators_id: linhdb@runsystem.net
title: Integrating Word Embeddings into IBM Word Alignment Models
ispublished: pub
subjects: IT
divisions: fac_fit
abstract: Wordalignmentmodelsareusedtogenerate word-aligned parallel text which is used in statistical machine translation systems. Currently, the most popular word alignment models are IBM models which have been widely applied in a large number of translation systems. The parameters of IBM models are estimated by using Maximum Likelihood principle, i.e. by counting the cooccurrence of words in the parallel text. This way of parameter estimation leads to the “ambiguity” problem when some words stand together in many sentence pairs but each of them is not translation of any other. Additionally, this method requires large amount of training data to achieve good results. However, parallel text which is used to train the IBM models is usually limited for low-resource languages. In this work, we try to solve these two problems by adding semantic information to the models. Our semantic information is derived from word embeddings which only need monolingual data to train. We deploy evaluation on a language pair that has great differences in grammar structure, English-Vietnamese. Even with this challenged task, our proposed models gain significant improvements in word alignment result and help increasing translation quality.
date: 2018-11-01
date_type: published
official_url: http://kse-conf.org/
full_text_status: public
pres_type: paper
pagerange: 79-84
event_title: 2018 10th International Conference on Knowledge and Systems Engineering (KSE)
event_location: Ho Chi Minh city, Vietnam
event_dates: 1-3 November 2018
event_type: conference
refereed: TRUE
citation:   Le, Anh Cuong and Nguyen, Tuan Phong and Tran, Quoc Long and Dao, Bao Linh  (2018) Integrating Word Embeddings into IBM Word Alignment Models.  In: 2018 10th International Conference on Knowledge and Systems Engineering (KSE), 1-3 November 2018, Ho Chi Minh city, Vietnam.     
document_url: https://eprints.uet.vnu.edu.vn/eprints/id/eprint/3266/1/p79-cuong.pdf