Abstract
Unknown words and word segmentation granularity are two main problems in Chinese word segmentation for Chinese-Japanese Machine Translation (MT). In this paper, we propose an approach of exploiting common Chinese characters shared between Chinese and Japanese in Chinese word segmentation optimization for MT aiming to solve these problems. We augment the system dictionary of a Chinese segmenter by extracting Chinese lexicons from a parallel training corpus. In addition, we adjust the granularity of the training data for the Chinese segmenter to that of Japanese. Experimental results of Chinese-Japanese MT on a phrase-based SMT system show that our approach improves MT performance significantly.
Original language | English |
---|---|
Pages | 35-42 |
Number of pages | 8 |
Publication status | Published - Jan 1 2012 |
Event | 16th Annual Conference of the European Association for Machine Translation, EAMT 2012 - Trento, Italy Duration: May 28 2012 → May 30 2012 |
Other
Other | 16th Annual Conference of the European Association for Machine Translation, EAMT 2012 |
---|---|
Country | Italy |
City | Trento |
Period | 5/28/12 → 5/30/12 |
All Science Journal Classification (ASJC) codes
- Language and Linguistics
- Human-Computer Interaction
- Software