Exploiting shared Chinese characters in Chinese word segmentation optimization for Chinese-Japanese Machine Translation

Chenhui Chu, Toshiaki Nakazawa, Daisuke Kawahara, Sadao Kurohashi

Research output: Contribution to conferencePaperpeer-review

11 Citations (Scopus)

Abstract

Unknown words and word segmentation granularity are two main problems in Chinese word segmentation for Chinese-Japanese Machine Translation (MT). In this paper, we propose an approach of exploiting common Chinese characters shared between Chinese and Japanese in Chinese word segmentation optimization for MT aiming to solve these problems. We augment the system dictionary of a Chinese segmenter by extracting Chinese lexicons from a parallel training corpus. In addition, we adjust the granularity of the training data for the Chinese segmenter to that of Japanese. Experimental results of Chinese-Japanese MT on a phrase-based SMT system show that our approach improves MT performance significantly.

Original languageEnglish
Pages35-42
Number of pages8
Publication statusPublished - Jan 1 2012
Event16th Annual Conference of the European Association for Machine Translation, EAMT 2012 - Trento, Italy
Duration: May 28 2012May 30 2012

Other

Other16th Annual Conference of the European Association for Machine Translation, EAMT 2012
CountryItaly
CityTrento
Period5/28/125/30/12

All Science Journal Classification (ASJC) codes

  • Language and Linguistics
  • Human-Computer Interaction
  • Software

Fingerprint Dive into the research topics of 'Exploiting shared Chinese characters in Chinese word segmentation optimization for Chinese-Japanese Machine Translation'. Together they form a unique fingerprint.

Cite this