Construction of an idiom corpus and its application to idiom identification based on WSD incorporating idiom-specific features

Chikara Hashimoto, Daisuke Kawahara

研究成果: Contribution to conferencePaper査読

15 被引用数 (Scopus)

抄録

Some phrases can be interpreted either idiomatically (figuratively) or literally in context, and the precise identification of idioms is indispensable for full-fledged natural language processing (NLP). To this end, we have constructed an idiom corpus for Japanese. This paper reports on the corpus and the results of an idiom identification experiment using the corpus. The corpus targets 146 ambiguous idioms, and consists of 102,846 sentences, each of which is annotated with a literal/idiom label. For idiom identification, we targeted 90 out of the 146 idioms and adopted a word sense disambiguation (WSD) method using both common WSD features and idiom-specific features. The corpus and the experiment are the largest of their kind, as far as we know. As a result, we found that a standard supervised WSD method works well for the idiom identification and achieved an accuracy of 89.25% and 88.86% with/without idiom-specific features and that the most effective idiom-specific feature is the one involving the adjacency of idiom constituents.

本文言語英語
ページ992-1001
ページ数10
DOI
出版ステータス出版済み - 2008
イベント2008 Conference on Empirical Methods in Natural Language Processing, EMNLP 2008, Co-located with AMTA 2008 and the International Workshop on Spoken Language Translation - Honolulu, HI, 米国
継続期間: 10 25 200810 27 2008

その他

その他2008 Conference on Empirical Methods in Natural Language Processing, EMNLP 2008, Co-located with AMTA 2008 and the International Workshop on Spoken Language Translation
国/地域米国
CityHonolulu, HI
Period10/25/0810/27/08

All Science Journal Classification (ASJC) codes

  • 情報システム
  • 計算理論と計算数学
  • コンピュータ サイエンスの応用

フィンガープリント

「Construction of an idiom corpus and its application to idiom identification based on WSD incorporating idiom-specific features」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル