A proposal of facial picture control incorporating several essences of conversation

Tsuneko Kara, Nobuyuki Watanabe, Shigeru Takano, Hideaki Kanayama

Research output: Contribution to journalArticlepeer-review


In the context of an interactive interface with a computer, a method is proposed for simple representation of dialog states by switching between facial pictures according to voice information. First, essences that represent dialog states are drawn out, and examined separately. Continuous mouth movement during the process of speech is presented as the vocal essence. The importance of the speaker's and listener's movements is shown, and necessity of imitating those movements is explained; this is treated as the realistic essence. As to the formal essence, an algorithm is proposed to represent an interlocutor by a facial picture while bringing its mouth into motion according to loudness. The effectiveness of the proposed method is verified by comparative experiments. The optimal display rate for the proposed method is determined experimentally.

Original languageEnglish
Pages (from-to)57-64
Number of pages8
JournalSystems and Computers in Japan
Issue number7
Publication statusPublished - Jun 30 1998

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Information Systems
  • Hardware and Architecture
  • Computational Theory and Mathematics

Fingerprint Dive into the research topics of 'A proposal of facial picture control incorporating several essences of conversation'. Together they form a unique fingerprint.

Cite this