A proposal of facial picture control incorporating several essences of conversation

Tsuneko Kara, Nobuyuki Watanabe, Shigeru Takano, Hideaki Kanayama

Research output: Contribution to journalArticle

Abstract

In the context of an interactive interface with a computer, a method is proposed for simple representation of dialog states by switching between facial pictures according to voice information. First, essences that represent dialog states are drawn out, and examined separately. Continuous mouth movement during the process of speech is presented as the vocal essence. The importance of the speaker's and listener's movements is shown, and necessity of imitating those movements is explained; this is treated as the realistic essence. As to the formal essence, an algorithm is proposed to represent an interlocutor by a facial picture while bringing its mouth into motion according to loudness. The effectiveness of the proposed method is verified by comparative experiments. The optimal display rate for the proposed method is determined experimentally.

Original languageEnglish
Pages (from-to)57-64
Number of pages8
JournalSystems and Computers in Japan
Volume29
Issue number7
Publication statusPublished - Jun 30 1998

Fingerprint

Interfaces (computer)
Display devices
Display
Motion
Experiments
Experiment
Movement
Dialogue
Necessity
Context
Voice
Speech

All Science Journal Classification (ASJC) codes

  • Hardware and Architecture
  • Information Systems
  • Theoretical Computer Science
  • Computational Theory and Mathematics

Cite this

A proposal of facial picture control incorporating several essences of conversation. / Kara, Tsuneko; Watanabe, Nobuyuki; Takano, Shigeru; Kanayama, Hideaki.

In: Systems and Computers in Japan, Vol. 29, No. 7, 30.06.1998, p. 57-64.

Research output: Contribution to journalArticle

Kara, Tsuneko ; Watanabe, Nobuyuki ; Takano, Shigeru ; Kanayama, Hideaki. / A proposal of facial picture control incorporating several essences of conversation. In: Systems and Computers in Japan. 1998 ; Vol. 29, No. 7. pp. 57-64.
@article{f73e78556e69463393da824c55cbbfb9,
title = "A proposal of facial picture control incorporating several essences of conversation",
abstract = "In the context of an interactive interface with a computer, a method is proposed for simple representation of dialog states by switching between facial pictures according to voice information. First, essences that represent dialog states are drawn out, and examined separately. Continuous mouth movement during the process of speech is presented as the vocal essence. The importance of the speaker's and listener's movements is shown, and necessity of imitating those movements is explained; this is treated as the realistic essence. As to the formal essence, an algorithm is proposed to represent an interlocutor by a facial picture while bringing its mouth into motion according to loudness. The effectiveness of the proposed method is verified by comparative experiments. The optimal display rate for the proposed method is determined experimentally.",
author = "Tsuneko Kara and Nobuyuki Watanabe and Shigeru Takano and Hideaki Kanayama",
year = "1998",
month = "6",
day = "30",
language = "English",
volume = "29",
pages = "57--64",
journal = "Systems and Computers in Japan",
issn = "0882-1666",
publisher = "John Wiley and Sons Inc.",
number = "7",

}

TY - JOUR

T1 - A proposal of facial picture control incorporating several essences of conversation

AU - Kara, Tsuneko

AU - Watanabe, Nobuyuki

AU - Takano, Shigeru

AU - Kanayama, Hideaki

PY - 1998/6/30

Y1 - 1998/6/30

N2 - In the context of an interactive interface with a computer, a method is proposed for simple representation of dialog states by switching between facial pictures according to voice information. First, essences that represent dialog states are drawn out, and examined separately. Continuous mouth movement during the process of speech is presented as the vocal essence. The importance of the speaker's and listener's movements is shown, and necessity of imitating those movements is explained; this is treated as the realistic essence. As to the formal essence, an algorithm is proposed to represent an interlocutor by a facial picture while bringing its mouth into motion according to loudness. The effectiveness of the proposed method is verified by comparative experiments. The optimal display rate for the proposed method is determined experimentally.

AB - In the context of an interactive interface with a computer, a method is proposed for simple representation of dialog states by switching between facial pictures according to voice information. First, essences that represent dialog states are drawn out, and examined separately. Continuous mouth movement during the process of speech is presented as the vocal essence. The importance of the speaker's and listener's movements is shown, and necessity of imitating those movements is explained; this is treated as the realistic essence. As to the formal essence, an algorithm is proposed to represent an interlocutor by a facial picture while bringing its mouth into motion according to loudness. The effectiveness of the proposed method is verified by comparative experiments. The optimal display rate for the proposed method is determined experimentally.

UR - http://www.scopus.com/inward/record.url?scp=0032092869&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0032092869&partnerID=8YFLogxK

M3 - Article

VL - 29

SP - 57

EP - 64

JO - Systems and Computers in Japan

JF - Systems and Computers in Japan

SN - 0882-1666

IS - 7

ER -