Voice and gesture based 3D multimedia presentation tool

Hiromichi Fukutake, Yoshiaki Akazawa, Yoshihiro Okada

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper proposes a 3D multimedia presentation tool that allows the user to manipulate intuitively only through the voice input and the gesture input without using a standard keyboard or a mouse device. The authors developed this system as a presentation tool to be used in a presentation room equipped a large screen like an exhibition room in a museum because, in such a presentation environment, it is better to use voice commands and the gesture pointing input rather than using a keyboard or a mouse device. This system was developed using IntelligentBox, which is a component-based 3D graphics software development system. IntelligentBox has already provided various types of 3D visible, reactive functional components called boxes, e.g., a voice input component and various multimedia handling components. IntelligentBox also provides a dynamic data linkage mechanism called slot-connection that allows the user to develop 3D graphics applications by combining already existing boxes through direct manipulations on a computer screen. Using IntelligentBox, the 3D multimedia presentation tool proposed in this paper was also developed as combined components only through direct manipulations on a computer screen. The authors have already proposed a 3D multimedia presentation tool using a stage metaphor and its voice input interface. This time, we extended the system to make it accept the user gesture input besides voice commands. This paper explains details of the proposed 3D multimedia presentation tool and especially describes its component-based voice and gesture input interfaces.

Original languageEnglish
Title of host publicationMultimedia Systems and Applications X
DOIs
Publication statusPublished - Dec 1 2007
EventMultimedia Systems and Applications X - Boston, MA, United States
Duration: Sep 10 2007Sep 11 2007

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume6777
ISSN (Print)0277-786X

Other

OtherMultimedia Systems and Applications X
CountryUnited States
CityBoston, MA
Period9/10/079/11/07

Fingerprint

multimedia
Speech recognition
commands
rooms
mice
boxes
manipulators
Museums
museums
Software engineering
slots
linkages
computer programs

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Cite this

Fukutake, H., Akazawa, Y., & Okada, Y. (2007). Voice and gesture based 3D multimedia presentation tool. In Multimedia Systems and Applications X [67770V] (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 6777). https://doi.org/10.1117/12.734783

Voice and gesture based 3D multimedia presentation tool. / Fukutake, Hiromichi; Akazawa, Yoshiaki; Okada, Yoshihiro.

Multimedia Systems and Applications X. 2007. 67770V (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 6777).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Fukutake, H, Akazawa, Y & Okada, Y 2007, Voice and gesture based 3D multimedia presentation tool. in Multimedia Systems and Applications X., 67770V, Proceedings of SPIE - The International Society for Optical Engineering, vol. 6777, Multimedia Systems and Applications X, Boston, MA, United States, 9/10/07. https://doi.org/10.1117/12.734783
Fukutake H, Akazawa Y, Okada Y. Voice and gesture based 3D multimedia presentation tool. In Multimedia Systems and Applications X. 2007. 67770V. (Proceedings of SPIE - The International Society for Optical Engineering). https://doi.org/10.1117/12.734783
Fukutake, Hiromichi ; Akazawa, Yoshiaki ; Okada, Yoshihiro. / Voice and gesture based 3D multimedia presentation tool. Multimedia Systems and Applications X. 2007. (Proceedings of SPIE - The International Society for Optical Engineering).
@inproceedings{146e06065c414801acb4e1c4e095780a,
title = "Voice and gesture based 3D multimedia presentation tool",
abstract = "This paper proposes a 3D multimedia presentation tool that allows the user to manipulate intuitively only through the voice input and the gesture input without using a standard keyboard or a mouse device. The authors developed this system as a presentation tool to be used in a presentation room equipped a large screen like an exhibition room in a museum because, in such a presentation environment, it is better to use voice commands and the gesture pointing input rather than using a keyboard or a mouse device. This system was developed using IntelligentBox, which is a component-based 3D graphics software development system. IntelligentBox has already provided various types of 3D visible, reactive functional components called boxes, e.g., a voice input component and various multimedia handling components. IntelligentBox also provides a dynamic data linkage mechanism called slot-connection that allows the user to develop 3D graphics applications by combining already existing boxes through direct manipulations on a computer screen. Using IntelligentBox, the 3D multimedia presentation tool proposed in this paper was also developed as combined components only through direct manipulations on a computer screen. The authors have already proposed a 3D multimedia presentation tool using a stage metaphor and its voice input interface. This time, we extended the system to make it accept the user gesture input besides voice commands. This paper explains details of the proposed 3D multimedia presentation tool and especially describes its component-based voice and gesture input interfaces.",
author = "Hiromichi Fukutake and Yoshiaki Akazawa and Yoshihiro Okada",
year = "2007",
month = "12",
day = "1",
doi = "10.1117/12.734783",
language = "English",
isbn = "9780819469373",
series = "Proceedings of SPIE - The International Society for Optical Engineering",
booktitle = "Multimedia Systems and Applications X",

}

TY - GEN

T1 - Voice and gesture based 3D multimedia presentation tool

AU - Fukutake, Hiromichi

AU - Akazawa, Yoshiaki

AU - Okada, Yoshihiro

PY - 2007/12/1

Y1 - 2007/12/1

N2 - This paper proposes a 3D multimedia presentation tool that allows the user to manipulate intuitively only through the voice input and the gesture input without using a standard keyboard or a mouse device. The authors developed this system as a presentation tool to be used in a presentation room equipped a large screen like an exhibition room in a museum because, in such a presentation environment, it is better to use voice commands and the gesture pointing input rather than using a keyboard or a mouse device. This system was developed using IntelligentBox, which is a component-based 3D graphics software development system. IntelligentBox has already provided various types of 3D visible, reactive functional components called boxes, e.g., a voice input component and various multimedia handling components. IntelligentBox also provides a dynamic data linkage mechanism called slot-connection that allows the user to develop 3D graphics applications by combining already existing boxes through direct manipulations on a computer screen. Using IntelligentBox, the 3D multimedia presentation tool proposed in this paper was also developed as combined components only through direct manipulations on a computer screen. The authors have already proposed a 3D multimedia presentation tool using a stage metaphor and its voice input interface. This time, we extended the system to make it accept the user gesture input besides voice commands. This paper explains details of the proposed 3D multimedia presentation tool and especially describes its component-based voice and gesture input interfaces.

AB - This paper proposes a 3D multimedia presentation tool that allows the user to manipulate intuitively only through the voice input and the gesture input without using a standard keyboard or a mouse device. The authors developed this system as a presentation tool to be used in a presentation room equipped a large screen like an exhibition room in a museum because, in such a presentation environment, it is better to use voice commands and the gesture pointing input rather than using a keyboard or a mouse device. This system was developed using IntelligentBox, which is a component-based 3D graphics software development system. IntelligentBox has already provided various types of 3D visible, reactive functional components called boxes, e.g., a voice input component and various multimedia handling components. IntelligentBox also provides a dynamic data linkage mechanism called slot-connection that allows the user to develop 3D graphics applications by combining already existing boxes through direct manipulations on a computer screen. Using IntelligentBox, the 3D multimedia presentation tool proposed in this paper was also developed as combined components only through direct manipulations on a computer screen. The authors have already proposed a 3D multimedia presentation tool using a stage metaphor and its voice input interface. This time, we extended the system to make it accept the user gesture input besides voice commands. This paper explains details of the proposed 3D multimedia presentation tool and especially describes its component-based voice and gesture input interfaces.

UR - http://www.scopus.com/inward/record.url?scp=42549150343&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=42549150343&partnerID=8YFLogxK

U2 - 10.1117/12.734783

DO - 10.1117/12.734783

M3 - Conference contribution

AN - SCOPUS:42549150343

SN - 9780819469373

T3 - Proceedings of SPIE - The International Society for Optical Engineering

BT - Multimedia Systems and Applications X

ER -