Remagicmirror: Action learning using human reenactment with the mirror metaphor

Fabian Lorenzo Dayrit, Ryosuke Kimura, Yuta Nakashima, Ambrosio Blanco, Hiroshi Kawasaki, Katsushi Ikeuchi, Tomokazu Sato, Naokazu Yokoya

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

We propose ReMagicMirror, a system to help people learn actions (e.g., martial arts, dances). We first capture the motions of a teacher performing the action to learn, using two RGB-D cameras. Next, we fit a parametric human body model to the depth data and texture it using the color data, reconstructing the teacher’s motion and appearance. The learner is then shown the ReMagicMirror system, which acts as a mirror. We overlay the teacher’s reconstructed body on top of this mirror in an augmented reality fashion. The learner is able to intuitively manipulate the reconstruction’s viewpoint by simply rotating her body, allowing for easy comparisons between the learner and the teacher. We perform a user study to evaluate our system’s ease of use, effectiveness, quality, and appeal.

Original languageEnglish
Title of host publicationMultiMedia Modeling - 23rd International Conference, MMM 2017, Proceedings
EditorsGylfi Thór Gudmundsson, Shin’ichi Satoh, Laurent Amsaleg, Björn Thór Jónsson, Cathal Gurrin
PublisherSpringer Verlag
Pages303-315
Number of pages13
ISBN (Print)9783319518107
DOIs
Publication statusPublished - Jan 1 2017
Externally publishedYes
Event23rd International Conference on MultiMedia Modeling, MMM 2017 - Reykjavik, Iceland
Duration: Jan 4 2017Jan 6 2017

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10132 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other23rd International Conference on MultiMedia Modeling, MMM 2017
CountryIceland
CityReykjavik
Period1/4/171/6/17

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Dayrit, F. L., Kimura, R., Nakashima, Y., Blanco, A., Kawasaki, H., Ikeuchi, K., ... Yokoya, N. (2017). Remagicmirror: Action learning using human reenactment with the mirror metaphor. In G. T. Gudmundsson, S. Satoh, L. Amsaleg, B. T. Jónsson, & C. Gurrin (Eds.), MultiMedia Modeling - 23rd International Conference, MMM 2017, Proceedings (pp. 303-315). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10132 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-51811-4_25