Blended-keyframes for mobile mediated reality applications

Yu Xue, Diego Thomas, Frederic Rayar, Hideaki Uchiyama, Rin Ichiro Taniguchi, Boacai Yin

研究成果: Chapter in Book/Report/Conference proceedingConference contribution

抄録

With the recent developments of Mixed Reality (MR) devices and advances in 3D scene understanding, MR applications on mobile devices are becoming available to a large part of the society. These applications allow users to mix virtual content into the surrounding environment. However the ability to mediate (i.e., modify or alter) the surrounding environment remains a difficult and unsolved problem that limits the degree of immersion of current MR applications on mobile devices. In this paper, we present a method to mediate 2D views of a real environment using a single consumer-grade RGB-D camera and without the need of pre-scanning the scene. Our proposed method creates in real-Time a dense and detailed keyframe-based 3D map of the real scene and takes advantage of a semantic instance segmentation to isolate target objects. We show that our proposed method allows to remove target objects in the environment and to replace them by their virtual counterpart, which are built on-The-fly. Such an approach is well suited for creating mobile Mediated Reality applications.

本文言語英語
ホスト出版物のタイトルAdjunct Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019
出版社Institute of Electrical and Electronics Engineers Inc.
ページ211-216
ページ数6
ISBN(電子版)9781728147659
DOI
出版ステータス出版済み - 10 2019
イベント18th IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019 - Beijing, 中国
継続期間: 10 14 201910 18 2019

出版物シリーズ

名前Adjunct Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019

会議

会議18th IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019
国/地域中国
CityBeijing
Period10/14/1910/18/19

All Science Journal Classification (ASJC) codes

  • コンピュータ サイエンスの応用
  • 人間とコンピュータの相互作用
  • メディア記述

フィンガープリント

「Blended-keyframes for mobile mediated reality applications」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル