Synthesis of environment maps for mixed reality

David R. Walton, Diego Thomas, Anthony Steed, Akihiro Sugimoto

研究成果: Chapter in Book/Report/Conference proceedingConference contribution

7 被引用数 (Scopus)

抄録

When rendering virtual objects in a mixed reality application, it is helpful to have access to an environment map that captures the appearance of the scene from the perspective of the virtual object. It is straightforward to render virtual objects into such maps, but capturing and correctly rendering the real components of the scene into the map is much more challenging. This information is often recovered from physical light probes, such as reflective spheres or fisheye cameras, placed at the location of the virtual object in the scene. For many application areas, however, real light probes would be intrusive or impractical. Ideally, all of the information necessary to produce detailed environment maps could be captured using a single device. We introduce a method using an RGBD camera and a small fisheye camera, contained in a single unit, to create environment maps at any location in an indoor scene. The method combines the output from both cameras to correct for their limited field of view and the displacement from the virtual object, producing complete environment maps suitable for rendering the virtual content in real time. Our method improves on previous probeless approaches by its ability to recover high-frequency environment maps. We demonstrate how this can be used to render virtual objects which shadow, reflect and refract their environment convincingly.

本文言語英語
ホスト出版物のタイトルProceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2017
編集者Wolfgang Broll, Holger Regenbrecht, J Edward Swan
出版社Institute of Electrical and Electronics Engineers Inc.
ページ72-81
ページ数10
ISBN(電子版)9781538629437
DOI
出版ステータス出版済み - 11 20 2017
イベント16th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2017 - Nantes, フランス
継続期間: 10 9 201710 13 2017

出版物シリーズ

名前Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2017

その他

その他16th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2017
国/地域フランス
CityNantes
Period10/9/1710/13/17

All Science Journal Classification (ASJC) codes

  • コンピュータ グラフィックスおよびコンピュータ支援設計
  • メディア記述
  • モデリングとシミュレーション

フィンガープリント

「Synthesis of environment maps for mixed reality」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル