CNN based dense underwater 3D scene reconstruction by transfer learning using bubble database

Kazuto Ichimaru, Ryo Furukawa, Hiroshi Kawasaki

研究成果: Chapter in Book/Report/Conference proceedingConference contribution

抜粋

Dense 3D shape acquisition of swimming human or live fish is an important research topic for sports, biological science and so on. For this purpose, active stereo sensor is usually used in the air, however it cannot be applied to the underwater environment because of refraction, strong light attenuation and severe interference of bubbles. Passive stereo is a simple solution for capturing dynamic scenes at underwater environment, however the shape with textureless surfaces or irregular reflections cannot be recovered. Recently, the stereo camera pair with a pattern projector for adding artificial textures on the objects is proposed. However, to use the system for underwater environment, several problems should be compensated, i.e., disturbance by fluctuation and bubbles. Simple solution is to use convolutional neural network for stereo to cancel the effects of bubbles and/or water fluctuation. Since it is not easy to train CNN with small size of database with large variation, we develop a special bubble generation device to efficiently create real bubble database of multiple size and density. In addition, we propose a transfer learning technique for multi-scale CNN to effectively remove bubbles and projected-patterns on the object. Further, we develop a real system and actually captured live swimming human, which has not been done before. Experiments are conducted to show the effectiveness of our method compared with the state of the art techniques.

元の言語英語
ホスト出版物のタイトルProceedings - 2019 IEEE Winter Conference on Applications of Computer Vision, WACV 2019
出版者Institute of Electrical and Electronics Engineers Inc.
ページ1543-1552
ページ数10
ISBN(電子版)9781728119755
DOI
出版物ステータス出版済み - 3 4 2019
イベント19th IEEE Winter Conference on Applications of Computer Vision, WACV 2019 - Waikoloa Village, 米国
継続期間: 1 7 20191 11 2019

出版物シリーズ

名前Proceedings - 2019 IEEE Winter Conference on Applications of Computer Vision, WACV 2019

会議

会議19th IEEE Winter Conference on Applications of Computer Vision, WACV 2019
米国
Waikoloa Village
期間1/7/191/11/19

All Science Journal Classification (ASJC) codes

  • Computer Vision and Pattern Recognition
  • Computer Science Applications

フィンガープリント CNN based dense underwater 3D scene reconstruction by transfer learning using bubble database' の研究トピックを掘り下げます。これらはともに一意のフィンガープリントを構成します。

  • これを引用

    Ichimaru, K., Furukawa, R., & Kawasaki, H. (2019). CNN based dense underwater 3D scene reconstruction by transfer learning using bubble database. : Proceedings - 2019 IEEE Winter Conference on Applications of Computer Vision, WACV 2019 (pp. 1543-1552). [8659224] (Proceedings - 2019 IEEE Winter Conference on Applications of Computer Vision, WACV 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/WACV.2019.00169