RGB-D Images Based 3D Plant Growth Prediction by Sequential Images-to-Images Translation with Plant Priors

Tomohiro Hamamoto, Hideaki Uchiyama, Atsushi Shimada, Rin ichiro Taniguchi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents a neural network based method for 3D plant growth prediction based on sequential images-to-images translation. Especially, we extend an existing image-to-image translation technique based on U-Net to images-to-images translation by incorporating convLSTM into skip connections in U-Net. With this architecture, we can achieve sequential image prediction tasks such that future images are predicted from several past ones. Since depth images are incorporated as additional channel into our network, the prediction can be represented in 3D space. As an application of our method, we develop a 3D plant growth prediction system. In the evaluation, the performance of our network was investigated in terms of the importance of each module in the network. We verified how the prediction accuracy was affected by the internal structure of the network. In addition, the extension of our network with plant priors was further investigated to evaluate the impact for plant growth prediction tasks.

Original languageEnglish
Title of host publicationComputer Vision, Imaging and Computer Graphics Theory and Applications - 15th International Joint Conference, VISIGRAPP 2020, Revised Selected Papers
EditorsKadi Bouatouch, A. Augusto de Sousa, Manuela Chessa, Alexis Paljic, Andreas Kerren, Christophe Hurter, Giovanni Maria Farinella, Petia Radeva, Jose Braz
PublisherSpringer Science and Business Media Deutschland GmbH
Pages334-352
Number of pages19
ISBN (Print)9783030948924
DOIs
Publication statusPublished - 2022
Event15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP 2020 - Valletta, Malta
Duration: Feb 27 2020Feb 29 2020

Publication series

NameCommunications in Computer and Information Science
Volume1474 CCIS
ISSN (Print)1865-0929
ISSN (Electronic)1865-0937

Conference

Conference15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP 2020
Country/TerritoryMalta
CityValletta
Period2/27/202/29/20

All Science Journal Classification (ASJC) codes

  • Computer Science(all)
  • Mathematics(all)

Fingerprint

Dive into the research topics of 'RGB-D Images Based 3D Plant Growth Prediction by Sequential Images-to-Images Translation with Plant Priors'. Together they form a unique fingerprint.

Cite this