Joint optimization for compressive video sensing and reconstruction under hardware constraints

Michitaka Yoshida, Akihiko Torii, Masatoshi Okutomi, Kenta Endo, Yukinobu Sugiyama, Rin-Ichiro Taniguchi, Hajime Nagahara

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Compressive video sensing is the process of encoding multiple sub-frames into a single frame with controlled sensor exposures and reconstructing the sub-frames from the single compressed frame. It is known that spatially and temporally random exposures provide the most balanced compression in terms of signal recovery. However, sensors that achieve a fully random exposure on each pixel cannot be easily realized in practice because the circuit of the sensor becomes complicated and incompatible with the sensitivity and resolution. Therefore, it is necessary to design an exposure pattern by considering the constraints enforced by hardware. In this paper, we propose a method of jointly optimizing the exposure patterns of compressive sensing and the reconstruction framework under hardware constraints. By conducting a simulation and actual experiments, we demonstrated that the proposed framework can reconstruct multiple sub-frame images with higher quality.

Original languageEnglish
Title of host publicationComputer Vision – ECCV 2018 - 15th European Conference, 2018, Proceedings
EditorsMartial Hebert, Vittorio Ferrari, Cristian Sminchisescu, Yair Weiss
PublisherSpringer Verlag
Pages649-663
Number of pages15
ISBN (Print)9783030012489
DOIs
Publication statusPublished - Jan 1 2018
Event15th European Conference on Computer Vision, ECCV 2018 - Munich, Germany
Duration: Sep 8 2018Sep 14 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11214 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other15th European Conference on Computer Vision, ECCV 2018
CountryGermany
CityMunich
Period9/8/189/14/18

Fingerprint

Sensing
Hardware
Optimization
Sensors
Sensor
Pixels
Compressive Sensing
Recovery
Networks (circuits)
Encoding
Compression
Pixel
Experiments
Necessary
Experiment
Simulation
Framework

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Yoshida, M., Torii, A., Okutomi, M., Endo, K., Sugiyama, Y., Taniguchi, R-I., & Nagahara, H. (2018). Joint optimization for compressive video sensing and reconstruction under hardware constraints. In M. Hebert, V. Ferrari, C. Sminchisescu, & Y. Weiss (Eds.), Computer Vision – ECCV 2018 - 15th European Conference, 2018, Proceedings (pp. 649-663). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11214 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-030-01249-6_39

Joint optimization for compressive video sensing and reconstruction under hardware constraints. / Yoshida, Michitaka; Torii, Akihiko; Okutomi, Masatoshi; Endo, Kenta; Sugiyama, Yukinobu; Taniguchi, Rin-Ichiro; Nagahara, Hajime.

Computer Vision – ECCV 2018 - 15th European Conference, 2018, Proceedings. ed. / Martial Hebert; Vittorio Ferrari; Cristian Sminchisescu; Yair Weiss. Springer Verlag, 2018. p. 649-663 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11214 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Yoshida, M, Torii, A, Okutomi, M, Endo, K, Sugiyama, Y, Taniguchi, R-I & Nagahara, H 2018, Joint optimization for compressive video sensing and reconstruction under hardware constraints. in M Hebert, V Ferrari, C Sminchisescu & Y Weiss (eds), Computer Vision – ECCV 2018 - 15th European Conference, 2018, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11214 LNCS, Springer Verlag, pp. 649-663, 15th European Conference on Computer Vision, ECCV 2018, Munich, Germany, 9/8/18. https://doi.org/10.1007/978-3-030-01249-6_39
Yoshida M, Torii A, Okutomi M, Endo K, Sugiyama Y, Taniguchi R-I et al. Joint optimization for compressive video sensing and reconstruction under hardware constraints. In Hebert M, Ferrari V, Sminchisescu C, Weiss Y, editors, Computer Vision – ECCV 2018 - 15th European Conference, 2018, Proceedings. Springer Verlag. 2018. p. 649-663. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-030-01249-6_39
Yoshida, Michitaka ; Torii, Akihiko ; Okutomi, Masatoshi ; Endo, Kenta ; Sugiyama, Yukinobu ; Taniguchi, Rin-Ichiro ; Nagahara, Hajime. / Joint optimization for compressive video sensing and reconstruction under hardware constraints. Computer Vision – ECCV 2018 - 15th European Conference, 2018, Proceedings. editor / Martial Hebert ; Vittorio Ferrari ; Cristian Sminchisescu ; Yair Weiss. Springer Verlag, 2018. pp. 649-663 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{938da844c76748b3812b2ced9654180b,
title = "Joint optimization for compressive video sensing and reconstruction under hardware constraints",
abstract = "Compressive video sensing is the process of encoding multiple sub-frames into a single frame with controlled sensor exposures and reconstructing the sub-frames from the single compressed frame. It is known that spatially and temporally random exposures provide the most balanced compression in terms of signal recovery. However, sensors that achieve a fully random exposure on each pixel cannot be easily realized in practice because the circuit of the sensor becomes complicated and incompatible with the sensitivity and resolution. Therefore, it is necessary to design an exposure pattern by considering the constraints enforced by hardware. In this paper, we propose a method of jointly optimizing the exposure patterns of compressive sensing and the reconstruction framework under hardware constraints. By conducting a simulation and actual experiments, we demonstrated that the proposed framework can reconstruct multiple sub-frame images with higher quality.",
author = "Michitaka Yoshida and Akihiko Torii and Masatoshi Okutomi and Kenta Endo and Yukinobu Sugiyama and Rin-Ichiro Taniguchi and Hajime Nagahara",
year = "2018",
month = "1",
day = "1",
doi = "10.1007/978-3-030-01249-6_39",
language = "English",
isbn = "9783030012489",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "649--663",
editor = "Martial Hebert and Vittorio Ferrari and Cristian Sminchisescu and Yair Weiss",
booktitle = "Computer Vision – ECCV 2018 - 15th European Conference, 2018, Proceedings",
address = "Germany",

}

TY - GEN

T1 - Joint optimization for compressive video sensing and reconstruction under hardware constraints

AU - Yoshida, Michitaka

AU - Torii, Akihiko

AU - Okutomi, Masatoshi

AU - Endo, Kenta

AU - Sugiyama, Yukinobu

AU - Taniguchi, Rin-Ichiro

AU - Nagahara, Hajime

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Compressive video sensing is the process of encoding multiple sub-frames into a single frame with controlled sensor exposures and reconstructing the sub-frames from the single compressed frame. It is known that spatially and temporally random exposures provide the most balanced compression in terms of signal recovery. However, sensors that achieve a fully random exposure on each pixel cannot be easily realized in practice because the circuit of the sensor becomes complicated and incompatible with the sensitivity and resolution. Therefore, it is necessary to design an exposure pattern by considering the constraints enforced by hardware. In this paper, we propose a method of jointly optimizing the exposure patterns of compressive sensing and the reconstruction framework under hardware constraints. By conducting a simulation and actual experiments, we demonstrated that the proposed framework can reconstruct multiple sub-frame images with higher quality.

AB - Compressive video sensing is the process of encoding multiple sub-frames into a single frame with controlled sensor exposures and reconstructing the sub-frames from the single compressed frame. It is known that spatially and temporally random exposures provide the most balanced compression in terms of signal recovery. However, sensors that achieve a fully random exposure on each pixel cannot be easily realized in practice because the circuit of the sensor becomes complicated and incompatible with the sensitivity and resolution. Therefore, it is necessary to design an exposure pattern by considering the constraints enforced by hardware. In this paper, we propose a method of jointly optimizing the exposure patterns of compressive sensing and the reconstruction framework under hardware constraints. By conducting a simulation and actual experiments, we demonstrated that the proposed framework can reconstruct multiple sub-frame images with higher quality.

UR - http://www.scopus.com/inward/record.url?scp=85055107362&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85055107362&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-01249-6_39

DO - 10.1007/978-3-030-01249-6_39

M3 - Conference contribution

AN - SCOPUS:85055107362

SN - 9783030012489

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 649

EP - 663

BT - Computer Vision – ECCV 2018 - 15th European Conference, 2018, Proceedings

A2 - Hebert, Martial

A2 - Ferrari, Vittorio

A2 - Sminchisescu, Cristian

A2 - Weiss, Yair

PB - Springer Verlag

ER -