High-speed imaging using CMOS image sensor with quasi pixel-wise exposure

T. Sonoda, H. Nagahara, K. Endo, Y. Sugiyama, Rin-Ichiro Taniguchi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Several recent studies in compressive video sensing have realized scene capture beyond the fundamental trade-off limit between spatial resolution and temporal resolution using random space-time sampling. However, most of these studies showed results for higher frame rate video that were produced by simulation experiments or using an optically simulated random sampling camera, because there are currently no commercially available image sensors with random exposure or sampling capabilities. We fabricated a prototype complementary metal oxide semiconductor (CMOS) image sensor with quasi pixel-wise exposure timing that can realize nonuniform space-time sampling. The prototype sensor can reset exposures independently by columns and fix these amount of exposure by rows for each 8x8 pixel block. This CMOS sensor is not fully controllable via the pixels, and has line-dependent controls, but it offers flexibility when compared with regular CMOS or charge-coupled device sensors with global or rolling shutters. We propose a method to realize pseudo-random sampling for high-speed video acquisition that uses the flexibility of the CMOS sensor. We reconstruct the high-speed video sequence from the images produced by pseudo-random sampling using an over-complete dictionary.

Original languageEnglish
Title of host publicationSelected Papers from the 31st International Congress on High-Speed Imaging and Photonics
EditorsTakeharu Goji Etoh, Hiroyuki Shiraga, Takeharu Goji Etoh
PublisherSPIE
ISBN (Electronic)9781510611009
DOIs
Publication statusPublished - Jan 1 2017
Event31st International Congress on High-Speed Imaging and Photonics - Osaka, Japan
Duration: Nov 6 2016Nov 10 2016

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume10328
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Other

Other31st International Congress on High-Speed Imaging and Photonics
CountryJapan
CityOsaka
Period11/6/1611/10/16

Fingerprint

High-speed Imaging
Image Sensor
Image sensors
Oxides
Random Sampling
Semiconductors
CMOS
Pixel
Metals
Pixels
pixels
high speed
Sampling
random sampling
Imaging techniques
Sensor
sensors
High Speed
Space-time
Flexibility

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Cite this

Sonoda, T., Nagahara, H., Endo, K., Sugiyama, Y., & Taniguchi, R-I. (2017). High-speed imaging using CMOS image sensor with quasi pixel-wise exposure. In T. G. Etoh, H. Shiraga, & T. G. Etoh (Eds.), Selected Papers from the 31st International Congress on High-Speed Imaging and Photonics [103280A] (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 10328). SPIE. https://doi.org/10.1117/12.2270485

High-speed imaging using CMOS image sensor with quasi pixel-wise exposure. / Sonoda, T.; Nagahara, H.; Endo, K.; Sugiyama, Y.; Taniguchi, Rin-Ichiro.

Selected Papers from the 31st International Congress on High-Speed Imaging and Photonics. ed. / Takeharu Goji Etoh; Hiroyuki Shiraga; Takeharu Goji Etoh. SPIE, 2017. 103280A (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 10328).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Sonoda, T, Nagahara, H, Endo, K, Sugiyama, Y & Taniguchi, R-I 2017, High-speed imaging using CMOS image sensor with quasi pixel-wise exposure. in TG Etoh, H Shiraga & TG Etoh (eds), Selected Papers from the 31st International Congress on High-Speed Imaging and Photonics., 103280A, Proceedings of SPIE - The International Society for Optical Engineering, vol. 10328, SPIE, 31st International Congress on High-Speed Imaging and Photonics, Osaka, Japan, 11/6/16. https://doi.org/10.1117/12.2270485
Sonoda T, Nagahara H, Endo K, Sugiyama Y, Taniguchi R-I. High-speed imaging using CMOS image sensor with quasi pixel-wise exposure. In Etoh TG, Shiraga H, Etoh TG, editors, Selected Papers from the 31st International Congress on High-Speed Imaging and Photonics. SPIE. 2017. 103280A. (Proceedings of SPIE - The International Society for Optical Engineering). https://doi.org/10.1117/12.2270485
Sonoda, T. ; Nagahara, H. ; Endo, K. ; Sugiyama, Y. ; Taniguchi, Rin-Ichiro. / High-speed imaging using CMOS image sensor with quasi pixel-wise exposure. Selected Papers from the 31st International Congress on High-Speed Imaging and Photonics. editor / Takeharu Goji Etoh ; Hiroyuki Shiraga ; Takeharu Goji Etoh. SPIE, 2017. (Proceedings of SPIE - The International Society for Optical Engineering).
@inproceedings{8c3ae57e0d4a4e108a438070efe8578b,
title = "High-speed imaging using CMOS image sensor with quasi pixel-wise exposure",
abstract = "Several recent studies in compressive video sensing have realized scene capture beyond the fundamental trade-off limit between spatial resolution and temporal resolution using random space-time sampling. However, most of these studies showed results for higher frame rate video that were produced by simulation experiments or using an optically simulated random sampling camera, because there are currently no commercially available image sensors with random exposure or sampling capabilities. We fabricated a prototype complementary metal oxide semiconductor (CMOS) image sensor with quasi pixel-wise exposure timing that can realize nonuniform space-time sampling. The prototype sensor can reset exposures independently by columns and fix these amount of exposure by rows for each 8x8 pixel block. This CMOS sensor is not fully controllable via the pixels, and has line-dependent controls, but it offers flexibility when compared with regular CMOS or charge-coupled device sensors with global or rolling shutters. We propose a method to realize pseudo-random sampling for high-speed video acquisition that uses the flexibility of the CMOS sensor. We reconstruct the high-speed video sequence from the images produced by pseudo-random sampling using an over-complete dictionary.",
author = "T. Sonoda and H. Nagahara and K. Endo and Y. Sugiyama and Rin-Ichiro Taniguchi",
year = "2017",
month = "1",
day = "1",
doi = "10.1117/12.2270485",
language = "English",
series = "Proceedings of SPIE - The International Society for Optical Engineering",
publisher = "SPIE",
editor = "Etoh, {Takeharu Goji} and Hiroyuki Shiraga and Etoh, {Takeharu Goji}",
booktitle = "Selected Papers from the 31st International Congress on High-Speed Imaging and Photonics",
address = "United States",

}

TY - GEN

T1 - High-speed imaging using CMOS image sensor with quasi pixel-wise exposure

AU - Sonoda, T.

AU - Nagahara, H.

AU - Endo, K.

AU - Sugiyama, Y.

AU - Taniguchi, Rin-Ichiro

PY - 2017/1/1

Y1 - 2017/1/1

N2 - Several recent studies in compressive video sensing have realized scene capture beyond the fundamental trade-off limit between spatial resolution and temporal resolution using random space-time sampling. However, most of these studies showed results for higher frame rate video that were produced by simulation experiments or using an optically simulated random sampling camera, because there are currently no commercially available image sensors with random exposure or sampling capabilities. We fabricated a prototype complementary metal oxide semiconductor (CMOS) image sensor with quasi pixel-wise exposure timing that can realize nonuniform space-time sampling. The prototype sensor can reset exposures independently by columns and fix these amount of exposure by rows for each 8x8 pixel block. This CMOS sensor is not fully controllable via the pixels, and has line-dependent controls, but it offers flexibility when compared with regular CMOS or charge-coupled device sensors with global or rolling shutters. We propose a method to realize pseudo-random sampling for high-speed video acquisition that uses the flexibility of the CMOS sensor. We reconstruct the high-speed video sequence from the images produced by pseudo-random sampling using an over-complete dictionary.

AB - Several recent studies in compressive video sensing have realized scene capture beyond the fundamental trade-off limit between spatial resolution and temporal resolution using random space-time sampling. However, most of these studies showed results for higher frame rate video that were produced by simulation experiments or using an optically simulated random sampling camera, because there are currently no commercially available image sensors with random exposure or sampling capabilities. We fabricated a prototype complementary metal oxide semiconductor (CMOS) image sensor with quasi pixel-wise exposure timing that can realize nonuniform space-time sampling. The prototype sensor can reset exposures independently by columns and fix these amount of exposure by rows for each 8x8 pixel block. This CMOS sensor is not fully controllable via the pixels, and has line-dependent controls, but it offers flexibility when compared with regular CMOS or charge-coupled device sensors with global or rolling shutters. We propose a method to realize pseudo-random sampling for high-speed video acquisition that uses the flexibility of the CMOS sensor. We reconstruct the high-speed video sequence from the images produced by pseudo-random sampling using an over-complete dictionary.

UR - http://www.scopus.com/inward/record.url?scp=85016436039&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85016436039&partnerID=8YFLogxK

U2 - 10.1117/12.2270485

DO - 10.1117/12.2270485

M3 - Conference contribution

AN - SCOPUS:85016436039

T3 - Proceedings of SPIE - The International Society for Optical Engineering

BT - Selected Papers from the 31st International Congress on High-Speed Imaging and Photonics

A2 - Etoh, Takeharu Goji

A2 - Shiraga, Hiroyuki

A2 - Etoh, Takeharu Goji

PB - SPIE

ER -