Video deblurring and super-resolution technique for multiple moving objects

Takuma Yamaguchi, Hisato Fukuda, Ryo Furukawa, Hiroshi Kawasaki, Peter Sturm

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Citations (Scopus)

Abstract

Video camera is now commonly used and demand of capturing a single frame from video sequence is increasing. Since resolution of video camera is usually lower than digital camera and video data usually contains a many motion blur in the sequence, simple frame capture can produce only low quality image; image restoration technique is inevitably required. In this paper, we propose a method to restore a sharp and high-resolution image from a video sequence by motion deblur for each frame followed by super-resolution technique. Since the frame-rate of the video camera is high and variance of feature appearance in successive frames and motion of feature points are usually small, we can still estimate scene geometries from video data with blur. Therefore, by using such geometric information, we first apply motion deblur for each frame, and then, super-resolve the images from the deblurred image set. For better result, we also propose an adaptive super-resolution technique considering different defocus blur effects dependent on depth. Experimental results are shown to prove the strength of our method.

Original languageEnglish
Title of host publicationComputer Vision, ACCV 2010 - 10th Asian Conference on Computer Vision, Revised Selected Papers
Pages127-140
Number of pages14
EditionPART 4
DOIs
Publication statusPublished - Mar 16 2011
Externally publishedYes
Event10th Asian Conference on Computer Vision, ACCV 2010 - Queenstown, New Zealand
Duration: Nov 8 2010Nov 12 2010

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 4
Volume6495 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other10th Asian Conference on Computer Vision, ACCV 2010
CountryNew Zealand
CityQueenstown
Period11/8/1011/12/10

Fingerprint

Deblurring
Super-resolution
Video cameras
Moving Objects
Camera
Digital cameras
Image resolution
Image reconstruction
Image quality
Motion
Motion Blur
Defocus
Digital Video
Geometry
Digital Camera
Image Restoration
Feature Point
Image Quality
Resolve
High Resolution

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Yamaguchi, T., Fukuda, H., Furukawa, R., Kawasaki, H., & Sturm, P. (2011). Video deblurring and super-resolution technique for multiple moving objects. In Computer Vision, ACCV 2010 - 10th Asian Conference on Computer Vision, Revised Selected Papers (PART 4 ed., pp. 127-140). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6495 LNCS, No. PART 4). https://doi.org/10.1007/978-3-642-19282-1_11

Video deblurring and super-resolution technique for multiple moving objects. / Yamaguchi, Takuma; Fukuda, Hisato; Furukawa, Ryo; Kawasaki, Hiroshi; Sturm, Peter.

Computer Vision, ACCV 2010 - 10th Asian Conference on Computer Vision, Revised Selected Papers. PART 4. ed. 2011. p. 127-140 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6495 LNCS, No. PART 4).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Yamaguchi, T, Fukuda, H, Furukawa, R, Kawasaki, H & Sturm, P 2011, Video deblurring and super-resolution technique for multiple moving objects. in Computer Vision, ACCV 2010 - 10th Asian Conference on Computer Vision, Revised Selected Papers. PART 4 edn, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), no. PART 4, vol. 6495 LNCS, pp. 127-140, 10th Asian Conference on Computer Vision, ACCV 2010, Queenstown, New Zealand, 11/8/10. https://doi.org/10.1007/978-3-642-19282-1_11
Yamaguchi T, Fukuda H, Furukawa R, Kawasaki H, Sturm P. Video deblurring and super-resolution technique for multiple moving objects. In Computer Vision, ACCV 2010 - 10th Asian Conference on Computer Vision, Revised Selected Papers. PART 4 ed. 2011. p. 127-140. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 4). https://doi.org/10.1007/978-3-642-19282-1_11
Yamaguchi, Takuma ; Fukuda, Hisato ; Furukawa, Ryo ; Kawasaki, Hiroshi ; Sturm, Peter. / Video deblurring and super-resolution technique for multiple moving objects. Computer Vision, ACCV 2010 - 10th Asian Conference on Computer Vision, Revised Selected Papers. PART 4. ed. 2011. pp. 127-140 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 4).
@inproceedings{1b554c980e674d4b8f042ecf3ca89aa7,
title = "Video deblurring and super-resolution technique for multiple moving objects",
abstract = "Video camera is now commonly used and demand of capturing a single frame from video sequence is increasing. Since resolution of video camera is usually lower than digital camera and video data usually contains a many motion blur in the sequence, simple frame capture can produce only low quality image; image restoration technique is inevitably required. In this paper, we propose a method to restore a sharp and high-resolution image from a video sequence by motion deblur for each frame followed by super-resolution technique. Since the frame-rate of the video camera is high and variance of feature appearance in successive frames and motion of feature points are usually small, we can still estimate scene geometries from video data with blur. Therefore, by using such geometric information, we first apply motion deblur for each frame, and then, super-resolve the images from the deblurred image set. For better result, we also propose an adaptive super-resolution technique considering different defocus blur effects dependent on depth. Experimental results are shown to prove the strength of our method.",
author = "Takuma Yamaguchi and Hisato Fukuda and Ryo Furukawa and Hiroshi Kawasaki and Peter Sturm",
year = "2011",
month = "3",
day = "16",
doi = "10.1007/978-3-642-19282-1_11",
language = "English",
isbn = "9783642192814",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
number = "PART 4",
pages = "127--140",
booktitle = "Computer Vision, ACCV 2010 - 10th Asian Conference on Computer Vision, Revised Selected Papers",
edition = "PART 4",

}

TY - GEN

T1 - Video deblurring and super-resolution technique for multiple moving objects

AU - Yamaguchi, Takuma

AU - Fukuda, Hisato

AU - Furukawa, Ryo

AU - Kawasaki, Hiroshi

AU - Sturm, Peter

PY - 2011/3/16

Y1 - 2011/3/16

N2 - Video camera is now commonly used and demand of capturing a single frame from video sequence is increasing. Since resolution of video camera is usually lower than digital camera and video data usually contains a many motion blur in the sequence, simple frame capture can produce only low quality image; image restoration technique is inevitably required. In this paper, we propose a method to restore a sharp and high-resolution image from a video sequence by motion deblur for each frame followed by super-resolution technique. Since the frame-rate of the video camera is high and variance of feature appearance in successive frames and motion of feature points are usually small, we can still estimate scene geometries from video data with blur. Therefore, by using such geometric information, we first apply motion deblur for each frame, and then, super-resolve the images from the deblurred image set. For better result, we also propose an adaptive super-resolution technique considering different defocus blur effects dependent on depth. Experimental results are shown to prove the strength of our method.

AB - Video camera is now commonly used and demand of capturing a single frame from video sequence is increasing. Since resolution of video camera is usually lower than digital camera and video data usually contains a many motion blur in the sequence, simple frame capture can produce only low quality image; image restoration technique is inevitably required. In this paper, we propose a method to restore a sharp and high-resolution image from a video sequence by motion deblur for each frame followed by super-resolution technique. Since the frame-rate of the video camera is high and variance of feature appearance in successive frames and motion of feature points are usually small, we can still estimate scene geometries from video data with blur. Therefore, by using such geometric information, we first apply motion deblur for each frame, and then, super-resolve the images from the deblurred image set. For better result, we also propose an adaptive super-resolution technique considering different defocus blur effects dependent on depth. Experimental results are shown to prove the strength of our method.

UR - http://www.scopus.com/inward/record.url?scp=79952510995&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79952510995&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-19282-1_11

DO - 10.1007/978-3-642-19282-1_11

M3 - Conference contribution

SN - 9783642192814

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 127

EP - 140

BT - Computer Vision, ACCV 2010 - 10th Asian Conference on Computer Vision, Revised Selected Papers

ER -