Distortion-free fusion of multiple video camera images using EPI analysis

Takeshi Mikami, Thanda Oo, Shintaro Ono, Hiroshi Kawasaki, Yutaka Ohsawa, Katsushi Ikeuchi

Research output: Contribution to journalArticle

Abstract

This paper presents a method that uses an Epipolar Plane Image (EPI) to calibrate multiple video cameras and obtain distortion-free fusion of these images. Generally speaking, the optical center of a camera exists inside its body making it physically difficult to focus these images at one point in multiple cameras. When fusing these types of camera images, distortion will occur unless three-dimensional shape information is used. In this paper we perform distortion-free image fusion by bringing these optical centers into agreement in a spatiotemporal field based on conditions in which multiple video cameras are installed on a movable object. The agreement points of the optical centers are automatically calculated by means of EPI matching. Because this process utilizes time-variant redundancy of each camera image, a stable corresponding relationship is obtained even when there is no spatial overlap of the photographic range making it possible to install cameras with comparative freedom. In addition, because it is possible to ensure sufficient quality without using special external synchronization devices or position measurement devices, this method is also suitable for acquiring textures of large-scale real scenes, such as urban spaces.

Original languageEnglish
Pages (from-to)85-98
Number of pages14
JournalElectronics and Communications in Japan, Part II: Electronics (English translation of Denshi Tsushin Gakkai Ronbunshi)
Volume90
Issue number11
DOIs
Publication statusPublished - Nov 1 2007
Externally publishedYes

Fingerprint

Video cameras
image analysis
Image analysis
fusion
Cameras
cameras
Position measurement
Image matching
Image fusion
Redundancy
Synchronization
Textures
redundancy
synchronism
textures

All Science Journal Classification (ASJC) codes

  • Physics and Astronomy(all)
  • Computer Networks and Communications
  • Electrical and Electronic Engineering

Cite this

Distortion-free fusion of multiple video camera images using EPI analysis. / Mikami, Takeshi; Oo, Thanda; Ono, Shintaro; Kawasaki, Hiroshi; Ohsawa, Yutaka; Ikeuchi, Katsushi.

In: Electronics and Communications in Japan, Part II: Electronics (English translation of Denshi Tsushin Gakkai Ronbunshi), Vol. 90, No. 11, 01.11.2007, p. 85-98.

Research output: Contribution to journalArticle

@article{29843e1feedb478bb3810905f4871c4e,
title = "Distortion-free fusion of multiple video camera images using EPI analysis",
abstract = "This paper presents a method that uses an Epipolar Plane Image (EPI) to calibrate multiple video cameras and obtain distortion-free fusion of these images. Generally speaking, the optical center of a camera exists inside its body making it physically difficult to focus these images at one point in multiple cameras. When fusing these types of camera images, distortion will occur unless three-dimensional shape information is used. In this paper we perform distortion-free image fusion by bringing these optical centers into agreement in a spatiotemporal field based on conditions in which multiple video cameras are installed on a movable object. The agreement points of the optical centers are automatically calculated by means of EPI matching. Because this process utilizes time-variant redundancy of each camera image, a stable corresponding relationship is obtained even when there is no spatial overlap of the photographic range making it possible to install cameras with comparative freedom. In addition, because it is possible to ensure sufficient quality without using special external synchronization devices or position measurement devices, this method is also suitable for acquiring textures of large-scale real scenes, such as urban spaces.",
author = "Takeshi Mikami and Thanda Oo and Shintaro Ono and Hiroshi Kawasaki and Yutaka Ohsawa and Katsushi Ikeuchi",
year = "2007",
month = "11",
day = "1",
doi = "10.1002/ecjb.20396",
language = "English",
volume = "90",
pages = "85--98",
journal = "Electronics and Communications in Japan, Part II: Electronics (English translation of Denshi Tsushin Gakkai Ronbunshi)",
issn = "8756-663X",
publisher = "Scripta Technica",
number = "11",

}

TY - JOUR

T1 - Distortion-free fusion of multiple video camera images using EPI analysis

AU - Mikami, Takeshi

AU - Oo, Thanda

AU - Ono, Shintaro

AU - Kawasaki, Hiroshi

AU - Ohsawa, Yutaka

AU - Ikeuchi, Katsushi

PY - 2007/11/1

Y1 - 2007/11/1

N2 - This paper presents a method that uses an Epipolar Plane Image (EPI) to calibrate multiple video cameras and obtain distortion-free fusion of these images. Generally speaking, the optical center of a camera exists inside its body making it physically difficult to focus these images at one point in multiple cameras. When fusing these types of camera images, distortion will occur unless three-dimensional shape information is used. In this paper we perform distortion-free image fusion by bringing these optical centers into agreement in a spatiotemporal field based on conditions in which multiple video cameras are installed on a movable object. The agreement points of the optical centers are automatically calculated by means of EPI matching. Because this process utilizes time-variant redundancy of each camera image, a stable corresponding relationship is obtained even when there is no spatial overlap of the photographic range making it possible to install cameras with comparative freedom. In addition, because it is possible to ensure sufficient quality without using special external synchronization devices or position measurement devices, this method is also suitable for acquiring textures of large-scale real scenes, such as urban spaces.

AB - This paper presents a method that uses an Epipolar Plane Image (EPI) to calibrate multiple video cameras and obtain distortion-free fusion of these images. Generally speaking, the optical center of a camera exists inside its body making it physically difficult to focus these images at one point in multiple cameras. When fusing these types of camera images, distortion will occur unless three-dimensional shape information is used. In this paper we perform distortion-free image fusion by bringing these optical centers into agreement in a spatiotemporal field based on conditions in which multiple video cameras are installed on a movable object. The agreement points of the optical centers are automatically calculated by means of EPI matching. Because this process utilizes time-variant redundancy of each camera image, a stable corresponding relationship is obtained even when there is no spatial overlap of the photographic range making it possible to install cameras with comparative freedom. In addition, because it is possible to ensure sufficient quality without using special external synchronization devices or position measurement devices, this method is also suitable for acquiring textures of large-scale real scenes, such as urban spaces.

UR - http://www.scopus.com/inward/record.url?scp=36348943465&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=36348943465&partnerID=8YFLogxK

U2 - 10.1002/ecjb.20396

DO - 10.1002/ecjb.20396

M3 - Article

AN - SCOPUS:36348943465

VL - 90

SP - 85

EP - 98

JO - Electronics and Communications in Japan, Part II: Electronics (English translation of Denshi Tsushin Gakkai Ronbunshi)

JF - Electronics and Communications in Japan, Part II: Electronics (English translation of Denshi Tsushin Gakkai Ronbunshi)

SN - 8756-663X

IS - 11

ER -