Stable Image Registration for People Tracking from the Sky

Yumi Iwashita, Ryo Kurazume

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

We propose a novel method for stabilizing videos taken by a low altitude aerial vehicle, for the purpose of monitoring activities on the ground. A popular choice for aerial video stabilization is the use of homography-based methods, which assume that the scene consists mostly of planar regions. When videos are recorded in low altitude flight, the regions with buildings, trees and hills are non-planar areas (with relatively big changes in height), and making the planar assumption would decrease the accuracy of stabilization with respect to the ground. The idea presented in this paper is to stabilize aerial images, where height changes exist, by explicitly estimating a planar area in the scene. For the estimation of planar region, a relative pose between two images is estimated by taking advantages of the homography-based method and the essential matrix-based method. Positions in the 3D space are reconstructed from feature points on the images, which are used for the pose estimation, and points on the plane are estimated based on RANSAC. The points on the flat area are used for stabilization of images with high accuracy. The experimental results with simulated aerial images illustrate the proposed method can estimate relative pose with higher accuracy compared with previous approaches, even when noise is present. The proposed method is also applied to real aerial images, in people tracking. Experimental results show that tracking using the proposed method has better performance than tracking using the homography-based method.

Original languageEnglish
Title of host publicationProceedings - 2015 6th International Conference on Emerging Security Technologies, EST 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages69-73
Number of pages5
ISBN (Electronic)9781467397995
DOIs
Publication statusPublished - Mar 8 2016
Event6th International Conference on Emerging Security Technologies, EST 2015 - Braunschweig, Germany
Duration: Sep 3 2015Sep 5 2015

Publication series

NameProceedings - 2015 6th International Conference on Emerging Security Technologies, EST 2015

Other

Other6th International Conference on Emerging Security Technologies, EST 2015
CountryGermany
CityBraunschweig
Period9/3/159/5/15

Fingerprint

Image registration
Antennas
Stabilization
Antenna grounds
Monitoring

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Signal Processing

Cite this

Iwashita, Y., & Kurazume, R. (2016). Stable Image Registration for People Tracking from the Sky. In Proceedings - 2015 6th International Conference on Emerging Security Technologies, EST 2015 (pp. 69-73). [7429273] (Proceedings - 2015 6th International Conference on Emerging Security Technologies, EST 2015). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/EST.2015.14

Stable Image Registration for People Tracking from the Sky. / Iwashita, Yumi; Kurazume, Ryo.

Proceedings - 2015 6th International Conference on Emerging Security Technologies, EST 2015. Institute of Electrical and Electronics Engineers Inc., 2016. p. 69-73 7429273 (Proceedings - 2015 6th International Conference on Emerging Security Technologies, EST 2015).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Iwashita, Y & Kurazume, R 2016, Stable Image Registration for People Tracking from the Sky. in Proceedings - 2015 6th International Conference on Emerging Security Technologies, EST 2015., 7429273, Proceedings - 2015 6th International Conference on Emerging Security Technologies, EST 2015, Institute of Electrical and Electronics Engineers Inc., pp. 69-73, 6th International Conference on Emerging Security Technologies, EST 2015, Braunschweig, Germany, 9/3/15. https://doi.org/10.1109/EST.2015.14
Iwashita Y, Kurazume R. Stable Image Registration for People Tracking from the Sky. In Proceedings - 2015 6th International Conference on Emerging Security Technologies, EST 2015. Institute of Electrical and Electronics Engineers Inc. 2016. p. 69-73. 7429273. (Proceedings - 2015 6th International Conference on Emerging Security Technologies, EST 2015). https://doi.org/10.1109/EST.2015.14
Iwashita, Yumi ; Kurazume, Ryo. / Stable Image Registration for People Tracking from the Sky. Proceedings - 2015 6th International Conference on Emerging Security Technologies, EST 2015. Institute of Electrical and Electronics Engineers Inc., 2016. pp. 69-73 (Proceedings - 2015 6th International Conference on Emerging Security Technologies, EST 2015).
@inproceedings{7d2f99f059ee493b8bd473aa11a560ec,
title = "Stable Image Registration for People Tracking from the Sky",
abstract = "We propose a novel method for stabilizing videos taken by a low altitude aerial vehicle, for the purpose of monitoring activities on the ground. A popular choice for aerial video stabilization is the use of homography-based methods, which assume that the scene consists mostly of planar regions. When videos are recorded in low altitude flight, the regions with buildings, trees and hills are non-planar areas (with relatively big changes in height), and making the planar assumption would decrease the accuracy of stabilization with respect to the ground. The idea presented in this paper is to stabilize aerial images, where height changes exist, by explicitly estimating a planar area in the scene. For the estimation of planar region, a relative pose between two images is estimated by taking advantages of the homography-based method and the essential matrix-based method. Positions in the 3D space are reconstructed from feature points on the images, which are used for the pose estimation, and points on the plane are estimated based on RANSAC. The points on the flat area are used for stabilization of images with high accuracy. The experimental results with simulated aerial images illustrate the proposed method can estimate relative pose with higher accuracy compared with previous approaches, even when noise is present. The proposed method is also applied to real aerial images, in people tracking. Experimental results show that tracking using the proposed method has better performance than tracking using the homography-based method.",
author = "Yumi Iwashita and Ryo Kurazume",
year = "2016",
month = "3",
day = "8",
doi = "10.1109/EST.2015.14",
language = "English",
series = "Proceedings - 2015 6th International Conference on Emerging Security Technologies, EST 2015",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "69--73",
booktitle = "Proceedings - 2015 6th International Conference on Emerging Security Technologies, EST 2015",
address = "United States",

}

TY - GEN

T1 - Stable Image Registration for People Tracking from the Sky

AU - Iwashita, Yumi

AU - Kurazume, Ryo

PY - 2016/3/8

Y1 - 2016/3/8

N2 - We propose a novel method for stabilizing videos taken by a low altitude aerial vehicle, for the purpose of monitoring activities on the ground. A popular choice for aerial video stabilization is the use of homography-based methods, which assume that the scene consists mostly of planar regions. When videos are recorded in low altitude flight, the regions with buildings, trees and hills are non-planar areas (with relatively big changes in height), and making the planar assumption would decrease the accuracy of stabilization with respect to the ground. The idea presented in this paper is to stabilize aerial images, where height changes exist, by explicitly estimating a planar area in the scene. For the estimation of planar region, a relative pose between two images is estimated by taking advantages of the homography-based method and the essential matrix-based method. Positions in the 3D space are reconstructed from feature points on the images, which are used for the pose estimation, and points on the plane are estimated based on RANSAC. The points on the flat area are used for stabilization of images with high accuracy. The experimental results with simulated aerial images illustrate the proposed method can estimate relative pose with higher accuracy compared with previous approaches, even when noise is present. The proposed method is also applied to real aerial images, in people tracking. Experimental results show that tracking using the proposed method has better performance than tracking using the homography-based method.

AB - We propose a novel method for stabilizing videos taken by a low altitude aerial vehicle, for the purpose of monitoring activities on the ground. A popular choice for aerial video stabilization is the use of homography-based methods, which assume that the scene consists mostly of planar regions. When videos are recorded in low altitude flight, the regions with buildings, trees and hills are non-planar areas (with relatively big changes in height), and making the planar assumption would decrease the accuracy of stabilization with respect to the ground. The idea presented in this paper is to stabilize aerial images, where height changes exist, by explicitly estimating a planar area in the scene. For the estimation of planar region, a relative pose between two images is estimated by taking advantages of the homography-based method and the essential matrix-based method. Positions in the 3D space are reconstructed from feature points on the images, which are used for the pose estimation, and points on the plane are estimated based on RANSAC. The points on the flat area are used for stabilization of images with high accuracy. The experimental results with simulated aerial images illustrate the proposed method can estimate relative pose with higher accuracy compared with previous approaches, even when noise is present. The proposed method is also applied to real aerial images, in people tracking. Experimental results show that tracking using the proposed method has better performance than tracking using the homography-based method.

UR - http://www.scopus.com/inward/record.url?scp=84978063122&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84978063122&partnerID=8YFLogxK

U2 - 10.1109/EST.2015.14

DO - 10.1109/EST.2015.14

M3 - Conference contribution

T3 - Proceedings - 2015 6th International Conference on Emerging Security Technologies, EST 2015

SP - 69

EP - 73

BT - Proceedings - 2015 6th International Conference on Emerging Security Technologies, EST 2015

PB - Institute of Electrical and Electronics Engineers Inc.

ER -