First-person activity recognition with C3D features from optical flow images

Asamichi Takamine, Yumi Iwashita, Ryo Kurazume

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

This paper proposes new features extracted from images derived from optical flow, for first-person activity recognition. Features from convolutional neural network (CNN), which is designed for 2D images, attract attention from computer vision researchers due to its powerful discrimination capability, and recently a convolutional neural network for videos, called C3D (Convolutional 3D), was proposed. Generally CNN / C3D features are extracted directly from original images / videos with pre-trained convolutional neural network, since the network was trained with images / videos. In this paper, on the other hand, we propose the use of images derived from optical flow (we call this image as "optical flow image") as input images into the pre-trained neural network, based on the following reasons; (i) optical flow images give dynamic information which is useful for activity recognition, compared with original images, which give only static information, and (ii) the pre-trained network has chance to extract features with reasonable discrimination capability, since the network was trained with huge amount of images from big categories. We carry out experiments with a dataset named "DogCentric Activity Dataset", and we show the effectiveness of the extracted features.

Original languageEnglish
Title of host publication2015 IEEE/SICE International Symposium on System Integration, SII 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages619-622
Number of pages4
ISBN (Electronic)9781467372428
DOIs
Publication statusPublished - Feb 10 2016
Event8th Annual IEEE/SICE International Symposium on System Integration, SII 2015 - Nagoya, Japan
Duration: Dec 11 2015Dec 13 2015

Publication series

Name2015 IEEE/SICE International Symposium on System Integration, SII 2015

Other

Other8th Annual IEEE/SICE International Symposium on System Integration, SII 2015
CountryJapan
CityNagoya
Period12/11/1512/13/15

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Control and Systems Engineering

Cite this

Takamine, A., Iwashita, Y., & Kurazume, R. (2016). First-person activity recognition with C3D features from optical flow images. In 2015 IEEE/SICE International Symposium on System Integration, SII 2015 (pp. 619-622). [7405050] (2015 IEEE/SICE International Symposium on System Integration, SII 2015). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/SII.2015.7405050