Automatic Content Curation System for Multiple Live Sport Video Streams

Kazuki Fujisawa, Yuko Hirabe, Hirohiko Suwa, Yutaka Arakawa, Keiichi Yasumoto

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

In this paper, we aim to develop a method to create personalized and high-presence multi-channel contents for a sport game through realtime content curation from various media streams captured/created by spectators. We use the live TV broadcast as a ground truth data and construct a machine learning-based model to automatically conduct curation from multiple videos which spectators captured from different angles and zoom levels. The live TV broadcast of a baseball game has some curation rules which select a specific angle camera for some specific scenes (e.g., a pitcher throwing a ball). As inputs for constructing a model, we use meta data such as image feature data (e.g., a pitcher is on the screen) in each fixed interval of baseball videos and game progress data (e.g., the inning number and the batting order). Output is the camera ID (among multiple cameras of spectators) at each point of time. For evaluation, we targeted Spring-Selection high-school baseball games. As training data, we used image features, game progress data, and the camera position at each point of time in the TV broadcast. We used videos of a baseball game captured from 7 different points in Hanshin Koshien Stadium with handy video cameras and generated sample data set by dividing the videos to fixed interval segments. We divided the sample data set into the training data set and the test data set and evaluated our method through two validation methods: (1) 10-fold crossvalidation method and (2) hold-out methods (e.g., learning first and second innings and testing third inning). As a result, our method predicted the camera switching timings with accuracy (F-measure) of 72.53% on weighted average for the base camera work and 92.1% for the fixed camera work.

Original languageEnglish
Title of host publicationProceedings - 2015 IEEE International Symposium on Multimedia, ISM 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages541-546
Number of pages6
ISBN (Electronic)9781509003792
DOIs
Publication statusPublished - Mar 25 2016
Externally publishedYes
Event17th IEEE International Symposium on Multimedia, ISM 2015 - Miami, United States
Duration: Dec 14 2015Dec 16 2015

Publication series

NameProceedings - 2015 IEEE International Symposium on Multimedia, ISM 2015

Conference

Conference17th IEEE International Symposium on Multimedia, ISM 2015
Country/TerritoryUnited States
CityMiami
Period12/14/1512/16/15

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Hardware and Architecture
  • Software
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Automatic Content Curation System for Multiple Live Sport Video Streams'. Together they form a unique fingerprint.

Cite this