学習による映像中の音源同定

Translated title of the contribution: Sound Source Detection by Learning

池田 千廣, ヤオカイ フォン, 内田 誠一

Research output: Contribution to journalArticlepeer-review

Abstract

Sound source detection in an image is a difficult inverse problem where the pixels belonging to the sound source area are to be estimated. The purpose of this paper is to consider an accurate sound source detection method by using machine learning framework. Specifically, the proposed method relies on an AdaBoost-based learning scheme for discriminating whether each pixel belongs to a sound source or not. The learning is done by training weak learners to discriminate positive samples (couples of image features around sound sources and audio features) and negative samples (couples of image features distant from sound sources and audio features). This learning scheme simply combines these multimodal information (i.e., image and audio) by using some weak learners to discriminate the samples by a single image feature and others by a single audio feature. The performance of this naive implementation based on a simple combination of multimodal information was examined experimentally and its essential problem was revealed with a possible remedy.
Translated title of the contributionSound Source Detection by Learning
Original languageJapanese
Pages (from-to)93-98
Number of pages6
JournalIEICE technical report
Volume110
Issue number188
Publication statusPublished - Aug 29 2010

Fingerprint Dive into the research topics of 'Sound Source Detection by Learning'. Together they form a unique fingerprint.

Cite this