Hyper column model vs. Fast DCT for feature extraction in visual arabic speech recognition

Alaa Sagheer, Naoyuki Tsuruta, Rin Ichiro Taniguchi, Sakashi Maeda

Research output: Contribution to conferencePaper

8 Citations (Scopus)

Abstract

Recently, the multimedia signal processing community has shown increasing interest for research development on visual speech recognition domain. In this paper we present a novel visual speech recognition approach based on our model Hyper Column Model (HCM). HCM is used for feature extraction task. The extracted features are modeled by Gaussian distributions through using Hidden Markov Model (HMM). The proposed system, HCM and HMM, can be used for any visual recognition task. We use it here to comprise a complete lip-reading system and evaluate its performance using Arabic database set. According to our knowledge, this is the first time that visual speech recognition is applied for Arabic language. Toward fair evaluation we compare our accuracy results with those using Fast Discrete Cosine Transform (FDCT) approach, in a separate experiment and using same data set and conditions of HCM experiment. Comparison turns out that HCM shows higher recognition accuracy than FDCT for Arabic sentences and words. HCM does not provide higher accuracy only but also it capable to achieve shift invariant recognition whereas FDCT can not.

Original languageEnglish
Pages761-766
Number of pages6
DOIs
Publication statusPublished - 2005
Event5th IEEE International Symposium on Signal Processing and Information Technology - Athens, Greece
Duration: Dec 18 2005Dec 21 2005

Other

Other5th IEEE International Symposium on Signal Processing and Information Technology
CountryGreece
CityAthens
Period12/18/0512/21/05

All Science Journal Classification (ASJC) codes

  • Engineering(all)

Fingerprint Dive into the research topics of 'Hyper column model vs. Fast DCT for feature extraction in visual arabic speech recognition'. Together they form a unique fingerprint.

Cite this