loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Wai Chee Yau 1 ; Dinesh Kant Kumar 1 and Hans Weghorn 2

Affiliations: 1 School of Electrical and Computer Engineering, RMIT University, Australia ; 2 Information Technology, BA-University of Cooperative Education, Germany

Abstract: This paper presents a novel approach for recognition of lower facial movements using motion features and hidden Markov models (HMM) for visual speech recognition applications. The proposed technique recognizes utterances based on mouth videos without using the acoustic signals. This paper adopts a visual speech model that divides utterances into sequences of smallest, visually distinguishable units known as visemes. The proposed technique uses the viseme model of Moving Picture Experts Group 4 (MPEG-4) standard. The facial movements in the video data are represented using 2D spatial-temporal templates (STT). The proposed technique combines discrete stationary wavelet transform (SWT) and Zernike moments to extract rotation invariant features from the STTs. Continuous HMM are used as speech classifier to model the English visemes. The preliminary results demonstrate that the proposed technique is suitable for classification of visemes with a good accuracy.

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 18.97.14.90

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Chee Yau, W. ; Kant Kumar, D. and Weghorn, H. (2007). Recognition of Human Movements Using Hidden Markov Models - An Application to Visual Speech Recognition. In Proceedings of the 7th International Workshop on Pattern Recognition in Information Systems (ICEIS 2007) - PRIS; ISBN 978-972-8865-93-1, SciTePress, pages 151-160. DOI: 10.5220/0002424901510160

@conference{pris07,
author={Wai {Chee Yau} and Dinesh {Kant Kumar} and Hans Weghorn},
title={Recognition of Human Movements Using Hidden Markov Models - An Application to Visual Speech Recognition},
booktitle={Proceedings of the 7th International Workshop on Pattern Recognition in Information Systems (ICEIS 2007) - PRIS},
year={2007},
pages={151-160},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002424901510160},
isbn={978-972-8865-93-1},
}

TY - CONF

JO - Proceedings of the 7th International Workshop on Pattern Recognition in Information Systems (ICEIS 2007) - PRIS
TI - Recognition of Human Movements Using Hidden Markov Models - An Application to Visual Speech Recognition
SN - 978-972-8865-93-1
AU - Chee Yau, W.
AU - Kant Kumar, D.
AU - Weghorn, H.
PY - 2007
SP - 151
EP - 160
DO - 10.5220/0002424901510160
PB - SciTePress