Skip to content

Publications

Detail of publication

Citation

Císař, P. and Železný, M. and Zelinka, J. and Trojanová, J. : Development and Testing of New Combined Visual Speech Parameterization . Proceedings of the workshop on Audio-visual speech processing, p. 97-100, 2007.

Abstract

Audio-visual speech recognition is used to make speech recognition more robust in case when the acoustic speech signal is affected by increased environmental noise. Since visual speech expression is not affected by the acoustic noise, it is used as supplemental information for the recognition. Usually, the shape of lips of a speaker is described by either pixel-based or shape-based features. After experiments with various parameterizations we decided to use expert knowledge about human lip-reading for development of a new parameterization. Based on this information we designed a combined parameterization for description of visual speech part. The designed parameterization combines both basic approaches and uses shape-based description for outer lip contour and pixel-based description for description of inner part of a mouth. Results obtained in experiments with this parameterization showed that it outperforms the traditionally used parameterizations.

Detail of publication

Title: Development and Testing of New Combined Visual Speech Parameterization
Author: Císař, P. ; Železný, M. ; Zelinka, J. ; Trojanová, J.
Language: English
Date of publication: 1 Jan 2007
Year: 2007
Type of publication: Papers in journals
Title of journal or book: Proceedings of the workshop on Audio-visual speech processing
Page: 97 - 100
/ /

Keywords

audio-visual speech recognition, lip-reading, multimodal speech processing, visual speech parameterization

BibTeX

@ARTICLE{CisarP_2007_Developmentand,
 author = {C\'{i}sa\v{r}, P. and \v{Z}elezn\'{y}, M. and Zelinka, J. and Trojanov\'{a}, J.},
 title = {Development and Testing of New Combined Visual Speech Parameterization},
 year = {2007},
 journal = {Proceedings of the workshop on Audio-visual speech processing},
 pages = {97-100},
 url = {http://www.kky.zcu.cz/en/publications/CisarP_2007_Developmentand},
}