Skip to content

Publications

Detail of publication

Citation

Hrúz Marek and Campr Pavel and Krňoul Zdeněk and Železný Miloš and Aran Oya and Santemiz Pinar : Multi-modal dialogue system with sign language capabilities . ASSETS'11: Proceedings of the 13th international ACM SIGACCESS Conference on Computers and Accessibility, 2011.

Download PDF

PDF

Additional information


acm portal

Abstract

This paper presents the design of a multimodal sign-language-enabled dialogue system. Its functionality was tested on a prototype of an information kiosk for the deaf people providing information about train connections. We use an automatic computer-vision-based sign language recognition, automatic speech recognition and touchscreen as input modalities. The outputs are shown on a screen displaying 3D signing avatar and on a touchscreen displaying graphical user interface. The information kiosk can be used both by hearing users and deaf users in several languages. We focus on description of sign language input and output modality.

Detail of publication

Title: Multi-modal dialogue system with sign language capabilities
Author: Hrúz Marek ; Campr Pavel ; Krňoul Zdeněk ; Železný Miloš ; Aran Oya ; Santemiz Pinar
Language: English
Date of publication: 22 Oct 2011
Year: 2011
Type of publication: Papers in proceedings of reviewed conferences
Book title: ASSETS'11: Proceedings of the 13th international ACM SIGACCESS Conference on Computers and Accessibility
DOI: 10.1145/2049536.2049599
/ 2012-11-07 10:41:48 /

Keywords

sign language, visual tracking, sign categorization

BibTeX

@INPROCEEDINGS{HruzMarek_2011_Multi-modaldialogue,
 author = {Hr\'{u}z Marek and Campr Pavel and Kr\v{n}oul Zden\v{e}k and \v{Z}elezn\'{y} Milo\v{s} and Aran Oya and Santemiz Pinar},
 title = {Multi-modal dialogue system with sign language capabilities},
 year = {2011},
 booktitle = {ASSETS'11: Proceedings of the 13th international ACM SIGACCESS Conference on Computers and Accessibility},
 doi = {10.1145/2049536.2049599},
 url = {http://www.kky.zcu.cz/en/publications/HruzMarek_2011_Multi-modaldialogue},
}