Publications
Detail of publication
Citation
p. 113-116, SPIIRAS, 2009. : Input and output modalities used in a sign-language-enabled information kiosk . proceedings of SPECOM'2009,
Abstract
This paper presents description and evaluation of input and output modalities used in a sign-language-enabled information kiosk. The kiosk was developed for experiments on interaction between computers and deaf users. The input modalities used are automatic computer-vision-based sign language recognition, automatic speech recognition (ASR) and a touchscreen. The output modalities are presented on a screen displaying 3D signing avatar, and on a touchscreen showing special graphical user interface for the Deaf. The kiosk was tested on a dialogue providing information about train connections, but the scenario can be easily changed to e.g. SL tutoring tool, SL dictionary or SL game. This scenario expects that both deaf and hearing people can use the kiosk. This is why both automatic speech recognition and automatic sign language recognition are used as input modalities, and signing avatar and written text as output modalities (in several languages). The human-computer interaction is controlled by a computer-driven dialogue system.
Detail of publication
Title: | Input and output modalities used in a sign-language-enabled information kiosk |
---|---|
Author: | Hrúz M. ; Campr P. ; Karpov A. ; Santemiz P. ; Aran O. ; Železný M. |
Language: | English |
Year: | 2009 |
Type of publication: | Papers in proceedings of reviewed conferences |
Title of journal or book: | proceedings of SPECOM'2009 |
Page: | 113 - 116 |
ISBN: | 978-5-8088-0442-5 |
Editor: | SPIIRAS |
Keywords
information kiosk, sign language, multimodal human-computer interfaces
BibTeX
@INPROCEEDINGS{HruzM_2009_Inputandoutput, author = {Hr\'{u}z M. and Campr P. and Karpov A. and Santemiz P. and Aran O. and \v{Z}elezn\'{y} M.}, title = {Input and output modalities used in a sign-language-enabled information kiosk}, year = {2009}, journal = {proceedings of SPECOM'2009}, pages = {113-116}, editor = {SPIIRAS}, ISBN = {978-5-8088-0442-5}, url = {http://www.kky.zcu.cz/en/publications/HruzM_2009_Inputandoutput}, }