Skip to content

Publications

Detail of publication

Citation

Tihelka, D. and Matoušek, J. : The design of Czech language formal listening tests for the evaluation of TTS systems . LREC 2004, proceedings of 4th International Conference on Language Resources and Evaluation, p. 2099-2102, European Language Resources Association, Lisbon, 2004.

Download PDF

PDF

Abstract

This paper presents an attempt to design listening tests for the Czech synthesis speech evaluation. The design is based on standardized and widely used listening tests for English; therefore, we can benefit from the advantages provided by standards. Bearing the Czech language phenomena in mind, we filled the standard frameworks of several listening tests, especially the MRT (Modified Rhyme Test) and the SUS (Semantically Unpredictable Sentences) test; the Czech National Corpus was used for this purpose. Designed tests were instantly used for real tests in which 88 people took part, a procedure which proved correct. This was the first attempt to design Czech listening tests according to given standard frameworks and it was successful.

Detail of publication

Title: The design of Czech language formal listening tests for the evaluation of TTS systems
Author: Tihelka, D. ; Matoušek, J.
Language: English
Date of publication: 26 May 2004
Year: 2004
Type of publication: Papers in proceedings of reviewed conferences
Book title: LREC 2004, proceedings of 4th International Conference on Language Resources and Evaluation
Page: 2099 - 2102
ISBN: 2-9517408-1-6
Publisher: European Language Resources Association
Address: Lisbon
Date: 26 May 2004 - 28 Feb 2004
/ 2015-03-06 09:37:58 /

Keywords

Synthetic speech quality assessment, Listening tests, MRT (Modified Rhyme Test), SUS (Semantically Unpredictable Sentences), MOS (Mean Opinion Score), CCR (Comparison Category Rating), The Czech National Speech Corpus

BibTeX

@INPROCEEDINGS{TihelkaD_2004_ThedesignofCzech,
 author = {Tihelka, D. and Matou\v{s}ek, J.},
 title = {The design of Czech language formal listening tests for the evaluation of TTS systems},
 year = {2004},
 publisher = {European Language Resources Association},
 address = {Lisbon},
 pages = {2099-2102},
 booktitle = {LREC 2004, proceedings of 4th International Conference on
Language Resources and Evaluation},
 ISBN = {2-9517408-1-6},
 url = {http://www.kky.zcu.cz/en/publications/TihelkaD_2004_ThedesignofCzech},
}