Publications
Detail of publication
Citation
p. 442-449, Springer Berlin Heidelberg, 2013. : Robust methodology for TTS enhancement evaluation . Text, Speech, and Dialogue, Lecture Notes in Computer Science, vol. 8082,
Download PDF
Abstract
The paper points to problematic and usually neglected aspects of using listening tests for TTS evaluation. It shows that simple random selection of phrases to be listened to may not cover those cases which are relevant to the evaluated TTS system. Also, it shows that a reliable phrase set cannot be chosen without a deeper knowledge of the distribution of differences in synthetic speech, which are obtained by comparing the output generated by an evaluated TTS system to what stands as a baseline system. Having such knowledge, the method able to evaluate the reliability of listening tests, as related to the estimation of possible invalidity of listening results-derived conclusion, is proposed here and demonstrated on real examples.
Detail of publication
Title: | Robust methodology for TTS enhancement evaluation |
---|---|
Author: | Tihelka Daniel ; Martin Grůber ; Zdeněk Hanzlíček |
Language: | Czech |
Year: | 2013 |
Type of publication: | Papers in proceedings of reviewed conferences |
Book title: | Text, Speech, and Dialogue |
Series: | Lecture Notes in Computer Science |
Číslo vydání: | 8082 |
Page: | 442 - 449 |
DOI: | 10.1007/978-3-642-40585-3_56 |
ISBN: | 978-3-642-40584-6 |
ISSN: | 0302-9743 |
Publisher: | Springer Berlin Heidelberg |
Date: | 1 Sep 2013 - 5 Sep 2013 |
Keywords
speech synthesis, TTS evaluation, listening tests, statistical reliability
BibTeX
@INPROCEEDINGS{TihelkaDaniel_2013_Robustmethodology, author = {Tihelka Daniel and Martin Gr\r{u}ber and Zden\v{e}k Hanzl\'{i}\v{c}ek}, title = {Robust methodology for TTS enhancement evaluation}, year = {2013}, publisher = {Springer Berlin Heidelberg}, volume = {8082}, pages = {442-449}, booktitle = {Text, Speech, and Dialogue}, series = {Lecture Notes in Computer Science}, ISBN = {978-3-642-40584-6}, ISSN = {0302-9743}, doi = {10.1007/978-3-642-40585-3_56}, url = {http://www.kky.zcu.cz/en/publications/TihelkaDaniel_2013_Robustmethodology}, }