Skip to content

Publications

Detail of publication

Citation

Daniel Tihelka and Martin Grůber and Zdeněk Hanzíček : Robust methodology for TTS enhancement evaluation . Text, Speech and Dialogue, Proceedings of the 16th International Conference TSD 2013, Lecture Notes in Artificial Intelligence, vol. 8082, p. 442-449, Springer, Berlin-Heidelberg, Germany, 2013.

Abstract

The paper points to problematic and usually neglected aspects of using listening tests for TTS evaluation. It shows that simple random selection of phrases to be listened to may not cover those cases which are relevant to the evaluated TTS system. Also, it shows that a reliable phrase set cannot be chosen without a deeper knowledge of the distribution of differences in synthetic speech, which are obtained by comparing the output generated by an evaluated TTS system to what stands as a baseline system. Having such knowledge, the method able to evaluate the reliability of listening tests, as related to the estimation of possible invalidity of listening results-derived conclusion, is proposed here and demonstrated on real examples.

Detail of publication

Title: Robust methodology for TTS enhancement evaluation
Author: Daniel Tihelka ; Martin Grůber ; Zdeněk Hanzíček
Language: English
Date of publication: 5 Sep 2013
Year: 2013
Type of publication: Papers in journals
Book title: Text, Speech and Dialogue, Proceedings of the 16th International Conference TSD 2013
Series: Lecture Notes in Artificial Intelligence
Číslo vydání: 8082
Page: 442 - 449
DOI: 10.1007/978-3-642-40585-3_56
ISBN: 978-3-642-40584-6
ISSN: 0302-9743
Publisher: Springer
Address: Berlin-Heidelberg, Germany
Date: 1 Sep 2013 - 5 Sep 2013
/ 2014-01-30 15:55:25 /

Keywords

speech synthesis, TTS evaluation, listening tests, statistical reliability

BibTeX

@MISC{DanielTihelka_2013_Robustmethodology,
 author = {Daniel Tihelka and Martin Gr\r{u}ber and Zden\v{e}k Hanz\'{i}\v{c}ek},
 title = {Robust methodology for TTS enhancement evaluation},
 year = {2013},
 publisher = {Springer},
 address = {Berlin-Heidelberg, Germany},
 volume = { 8082},
 pages = {442-449},
 booktitle = {Text, Speech and Dialogue, Proceedings of the 16th International Conference TSD 2013},
 series = { Lecture Notes in Artificial Intelligence},
 ISBN = {978-3-642-40584-6},
 ISSN = {0302-9743},
 doi = {10.1007/978-3-642-40585-3_56},
 url = {http://www.kky.zcu.cz/en/publications/DanielTihelka_2013_Robustmethodology},
}