Skip to content

Publications

Detail of publication

Citation

Matoušek, J. and Hanzlíček, Z. and Tihelka, D. and Méner, M. : Automatic Dubbing of TV Programmes for the Hearing Impaired . Proceedings of 2010 IEEE 10th International Conference on Signal Processing, vol. 1, p. 589-592, Institute of Electrical and Electronics Engineers, Inc., Beijing, China, 2010.

Download PDF

PDF

Abstract

This paper presents experiments with a customisation of a corpus-based unit-selection text-to-speech (TTS) system for automatic dubbing of TV programmes. The project aims at people with hearing impairments as its main goal is to produce a highly intelligible, less-dynamic, and more-undisturbed audio track for TV programmes automatically from subtitles. A two-phase synchronisation process was proposed to cope with audio-video synchronisation issues. These phases include both off-line time compression of all utterances in a source speech corpus used for TTS and on-line time compression of speech that overlaps assigned subtitle time slots. Based on a case study, in which a TTS-generated audio track of a selected movie was analysed, a simplification of to-be-desynchronised subtitle texts was proposed in order to keep time-compression factors in a reasonable extent. In this way, abrupt changes in dynamics of the produced audio track are avoided.

Detail of publication

Title: Automatic Dubbing of TV Programmes for the Hearing Impaired
Author: Matoušek, J. ; Hanzlíček, Z. ; Tihelka, D. ; Méner, M.
Language: English
Date of publication: 24 Oct 2010
Year: 2010
Type of publication: Papers in proceedings of reviewed conferences
Book title: Proceedings of 2010 IEEE 10th International Conference on Signal Processing
Číslo vydání: 1
Page: 589 - 592
ISBN: 978-1-4244-5899-1
Publisher: Institute of Electrical and Electronics Engineers, Inc.
Address: Beijing, China
Date: 24 Oct 2010 - 28 Oct 2010
/ 2010-12-08 15:11:52 /

Keywords

TTS, speech synthesis, WSOLA, automatic dubbing, hearing impaired

BibTeX

@INPROCEEDINGS{MatousekJ_2010_AutomaticDubbingof,
 author = {Matou\v{s}ek, J. and Hanzl\'{i}\v{c}ek, Z. and Tihelka, D. and M\'{e}ner, M.},
 title = {Automatic Dubbing of TV Programmes for the Hearing Impaired},
 year = {2010},
 publisher = {Institute of Electrical and Electronics Engineers, Inc.},
 address = {Beijing, China},
 volume = {1},
 pages = {589-592},
 booktitle = {Proceedings of 2010 IEEE 10th International Conference on Signal Processing},
 ISBN = {978-1-4244-5899-1},
 url = {http://www.kky.zcu.cz/en/publications/MatousekJ_2010_AutomaticDubbingof},
}