Search: onr:"swepub:oai:DiVA.org:kth-268307" >
Spontaneous convers...
Spontaneous conversational speech synthesis from found data
-
Székely, Éva (author)
-
- Henter, Gustav Eje, Assistant Professor (author)
- KTH,Tal, musik och hörsel, TMH
-
- Beskow, Jonas (author)
- KTH,Tal, musik och hörsel, TMH
-
show more...
-
- Gustafson, Joakim, professor, 1966- (author)
- KTH,Tal, musik och hörsel, TMH
-
show less...
-
(creator_code:org_t)
- ISCA, 2019
- 2019
- English.
-
In: Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH. - : ISCA. ; , s. 4435-4439
- Related links:
-
https://www.isca-spe...
-
show more...
-
https://urn.kb.se/re...
-
https://doi.org/10.2...
-
show less...
Abstract
Subject headings
Close
- Synthesising spontaneous speech is a difficult task due to disfluencies, high variability and syntactic conventions different from those of written language. Using found data, as opposed to lab-recorded conversations, for speech synthesis adds to these challenges because of overlapping speech and the lack of control over recording conditions. In this paper we address these challenges by using a speaker-dependent CNN-LSTM breath detector to separate continuous recordings into utterances, which we here apply to extract nine hours of clean single-speaker breath groups from a conversational podcast. The resulting corpus is transcribed automatically (both lexical items and filler tokens) and used to build several voices on a Tacotron 2 architecture. Listening tests show: i) pronunciation accuracy improved with phonetic input and transfer learning; ii) it is possible to create a more fluent conversational voice by training on data without filled pauses; and iii) the presence of filled pauses improved perceived speaker authenticity. Another listening test showed the found podcast voice to be more appropriate for prompts from both public speeches and casual conversations, compared to synthesis from found read speech and from a manually transcribed lab-recorded spontaneous conversation.
Subject headings
- NATURVETENSKAP -- Data- och informationsvetenskap -- Språkteknologi (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Language Technology (hsv//eng)
Publication and Content Type
- ref (subject category)
- kon (subject category)
To the university's database