WFRF:(Salvi Giampiero)
Search: WFRF:(Salvi Giampiero) > (2000-2004) > Intelligibility of ...
- 8 of 9
- Previous record
- Next record
- To hitlist
Intelligibility of an ASR-controlled synthetic talking face
- Siciliano, C. (author)
- Williams, G. (author)
- Faulkner, A. (author)
- show more...
- show less...
- (creator_code:org_t)
- 2004
- 2004
- English.
- In: Journal of the Acoustical Society of America. - 0001-4966 .- 1520-8524. ; 115:5, s. 2428-
- Journal article (peer-reviewed)
Abstract
Subject headings
Close
- The goal of the SYNFACE project is to develop a multilingual synthetic talking face, driven by an automatic speech recognizer (ASR), to assist hearing‐impaired people with telephone communication. Previous multilingual experiments with the synthetic face have shown that time‐aligned synthesized visual face movements can enhance speech intelligibility in normal‐hearing and hearing‐impaired users [C. Siciliano et al., Proc. Int. Cong. Phon. Sci. (2003)]. Similar experiments are in progress to examine whether the synthetic face remains intelligible when driven by ASR output. The recognizer produces phonetic output in real time, in order to drive the synthetic face while maintaining normal dialogue turn‐taking. Acoustic modeling was performed with a neural network, while an HMM was used for decoding. The recognizer was trained on the SpeechDAT telephone speech corpus. Preliminary results suggest that the currently achieved recognition performance of around 60% frames correct limits the usefulness of the synthetic face movements. This is particularly true for consonants, where correct place of articulation is especially important for visual intelligibility. Errors in the alignment of phone boundaries representative of those arising in the ASR output were also shown to decrease audio‐visual intelligibility.
Subject headings
- NATURVETENSKAP -- Data- och informationsvetenskap -- Datavetenskap (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Computer Sciences (hsv//eng)
- NATURVETENSKAP -- Data- och informationsvetenskap -- Språkteknologi (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Language Technology (hsv//eng)
Publication and Content Type
- ref (subject category)
- art (subject category)
Find in a library
- Journal of the Acoustical Society of America (Search for host publication in LIBRIS)
To the university's database
- 8 of 9
- Previous record
- Next record
- To hitlist
Find more in SwePub
- By the author/editor
- Siciliano, C.
- Williams, G.
- Faulkner, A.
- Salvi, Giampiero
- About the subject
-
- NATURAL SCIENCES
- NATURAL SCIENCES
- and Computer and Inf ...
- and Computer Science ...
-
- NATURAL SCIENCES
- NATURAL SCIENCES
- and Computer and Inf ...
- and Language Technol ...
- Articles in the publication
- Journal of the A ...
- By the university
- Royal Institute of Technology
Search outside SwePub
- Extend your search to:
- Google Book Search
- Google Scholar
Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.
- Copyright © LIBRIS - National Library Systems
- LIBRIS.kb.se
