Virtual Speech Reading Support for Hard of Hearing in a Domestic Multi-Media Setting

• In this paper we present recent results on the development of the SynFace lip synchronized talking head towards multilinguality, varying signal conditions and noise robustness in the Hearing at Home project. We then describe the large scale hearing impaired user studies carried out for three languages. The user tests focus on measuring the gain in Speech Reception Threshold in Noise when using SynFace, and on measuring the effort scaling when using SynFace by hearing impaired people. Preliminary analysis of the results does not show significant gain in SRT or in effort scaling. But looking at inter-subject variability, it is clear that many subjects benefit from SynFace especially with speech with stereo babble noise.

Ämnesord

NATURVETENSKAP  -- Data- och informationsvetenskap (hsv//swe)

NATURAL SCIENCES  -- Computer and Information Sciences (hsv//eng)

SAMHÄLLSVETENSKAP  -- Medie- och kommunikationsvetenskap -- Kommunikationsvetenskap (hsv//swe)

SOCIAL SCIENCES  -- Media and Communications -- Communication Studies (hsv//eng)

HUMANIORA  -- Språk och litteratur -- Jämförande språkvetenskap och allmän lingvistik (hsv//swe)

HUMANITIES  -- Languages and Literature -- General Language Studies and Linguistics (hsv//eng)

Nyckelord

hearing impairment

communication support

talking heads

visual speech reading

multilingual

Information technology

Informationsteknik

Human communication

Kommunikation mellan människor

Linguistic subjects

Lingvistikämnen

Publikations- och innehållstyp

ref (ämneskategori)

kon (ämneskategori)