Sökning: WFRF:(Belpaeme Tony) >
"Am I listening?", ...
"Am I listening?", Evaluating the Quality of Generated Data-driven Listening Motion
-
- Wolfert, Pieter (författare)
- IDLab-AIRO -Ghent University Ghent, Belgium
-
- Henter, Gustav Eje, Assistant Professor, 1980- (författare)
- KTH,Tal, musik och hörsel, TMH
-
- Belpaeme, Tony (författare)
- IDLab-AIRO -Ghent University Ghent, Belgium
-
(creator_code:org_t)
- Association for Computing Machinery (ACM), 2023
- 2023
- Engelska.
-
Ingår i: ICMI 2023 Companion. - : Association for Computing Machinery (ACM). ; , s. 6-10
- Relaterad länk:
-
https://doi.org/10.1...
-
visa fler...
-
https://urn.kb.se/re...
-
https://doi.org/10.1...
-
visa färre...
Abstract
Ämnesord
Stäng
- This paper asks if recent models for generating co-speech gesticulation also may learn to exhibit listening behaviour as well. We consider two models from recent gesture-generation challenges and train them on a dataset of audio and 3D motion capture from dyadic conversations. One model is driven by information from both sides of the conversation, whereas the other only uses the character's own speech. Several user studies are performed to assess the motion generated when the character is speaking actively, versus when the character is the listener in the conversation. We find that participants are reliably able to discern motion associated with listening, whether from motion capture or generated by the models. Both models are thus able to produce distinctive listening behaviour, even though only one model is truly a listener, in the sense that it has access to information from the other party in the conversation. Additional experiments on both natural and model-generated motion finds motion associated with listening to be rated as less human-like than motion associated with active speaking.
Ämnesord
- NATURVETENSKAP -- Data- och informationsvetenskap -- Språkteknologi (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Language Technology (hsv//eng)
Nyckelord
- embodied conversational agents
- listening behaviour
Publikations- och innehållstyp
- ref (ämneskategori)
- kon (ämneskategori)