Perceptual Evaluation of Blended Sonification of Mechanical Robot Sounds Produced by Emotionally Expressive Gestures: Augmenting Consequential Sounds to Improve Non-verbal Robot Communication

Frid, Emma,1988-KTH,Medieteknik och interaktionsdesign, MID,Sound and Music Computing (författare)

Perceptual Evaluation of Blended Sonification of Mechanical Robot Sounds Produced by Emotionally Expressive Gestures : Augmenting Consequential Sounds to Improve Non-verbal Robot Communication

QC 20210609
This paper presents two experiments focusing on perception of mechanical sounds produced by expressive robot movement and blended sonifications thereof. In the first experiment, 31 participants evaluated emotions conveyed by robot sounds through free-form text descriptions. The sounds were inherently produced by the movements of a NAO robot and were not specifically designed for communicative purposes. Results suggested no strong coupling between the emotional expression of gestures and how sounds inherent to these movements were perceived by listeners; joyful gestures did not necessarily result in joyful sounds. A word that reoccurred in text descriptions of all sounds, regardless of the nature of the expressive gesture, was “stress”. In the second experiment, blended sonification was used to enhance and further clarify the emotional expression of the robot sounds evaluated in the first experiment. Analysis of quantitative ratings of 30 participants revealed that the blended sonification successfully contributed to enhancement of the emotional message for sound models designed to convey frustration and joy. Our findings suggest that blended sonification guided by perceptual research on emotion in speech and music can successfully improve communication of emotions through robot sounds in auditory-only conditions.

Bresin, Roberto,1963-KTH,Medieteknik och interaktionsdesign, MID,Sound and Music Computing(Swepub:kth)u18ut7qb (författare)
KTHMedieteknik och interaktionsdesign, MID (creator_code:org_t)

Ingår i:International Journal of Social Robotics: Springer Nature1875-47911875-4805

Om ämnet

NATURVETENSKAP: NATURVETENSKAP; och Data och informa ...; och Människa datorin ...

NATURVETENSKAP: NATURVETENSKAP; och Data och informa ...; och Datorseende och ...

NATURVETENSKAP: NATURVETENSKAP; och Data och informa ...; och Annan data och i ...

TEKNIK OCH TEKNOLOGIER: TEKNIK OCH TEKNO ...; och Annan teknik; och Interaktionstekn ...

TEKNIK OCH TEKNOLOGIER: TEKNIK OCH TEKNO ...; och Annan teknik; och Mediateknik

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.