| 1. |
- Torre, Ilaria, et al.
(författare)
-
Dimensional perception of a ‘smiling McGurkeffect’
- 2021
-
Ingår i: 2021 9th International Conference on Affective Computing and Intelligent Interaction (ACII). - : Institute of Electrical and Electronics Engineers (IEEE).
-
Konferensbidrag (refereegranskat)abstract
- Multisensory integration influences emotional perception, as the McGurk effect demonstrates for the communication between humans. Human physiology implicitly links the production of visual features with other modes like the audio channel: Face muscles responsible for a smiling face also stretch the vocal cords that results in a characteristic smiling voice. For artificial agents capable of multimodal expression, this linkage is modeled explicitly. In our study, we observe the influence of visual and audio channel on the perception of the agent’s emotional state. We created two virtual characters to control for anthropomorphic appearance. We record videos of these agents either with matching or mismatching emotional expression in the audio and visual channel. In an online study we measured the agent’s perceived valence and arousal. Our results show that a matched smiling voice and smiling face increase both dimensions of the Circumplex model of emotions: ratings of valence and arousal grow. When the channels present conflicting information, any type of smiling results in higher arousal rating, but only the visual channel increases the perceived valence. When engineers are constrained in their design choices, we suggest they should give precedence to convey the artificial agent’s emotional state through the visual channel.
|
|
| 2. |
- Torre, Ilaria, et al.
(författare)
-
The Effect of Audio-Visual Smiles on Social Influence in a Cooperative Human-Agent Interaction Task
- 2021
-
Ingår i: ACM Transactions on Computer-Human Interaction. - : ASSOC COMPUTING MACHINERY. - 1073-0516 .- 1557-7325. ; 28:6
-
Tidskriftsartikel (refereegranskat)abstract
- Emotional expressivity is essential for human interactions, informing both perception and decision-making. Here, we examine whether creating an audio-visual emotional channel mismatch influences decision-making in a cooperative task with a virtual character. We created a virtual character that was either congruent in its emotional expression (smiling in the face and voice) or incongruent (smiling in only one channel). People (N = 98) evaluated the character in terms of valence and arousal in an online study; then, visitors in a museum played the "lunar survival task" with the character over three experiments (N = 597, 78, 101, respectively). Exploratory results suggest that multi-modal expressions are perceived, and reacted upon, differently than unimodal expressions, supporting previous theories of audio-visual integration.
|
|
| 3. |
- Torre, Ilaria, et al.
(författare)
-
To smile or not to smile : The effect of mismatched emotional expressions in a Human-Robot cooperative task
- 2022
-
Ingår i: 2022 31St Ieee International Conference On Robot And Human Interactive Communication (Ieee Ro-Man 2022). - : Institute of Electrical and Electronics Engineers (IEEE). ; , s. 8-13
-
Konferensbidrag (refereegranskat)abstract
- Emotional expressivity is essential for successful Human-Robot Interaction. However, robots often have different levels of expressivity in their face and voice. Here we ask whether this modality mismatch influences human behaviour and perception of the robot. Participants played a cooperative task with a robot that displayed matched and mismatched smiling expressions in the face and voice. Emotional expressivity did not influence acceptance of robot's recommendations or subjective evaluations of the robot. However, we found that the robot had overall a higher social influence than a virtual character, and was evaluated more positively.
|
|
