| 1. |
- Cerrato, Loredana, et al.
(author)
-
Evaluating users reactions to human-like interfaces : Prosodic and paralinguistic features as new evaluation measures for users’ satisfaction
- 2002
-
In: From brows to trust. - : Kluwer academic publishers. - 140202729X
-
Book chapter (other academic/artistic)abstract
- An increasing number of dialogue systems are deployed to providepublic services in our everyday lives. They are becoming moreservice-minded and several of them provide different channels forinteraction. The rationale is to make automatic services available innew environments and more attractive to use. From a developerperspective, this affects the complexity of the requirementselicitation activity, as new combinations and variations in end-userinteraction need to considered. The aim of our investigation is topropose new parameters and metrics to evaluate multimodal dialoguesystems endowed with embodied conversational agents (ECAs). These newmetrics focus on the users, rather than on the system. Our assumptionis that the intentional use of prosodic variation and the productionof communicative non-verbal behaviour by users can give an indicationof their attitude towards the system and might also help to evaluatethe users' overall experience of the interaction. To test ourhypothesis we carried out analyses on different Swedish corpora ofinteractions between users and multimodal dialogue systems. Weanalysed the prosodic variation in the way the users ended theirinteractions with the system and we observed the production ofnon-verbal communicative expressions by users. Our study supports theidea that the observation of users' prosodic variation and productionof communicative non-verbal behaviour during the interaction withdialogue systems could be used as an indication of whether or not theusers are satisfied with the system performance.
|
|
| 2. |
- Cerrato, Loredana, et al.
(author)
-
Evaluating users reactions to human-like interfaces : Prosodic and paralinguistic features as new evaluation measures for users’ satisfaction
- 2004
-
In: From Brows to Trust. - Dordrecht : Kluwer Academic Publishers. - 140202729X - 9781402027307 ; , s. 101-124
-
Book chapter (peer-reviewed)abstract
- An increasing number of dialogue systems are deployed to provide public services in our everyday lives. They are becoming more service-minded and several of them provide different channels for interaction. The rationale is to make automatic services available in new environments and more attractive to use. From a developer perspective, this affects the complexity of the requirements elicitation activity, as new combinations and variations in end-user interaction need to considered. The aim of our investigation is to propose new parameters and metrics to evaluate multimodal dialogue systems endowed with embodied conversational agents (ECAs). These new metrics focus on the users, rather than on the system. Our assumption is that the intentional use of prosodic variation and the production of communicative non-verbal behaviour by users can give an indication of their attitude towards the system and might also help to evaluate the users' overall experience of the interaction. To test our hypothesis we carried out analyses on different Swedish corpora of interactions between users and multimodal dialogue systems. We analysed the prosodic variation in the way the users ended their interactions with the system and we observed the production of non-verbal communicative expressions by users. Our study supports the idea that the observation of users' prosodic variation and production of communicative non-verbal behaviour during the interaction with dialogue systems could be used as an indication of whether or not the users are satisfied with the system performance.
|
|
| 3. |
- Höök, Kristina
(author)
-
User-centred design and evaluation of affective interfaces
- 2003. - 1
-
In: From brows to trust. - Norwell, USA : Kluwer Academic Publishers. - 140202729X ; , s. 127-160
-
Book chapter (peer-reviewed)abstract
- One obvious challenge for affective interfaces is to find ways of checking whether the expressed emotions are understood by users, and whether the sys-tem can interpret user emotions correctly. Even more challenging is whether the overall usage scenarios are achieving their purpose of being e g engaging, fun, believable, or creating a relationship with the user, and how much of this can be attributed to the emotion modeling and expression. We propose a two-tiered design and evaluation model. We exemplify this model through studies of three different affective interfaces: the Agneta & Frida system, the Influenc-ing Machine, and SenToy and FantasyA.
|
|
