| 1. |
- Al Moubayed, Samer, et al.
(författare)
-
Analysis of gaze and speech patterns in three-party quiz game interaction
- 2013
-
Ingår i: Interspeech 2013. - : The International Speech Communication Association (ISCA). ; , s. 1126-1130
-
Konferensbidrag (refereegranskat)abstract
- In order to understand and model the dynamics between interaction phenomena such as gaze and speech in face-to-face multiparty interaction between humans, we need large quantities of reliable, objective data of such interactions. To date, this type of data is in short supply. We present a data collection setup using automated, objective techniques in which we capture the gaze and speech patterns of triads deeply engaged in a high-stakes quiz game. The resulting corpus consists of five one-hour recordings, and is unique in that it makes use of three state-of-the-art gaze trackers (one per subject) in combination with a state-of-theart conical microphone array designed to capture roundtable meetings. Several video channels are also included. In this paper we present the obstacles we encountered and the possibilities afforded by a synchronised, reliable combination of large-scale multi-party speech and gaze data, and an overview of the first analyses of the data. Index Terms: multimodal corpus, multiparty dialogue, gaze patterns, multiparty gaze.
|
|
| 2. |
- Al Moubayed, Samer, et al.
(författare)
-
Furhat goes to Robotville: a large-scale multiparty human-robot interaction data collection in a public space
- 2012
-
Ingår i: Proc of LREC Workshop on Multimodal Corpora. - Istanbul, Turkey.
-
Konferensbidrag (refereegranskat)abstract
- In the four days of the Robotville exhibition at the London Science Museum, UK, during which the back-projected head Furhat in a situated spoken dialogue system was seen by almost 8 000 visitors, we collected a database of 10 000 utterances spoken to Furhat in situated interaction. The data collection is an example of a particular kind of corpus collection of human-machine dialogues in public spaces that has several interesting and specific characteristics, both with respect to the technical details of the collection and with respect to the resulting corpus contents. In this paper, we take the Furhat data collection as a starting point for a discussion of the motives for this type of data collection, its technical peculiarities and prerequisites, and the characteristics of the resulting corpus.
|
|
| 3. |
- Al Moubayed, Samer, et al.
(författare)
-
Talking with Furhat - multi-party interaction with a back-projected robot head
- 2012
-
Ingår i: Proceedings of Fonetik 2012. - Gothenberg, Sweden. ; , s. 109-112
-
Konferensbidrag (övrigt vetenskapligt/konstnärligt)abstract
- This is a condensed presentation of some recent work on a back-projected robotic head for multi-party interaction in public settings. We will describe some of the design strategies and give some preliminary analysis of an interaction database collected at the Robotville exhibition at the London Science Museum
|
|
| 4. |
- Bell, Linda, et al.
(författare)
-
Children’s convergence in referring expressions to graphical objects in a speech-enabled computer game
- 2007
-
Ingår i: 8th Annual Conference of the International Speech Communication Association. - Antwerp, Belgium. - 9781605603162 ; , s. 2788-2791
-
Konferensbidrag (refereegranskat)abstract
- This paper describes an empirical study of children's spontaneous interactions with an animated character in a speech-enabled computer game. More specifically, it deals with convergence of referring expressions. 49 children were invited to play the game, which was initiated by a collaborative "put-that-there" task. In order to solve this task, the children had to refer to both physical objects and icons in a 3D environment. For physical objects, which were mostly referred to using straight-forward noun phrases, lexical convergence took place in 90% of all cases. In the case of the icons, the children were more innovative and spontaneously referred to them in many different ways. Even after being prompted by the system, lexical convergence took place for only 50% of the icons. In the cases where convergence did take place, the effect of the system's prompts were quite local, and the children quickly resorted to their original way of referring when naming new icons in later tasks.
|
|
| 5. |
- Bell, Linda, et al.
(författare)
-
The Swedish NICE Corpus – Spoken dialogues between children and embodied characters in a computer game scenario
- 2005
-
Ingår i: Proceedings Interspeech 2005 - Eurospeech. - Lisbon, Portugal : ISCA. ; , s. 2765-2768, s. 2765-2768
-
Konferensbidrag (refereegranskat)abstract
- This article describes the collection and analysis of a Swedish database of spontaneous and unconstrained children-machine dialogues. The Swedish NICE corpus consists of spoken dialogues between children aged 8 to 15 and embodied fairytale characters in a computer game scenario. Compared to previously collected corpora of children's computer-directed speech, the Swedish NICE corpus contains extended interactions, including three-party conversation, in which the young users used spoken dialogue as the primary means of progression in the game.
|
|
| 6. |
- Beskow, Jonas, et al.
(författare)
-
Experiments with Synthesis of Swedish Dialects
- 2009
-
Ingår i: Proceedings of Fonetik 2009. - Stockholm : Stockholm University. ; , s. 28-29
-
Konferensbidrag (övrigt vetenskapligt/konstnärligt)abstract
- We describe ongoing work on synthesizing Swedish dialects with an HMM synthesizer. A prototype synthesizer has been trained on alarge database for standard Swedish read by a professional male voice talent. We have selected a few untrained speakers from each ofthe following dialectal region: Norrland, Dala,Göta, Gotland and South of Sweden. The planis to train a multi-dialect average voice, and then use 20-30 minutes of dialectal speech from one speaker to adapt either the standard Swedish voice or the average voice to the dialect of that speaker.
|
|
| 7. |
- Beskow, Jonas, et al.
(författare)
-
Modelling humanlike conversational behaviour
- 2010
-
Ingår i: SLTC 2010. - Linköping, Sweden. ; , s. 9-10
-
Konferensbidrag (övrigt vetenskapligt/konstnärligt)abstract
- We have a visionar y goal: to learn enough about human face-to-face interaction that we are able to create an artificial conversational partner that is humanlike. We take the opportunity here to present four new projects inaugurated in 2010, each adding pieces of the puzzle through a shared research focus: modelling interactional aspects of spoken face-to-face communication.
|
|
| 8. |
- Beskow, Jonas, et al.
(författare)
-
Research focus : Interactional aspects of spoken face-to-face communication
- 2010
-
Ingår i: Proceedings from Fonetik, Lund, June 2-4, 2010. - Lund, Sweden : Lund University. ; , s. 7-10
-
Konferensbidrag (övrigt vetenskapligt/konstnärligt)abstract
- We have a visionary goal: to learn enough about human face-to-face interaction that we are able to create an artificial conversational partner that is human-like. We take the opportunity here to present four new projects inaugurated in 2010, each adding pieces of the puzzle through a shared research focus: interactional aspects of spoken face-to-face communication.
|
|
| 9. |
- Beskow, Jonas, et al.
(författare)
-
Speech technology in the European project MonAMI
- 2008
-
Ingår i: Proceedings of FONETIK 2008. - Gothenburg, Sweden : University of Gothenburg. - 9789197719605 ; , s. 33-36
-
Konferensbidrag (övrigt vetenskapligt/konstnärligt)abstract
- This paper describes the role of speech and speech technology in the European project MonAMI, which aims at “mainstreaming ac-cessibility in consumer goods and services, us-ing advanced technologies to ensure equal ac-cess, independent living and participation for all”. It presents the Reminder, a prototype em-bodied conversational agent (ECA) which helps users to plan activities and to remember what to do. The prototype merges speech technology with other, existing technologies: Google Cal-endar and a digital pen and paper. The solution allows users to continue using a paper calendar in the manner they are used to, whilst the ECA provides notifications on what has been written in the calendar. Users may also ask questions such as “When was I supposed to meet Sara?” or “What’s on my schedule today?”
|
|
| 10. |
- Beskow, Jonas, et al.
(författare)
-
The MonAMI Reminder : a spoken dialogue system for face-to-face interaction
- 2009
-
Ingår i: Proceedings of the 10th Annual Conference of the International Speech Communication Association, INTERSPEECH 2009. - Brighton, U.K. ; , s. 300-303
-
Konferensbidrag (refereegranskat)abstract
- We describe the MonAMI Reminder, a multimodal spoken dialogue system which can assist elderly and disabled people in organising and initiating their daily activities. Based on deep interviews with potential users, we have designed a calendar and reminder application which uses an innovative mix of an embodied conversational agent, digital pen and paper, and the web to meet the needs of those users as well as the current constraints of speech technology. We also explore the use of head pose tracking for interaction and attention control in human-computer face-to-face interaction.
|
|
