| 1. |
- Laskowski, Kornel, 1972-, et al.
(author)
-
On the dynamics of overlap in multi-party conversation
- 2012
-
In: INTERSPEECH 2012. - Portland, USA : Curran Associates, Inc. - 9781622767595 ; , s. 846-849
-
Conference paper (peer-reviewed)abstract
- Overlap, although short in duration, occurs frequently in multi- party conversation. We show that its duration is approximately log-normal, and inversely proportional to the number of simul- taneously speaking parties. Using a simple model, we demon- strate that simultaneous talk tends to end simultaneously less frequently than in begins simultaneously, leading to an arrow of time in chronograms constructed from speech activity alone. The asymmetry is significant and discriminative. It appears to be due to dialog acts which do not carry propositional content, and those which are not brought to completion.
|
|
| 2. |
- Al Moubayed, Samer, et al.
(author)
-
Analysis of gaze and speech patterns in three-party quiz game interaction
- 2013
-
In: Interspeech 2013. - : The International Speech Communication Association (ISCA). ; , s. 1126-1130
-
Conference paper (peer-reviewed)abstract
- In order to understand and model the dynamics between interaction phenomena such as gaze and speech in face-to-face multiparty interaction between humans, we need large quantities of reliable, objective data of such interactions. To date, this type of data is in short supply. We present a data collection setup using automated, objective techniques in which we capture the gaze and speech patterns of triads deeply engaged in a high-stakes quiz game. The resulting corpus consists of five one-hour recordings, and is unique in that it makes use of three state-of-the-art gaze trackers (one per subject) in combination with a state-of-theart conical microphone array designed to capture roundtable meetings. Several video channels are also included. In this paper we present the obstacles we encountered and the possibilities afforded by a synchronised, reliable combination of large-scale multi-party speech and gaze data, and an overview of the first analyses of the data. Index Terms: multimodal corpus, multiparty dialogue, gaze patterns, multiparty gaze.
|
|
| 3. |
- Al Moubayed, Samer, et al.
(author)
-
Animated Faces for Robotic Heads : Gaze and Beyond
- 2011
-
In: Analysis of Verbal and Nonverbal Communication and Enactment. - Berlin, Heidelberg : Springer Berlin/Heidelberg. - 9783642257742 ; , s. 19-35
-
Conference paper (peer-reviewed)abstract
- We introduce an approach to using animated faces for robotics where a static physical object is used as a projection surface for an animation. The talking head is projected onto a 3D physical head model. In this chapter we discuss the different benefits this approach adds over mechanical heads. After that, we investigate a phenomenon commonly referred to as the Mona Lisa gaze effect. This effect results from the use of 2D surfaces to display 3D images and causes the gaze of a portrait to seemingly follow the observer no matter where it is viewed from. The experiment investigates the perception of gaze direction by observers. The analysis shows that the 3D model eliminates the effect, and provides an accurate perception of gaze direction. We discuss at the end the different requirements of gaze in interactive systems, and explore the different settings these findings give access to.
|
|
| 4. |
- Beskow, Jonas, et al.
(author)
-
Kinetic Data for Large-Scale Analysis and Modeling of Face-to-Face Conversation
- 2011
-
In: Proceedings of International Conference on Audio-Visual Speech Processing 2011. - Stockholm : KTH Royal Institute of Technology. ; , s. 103-106
-
Conference paper (peer-reviewed)abstract
- Spoken face to face interaction is a rich and complex form of communication that includes a wide array of phenomena thatare not fully explored or understood. While there has been extensive studies on many aspects in face-to-face interaction, these are traditionally of a qualitative nature, relying on hand annotated corpora, typically rather limited in extent, which is a natural consequence of the labour intensive task of multimodal data annotation. In this paper we present a corpus of 60 hours of unrestricted Swedish face-to-face conversations recorded with audio, video and optical motion capture, and we describe a new project setting out to exploit primarily the kinetic data in this corpus in order to gain quantitative knowledge on humanface-to-face interaction.
|
|
| 5. |
- Beskow, Jonas, et al.
(author)
-
Modelling humanlike conversational behaviour
- 2010
-
In: SLTC 2010. - Linköping, Sweden. ; , s. 9-10
-
Conference paper (other academic/artistic)abstract
- We have a visionar y goal: to learn enough about human face-to-face interaction that we are able to create an artificial conversational partner that is humanlike. We take the opportunity here to present four new projects inaugurated in 2010, each adding pieces of the puzzle through a shared research focus: modelling interactional aspects of spoken face-to-face communication.
|
|
| 6. |
- Beskow, Jonas, et al.
(author)
-
Project presentation: Spontal : multimodal database of spontaneous dialog
- 2009
-
In: Proceedings of Fonetik 2009. - Stockholm : Stockholm University. - 9789163348921 - 9789163348938 ; , s. 190-193
-
Conference paper (other academic/artistic)abstract
- We describe the ongoing Swedish speech database project Spontal: Multimodal database of spontaneous speech in dialog (VR 2006-7482). The project takes as its point of departure the fact that both vocal signals and gesture involving the face and body are important in every-day, face-to-face communicative interaction, and that there is a great need for data with which we more precisely measure these.
|
|
| 7. |
- Beskow, Jonas, et al.
(author)
-
Research focus : Interactional aspects of spoken face-to-face communication
- 2010
-
In: Proceedings from Fonetik, Lund, June 2-4, 2010. - Lund, Sweden : Lund University. ; , s. 7-10
-
Conference paper (other academic/artistic)abstract
- We have a visionary goal: to learn enough about human face-to-face interaction that we are able to create an artificial conversational partner that is human-like. We take the opportunity here to present four new projects inaugurated in 2010, each adding pieces of the puzzle through a shared research focus: interactional aspects of spoken face-to-face communication.
|
|
| 8. |
- Beskow, Jonas, et al.
(author)
-
Speech technology in the European project MonAMI
- 2008
-
In: Proceedings of FONETIK 2008. - Gothenburg, Sweden : University of Gothenburg. - 9789197719605 ; , s. 33-36
-
Conference paper (other academic/artistic)abstract
- This paper describes the role of speech and speech technology in the European project MonAMI, which aims at “mainstreaming ac-cessibility in consumer goods and services, us-ing advanced technologies to ensure equal ac-cess, independent living and participation for all”. It presents the Reminder, a prototype em-bodied conversational agent (ECA) which helps users to plan activities and to remember what to do. The prototype merges speech technology with other, existing technologies: Google Cal-endar and a digital pen and paper. The solution allows users to continue using a paper calendar in the manner they are used to, whilst the ECA provides notifications on what has been written in the calendar. Users may also ask questions such as “When was I supposed to meet Sara?” or “What’s on my schedule today?”
|
|
| 9. |
- Beskow, Jonas, et al.
(author)
-
The MonAMI Reminder : a spoken dialogue system for face-to-face interaction
- 2009
-
In: Proceedings of the 10th Annual Conference of the International Speech Communication Association, INTERSPEECH 2009. - Brighton, U.K. ; , s. 300-303
-
Conference paper (peer-reviewed)abstract
- We describe the MonAMI Reminder, a multimodal spoken dialogue system which can assist elderly and disabled people in organising and initiating their daily activities. Based on deep interviews with potential users, we have designed a calendar and reminder application which uses an innovative mix of an embodied conversational agent, digital pen and paper, and the web to meet the needs of those users as well as the current constraints of speech technology. We also explore the use of head pose tracking for interaction and attention control in human-computer face-to-face interaction.
|
|
| 10. |
- Carlson, Rolf, et al.
(author)
-
Towards human-like behaviour in spoken dialog systems
- 2006
-
In: Proceedings of Swedish Language Technology Conference (SLTC 2006). - Gothenburg, Sweden.
-
Conference paper (other academic/artistic)abstract
- We and others have found it fruitful to assume that users, when interacting with spoken dialogue systems, perceive the systems and their actions metaphorically. Common metaphors include the human metaphor and the interface metaphor (cf. Edlund, Heldner, & Gustafson, 2006). In the interface metaphor, the spoken dialogue system is perceived as a machine interface – often but not always a computer interface. Speech is used to accomplish what would have otherwise been accomplished by some other means of input, such as a keyboard or a mouse. In the human metaphor, on the other hand, the computer is perceived as a creature (or even a person) with humanlike conversational abilities, and speech is not a substitute or one of many alternatives, but rather the primary means of communicating with this creature. We are aware that more “natural ” or human-like behaviour does not automatically make a spoken dialogue system “better ” (i.e. more efficient or more well-liked by its users). Indeed, we are quite convinced that the advantage (or disadvantage) of humanlike behaviour will be highly dependent on the application. However, a dialogue system that is coherent with a human metaphor may profit from a number of characteristics.
|
|
