| 1. |
- Bell, Linda, et al.
(author)
-
Modality Convergence in a Multimodal Dialogue System
- 2000
-
In: Proceedings of Götalog. ; , s. 29-34
-
Conference paper (peer-reviewed)abstract
- When designing multimodal dialogue systems allowing speech as well as graphical operations, it is important to understand not only how people make use of the different modalities in their utterances, but also how the system might influence a user’s choice of modality by its own behavior. This paper describes an experiment in which subjects interacted with two versions of a simulated multimodal dialogue system. One version used predominantly graphical means when referring to specific objects; the other used predominantly verbal referential expressions. The purpose of the study was to find out what effect, if any, the system’s referential strategy had on the user’s behavior. The results provided limited support for the hypothesis that the system can influence users to adopt another modality for the purpose of referring
|
|
| 2. |
- Bell, Linda, et al.
(author)
-
Real-time Handling of Fragmented Utterances
- 2001
-
In: Proceedings of the NAACL Workshop on Adaption in Dialogue Systems.
-
Conference paper (peer-reviewed)abstract
- this paper, we discuss an adaptive method of handling fragmented user utterances to a speech-based multimodal dialogue system. Inserted silent pauses between fragments present the following problem: Does the current silence indicate that the user has completed her utterance, or is the silence just a pause between two fragments, so that the system should wait for more input? Our system incrementally classifies user utterances as either closing (more input is unlikely to come) or non-closing (more input is likely to come), partly depending on the current dialogue state. Utterances that are categorized as non-closing allow the dialogue system to await additional spoken or graphical input before responding
|
|
| 3. |
- Boye, Johan, et al.
(author)
-
Contextual reasoning in multimodal dialogue systems : two case studies
- 2004
-
In: Proceedings of The 8th Workshop on the Semantics and Pragmatics of Dialogue Catalogue'04. - Barcelona. ; , s. 19-21
-
Conference paper (peer-reviewed)abstract
- This paper describes an approach to contextual reasoning for interpretation ofspoken multimodal dialogue. The approach is based on combining recencybased search for antecedents with an object-oriented domain representation insuch a way that the search is highly constrained by the type information of theantecedents. By furthermore representingcandidate antecedents from the dialoguehistory and visual context in a uniformway, a single machinery (based on -reduction in lambda calculus) can be usedfor resolving many kinds of underspecified utterances. The approach has beenimplemented in two highly different domains.
|
|
| 4. |
|
|
| 5. |
|
|
| 6. |
|
|
| 7. |
|
|
| 8. |
|
|
| 9. |
- Gustafson, Joakim, et al.
(author)
-
Constraint Manipulation and Visualization in a Multimodal Dialogue System
- 2002
-
In: Proceedings of the ISCA Workshop on Multimodal Dialogue in Mobile Environments, Kloster Irsee, Germany..
-
Conference paper (peer-reviewed)abstract
- When interacting with spoken and multimodal dialogue systems, it is often difficult for users to understand and influence how their input is processed by the system. In this paper, wedescribe how these problems were addressed in the multimodal real-estate dialogue systemAdApt. During the course of a dialogue, the user's contraints are translated into symbolicicons that are visualized on the screen and can be manipulated by drag-and-drop operations.Users are thus given a clear picture of how their utterances are understood, and are given atransparent means of controlling the interaction with the system.
|
|
| 10. |
- Gustafson, Johan, et al.
(author)
-
Identification of Step Atoms by High Resolution Core Level Spectroscopy
- 2003
-
In: Physical Review Letters. - 1079-7114. ; 91:5
-
Journal article (peer-reviewed)abstract
- Vicinal Rh(111) surfaces are studied with high resolution core level photoemission. We demonstrate the possibility to distinguish between the different kinds of surface atoms on these surfaces by virtue of their 3d core level binding energies. In particular, the low coordinated step atoms are found to exhibit a clear fingerprint in Rh 3d spectra. We demonstrate how this may be used to show that initial oxygen adsorption occurs on the steps and not on the terraces of the vicinal surfaces.
|
|
