| 1. |
- Bell, Linda, et al.
(författare)
-
Modality Convergence in a Multimodal Dialogue System
- 2000
-
Ingår i: Proceedings of Götalog. ; , s. 29-34
-
Konferensbidrag (refereegranskat)abstract
- When designing multimodal dialogue systems allowing speech as well as graphical operations, it is important to understand not only how people make use of the different modalities in their utterances, but also how the system might influence a user’s choice of modality by its own behavior. This paper describes an experiment in which subjects interacted with two versions of a simulated multimodal dialogue system. One version used predominantly graphical means when referring to specific objects; the other used predominantly verbal referential expressions. The purpose of the study was to find out what effect, if any, the system’s referential strategy had on the user’s behavior. The results provided limited support for the hypothesis that the system can influence users to adopt another modality for the purpose of referring
|
|
| 2. |
- Bell, Linda, et al.
(författare)
-
The Swedish NICE Corpus – Spoken dialogues between children and embodied characters in a computer game scenario
- 2005
-
Ingår i: Proceedings Interspeech 2005 - Eurospeech. - Lisbon, Portugal : ISCA. ; , s. 2765-2768, s. 2765-2768
-
Konferensbidrag (refereegranskat)abstract
- This article describes the collection and analysis of a Swedish database of spontaneous and unconstrained children-machine dialogues. The Swedish NICE corpus consists of spoken dialogues between children aged 8 to 15 and embodied fairytale characters in a computer game scenario. Compared to previously collected corpora of children's computer-directed speech, the Swedish NICE corpus contains extended interactions, including three-party conversation, in which the young users used spoken dialogue as the primary means of progression in the game.
|
|
| 3. |
- Boye, Johan, et al.
(författare)
-
Contextual reasoning in multimodal dialogue systems : two case studies
- 2004
-
Ingår i: Proceedings of The 8th Workshop on the Semantics and Pragmatics of Dialogue Catalogue'04. - Barcelona. ; , s. 19-21
-
Konferensbidrag (refereegranskat)abstract
- This paper describes an approach to contextual reasoning for interpretation ofspoken multimodal dialogue. The approach is based on combining recencybased search for antecedents with an object-oriented domain representation insuch a way that the search is highly constrained by the type information of theantecedents. By furthermore representingcandidate antecedents from the dialoguehistory and visual context in a uniformway, a single machinery (based on -reduction in lambda calculus) can be usedfor resolving many kinds of underspecified utterances. The approach has beenimplemented in two highly different domains.
|
|
| 4. |
- Boye, Johan, et al.
(författare)
-
Multi-slot semantics for natural-language call routing systems
- 2007
-
Ingår i: Proceedings of Bridging the Gap. ; , s. 68-75, s. 68-75
-
Konferensbidrag (refereegranskat)abstract
- Statistical classification techniques for natural-language call routing systems have matured to the point where it is possible to distinguish between several hundreds of semantic categories with an accuracy that is sufficient for commercial deployments. For category sets of this size, the problem of maintaining consistency among manually tagged utterances becomes limiting, as lack of consistency in the training data will degrade performance of the classifier. It is thus essential that the set of categories be structured in a way that alleviates this problem, and enables consistency to be preserved as the domain keeps changing. In this paper, we describe our experiences of using a two-level multi-slot semantics as a way of meeting this problem. Furthermore, we explore the ramifications of the approach with respect to classification, evaluation and dialogue design for call routing systems.
|
|
| 5. |
- Boye, Johan, et al.
(författare)
-
Negotiative Spoken-Dialogue Interfaces to Databases
- 2003
-
Ingår i: Proceedings of Diabruck, Wallerfangen, Germany.
-
Konferensbidrag (refereegranskat)abstract
- The aim of this paper is to develop a principled and empirically motivated approach to robust, negotiative spoken dialogue with databases. Robustness is achieved by limiting the set of representable utterance types. Still, the vast majority of utterances that occur in practice can be handled.
|
|
| 6. |
- Boye, Johan, et al.
(författare)
-
Robust parsing and spoken negotiative dialogue with databases
- 2008
-
Ingår i: Natural Language Engineering. - : Cambridge University Press. - 1351-3249 .- 1469-8110. ; 14:3, s. 289-312
-
Tidskriftsartikel (refereegranskat)abstract
- This paper presents a robust parsing algorithm and semantic formalism for the interpretation of utterances in spoken negotiative dialogue with databases. The algorithm works in two passes: a domain-specific pattern-matching phase and a domain-independent semantic analysis phase. Robustness is achieved by limiting the set of representable utterance types to an empirically motivated subclass which is more expressive than propositional slot–value lists, but much less expressive than first-order logic. Our evaluation shows that in actual practice the vast majority of utterances that occur can be handled, and that the parsing algorithm is highly efficient and accurate.
|
|
| 7. |
- Boye, Johan, et al.
(författare)
-
Robust Parsing of Utterances in Negotiative Dialogue
- 2003
-
Ingår i: Proceedings 8th European Conference on Speech Communication and Technology (Eurospeech), Geneva, Switzerland.
-
Konferensbidrag (refereegranskat)abstract
- This paper presents an algorithm for domain-dependent parsing of utterances in negotiative dialogue. To represent such utterances, the algorithm outputs semantic expressions that are more expressive than propositional slot-filler structures. It is very fast and robust, yet precise and capable of correctly combining information from different utterance fragments.
|
|
| 8. |
- Boye, Johan, et al.
(författare)
-
Robust spoken language understanding in a computer game
- 2006
-
Ingår i: Speech Communication. - : Elsevier. - 0167-6393 .- 1872-7182. ; 48:3-4, s. 335-353
-
Tidskriftsartikel (refereegranskat)abstract
- We present and evaluate a robust method for the interpretation of spoken input to a conversational computer game. The scenario of the game is that of a player interacting with embodied fairy-tale characters in a 3D world via spoken dialogue (supplemented by graphical pointing actions) to solve various problems. The player himself cannot directly perform actions in the world, but interacts with the fairy-tale characters to have them perform various tasks, and to get information about the world and the problems to solve. Hence the role of spoken dialogue as the primary means of control is obvious and natural to the player. Naturally, this means that robust spoken language understanding becomes a critical component. To this end, the paper describes a semantic representation formalism and an accompanying parsing algorithm which works off the output of the speech recogniser's statistical language model. The evaluation shows that the parser is robust in the sense of considerably improving on the noisy output of the speech recogniser.
|
|
| 9. |
- Carter, David, et al.
(författare)
-
Common speech/language issues
- 2000
-
Ingår i: The spoken language translator. - Cambridge : Cambridge University Press. - 0521770777 - 9780521038829 ; , s. 284-294
-
Bokkapitel (övrigt vetenskapligt/konstnärligt)
|
|
| 10. |
- Carter, David, et al.
(författare)
-
Evaluation
- 2000
-
Ingår i: The spoken language translator. - Cambridge : Cambridge University Press. - 0521770777 - 9780521038829 ; , s. 297-312
-
Bokkapitel (övrigt vetenskapligt/konstnärligt)
|
|
