| 1. |
- Lu, Zhihan, et al.
(författare)
-
Multimodal Hand and Foot Gesture Interaction for Handheld Devices
- 2014
-
Ingår i: ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP). - : Association for Computing Machinery (ACM). - 1551-6857 .- 1551-6865. ; 11:1
-
Tidskriftsartikel (refereegranskat)abstract
- We present a hand-and-foot-based multimodal interaction approach for handheld devices. Our method combines input modalities (i.e., hand and foot) and provides a coordinated output to both modalities along with audio and video. Human foot gesture is detected and tracked using contour-based template detection (CTD) and Tracking-Learning-Detection (TLD) algorithm. 3D foot pose is estimated from passive homography matrix of the camera. 3D stereoscopic and vibrotactile are used to enhance the immersive feeling. We developed a multimodal football game based on the multimodal approach as a proof-of-concept. We confirm our systems user satisfaction through a user study.
|
|
| 2. |
- Koniaris, Christos, 1979-
(författare)
-
Perceptually motivated speech recognition and mispronunciation detection
- 2012
-
Doktorsavhandling (övrigt vetenskapligt/konstnärligt)abstract
- This doctoral thesis is the result of a research effort performed in two fields of speech technology, i.e., speech recognition and mispronunciation detection. Although the two areas are clearly distinguishable, the proposed approaches share a common hypothesis based on psychoacoustic processing of speech signals. The conjecture implies that the human auditory periphery provides a relatively good separation of different sound classes. Hence, it is possible to use recent findings from psychoacoustic perception together with mathematical and computational tools to model the auditory sensitivities to small speech signal changes.The performance of an automatic speech recognition system strongly depends on the representation used for the front-end. If the extracted features do not include all relevant information, the performance of the classification stage is inherently suboptimal. The work described in Papers A, B and C is motivated by the fact that humans perform better at speech recognition than machines, particularly for noisy environments. The goal is to make use of knowledge of human perception in the selection and optimization of speech features for speech recognition. These papers show that maximizing the similarity of the Euclidean geometry of the features to the geometry of the perceptual domain is a powerful tool to select or optimize features. Experiments with a practical speech recognizer confirm the validity of the principle. It is also shown an approach to improve mel frequency cepstrum coefficients (MFCCs) through offline optimization. The method has three advantages: i) it is computationally inexpensive, ii) it does not use the auditory model directly, thus avoiding its computational cost, and iii) importantly, it provides better recognition performance than traditional MFCCs for both clean and noisy conditions.The second task concerns automatic pronunciation error detection. The research, described in Papers D, E and F, is motivated by the observation that almost all native speakers perceive, relatively easily, the acoustic characteristics of their own language when it is produced by speakers of the language. Small variations within a phoneme category, sometimes different for various phonemes, do not change significantly the perception of the language’s own sounds. Several methods are introduced based on similarity measures of the Euclidean space spanned by the acoustic representations of the speech signal and the Euclidean space spanned by an auditory model output, to identify the problematic phonemes for a given speaker. The methods are tested for groups of speakers from different languages and evaluated according to a theoretical linguistic study showing that they can capture many of the problematic phonemes that speakers from each language mispronounce. Finally, a listening test on the same dataset verifies the validity of these methods.
|
|
| 3. |
- Faber, Adrian, et al.
(författare)
-
Critical design goggles: Explorative use of critical design perspectives in a video production project
- 2014
-
Ingår i: SIDER’14 Royal Institute of Technology, KTH, Stockholm, Sweden, April 11-12, 2014.. ; , s. -5
-
Konferensbidrag (refereegranskat)abstract
- This paper is built on a study that intends to develop a method by creating a set of tools based on selected parts from critical design and critical design theory. The goals of these tools are to function as instruments enabling practical implementation of critical design in a design and/or production process. In this study we develop the tools for critical design work and test our tools in a specific production process of a music video to explore how to apply critical design practically. Indoing so we used design-oriented research methods. By bringing together critical design perspectives and the practice of video production, this study wishes to contribute to the work of bridging the gap between theory and practice in critical design.
|
|
| 4. |
- Katzeff, Cecilia, 1957-, et al.
(författare)
-
Exploring Sustainable Practices in Workplace Settings through Visualizing Electricity Consumption
- 2013
-
Ingår i: ACM Transactions on Computer-Human Interaction. - New York : ACM Press. - 1073-0516 .- 1557-7325. ; 20:5
-
Tidskriftsartikel (refereegranskat)abstract
- People’s domestic habits are increasingly being targeted to reduce levels of CO2 emissions. Whereas domestic energy consumption has received a lot of attention with several reported studies on sustainable practices, there are very few studies on workplace practices. Nevertheless, these are considered as having much potential for reducing energy consumption. This paper presents the findings from two field studies where two different types of prototypes for visualizing energy use were designed, implemented and evaluated in different types of workplace settings – factories and offices. The studies used design probes to explore how visual feedback for electricity use was interpreted and acted upon by employees in work settings. A striking observation was that it is very difficult to get people to change to more pro-environmental behavior and practices in a workplace environment. The paper discusses why this might be the case.
|
|
| 5. |
|
|
| 6. |
- Bresin, Roberto, 1963-, et al.
(författare)
-
Evaluation of computer systems for expressive music performance
- 2013
-
Ingår i: Guide to Computing for Expressive Music Performance. - London : Springer. - 9781447141235 - 9781447141228 ; , s. 181-203
-
Bokkapitel (refereegranskat)abstract
- In this chapter, we review and summarize different methods for the evaluation of CSEMPs. The main categories of evaluation methods are (1) comparisons with measurements from real performances, (2) listening experiments, and (3) production experiments. Listening experiments can be of different types. For example, in some experiments, subjects may be asked to rate a particular expressive characteristic (such as the emotion conveyed or the overall expression) or to rate the effect of a particular acoustic cue. In production experiments, subjects actively manipulate system parameters to achieve a target performance. Measures for estimating the difference between performances are discussed in relation to the objectives of the model and the objectives of the evaluation. There will be also a section with a presentation and discussion of the Rencon (Performance Rendering Contest). Rencon is a contest for comparing the expressive musical performances of the same score generated by different CSEMPs. Practical examples from previous works are presented, commented on, and analysed.
|
|
| 7. |
- Bresin, Roberto, 1963-, et al.
(författare)
-
Expressive sonification of footstep sounds
- 2010
-
Ingår i: Proceedings of ISon 2010. - Stockholm, Sweden : KTH Royal Institute of Technology. ; , s. 51-54
-
Konferensbidrag (refereegranskat)abstract
- In this study we present the evaluation of a model for the interactive sonification of footsteps. The sonification is achieved by means of specially designed sensored-shoes which control the expressive parameters of novel sound synthesis models capable of reproducing continuous auditory feedback for walking. In a previousstudy, sounds corresponding to different grounds were associated to different emotions and gender. In this study, we used an interactive sonification actuated by the sensored-shoes for providing auditory feedback to walkers. In an experiment we asked subjects to walk (using the sensored-shoes) with four different emotional intentions (happy, sad, aggressive, tender) and for each emotion we manipulated the ground texture sound four times (wood panels, linoleum, muddy ground, and iced snow). Preliminary results show that walkers used a more active walking style (faster pace) when the sound of the walking surface was characterized by an higher spectral centroid (e.g. iced snow), and a less active style (slower pace) when the spectral centroid was low (e.g. muddy ground). Harder texture sounds lead to more aggressive walking patters while softer ones to more tender and sad walking styles.
|
|
| 8. |
- Elblaus, Ludvig, 1981-, et al.
(författare)
-
Modes of sonic interaction in circus : Three proofs of concept
- 2014
-
Ingår i: Proceedings of Sound and Music Computing Conference 2014. - Athens : The International Computer Music Association, The Sound and Music Computing Steering Committe, The Institute for Research on Music & Acoustics. ; , s. 1698-1706, s. 1698-1706-
-
Konferensbidrag (refereegranskat)abstract
- The art of circus is a vibrant and competitive culture that embraces new tools and technology. In this paper, a series of exploratory design processes resulting in proofs of concepts are presented, showing strategies for effective use of three different modes of sonic interaction in contemporary circus. Each design process is based on participatory studio work, involving professional circus artists. All of the proofs of concepts have been evaluated, both with studio studies and public circus performances, taking the work beyond theoretical laboratory projects and properly engaging the practice and culture of contemporary circus.The first exploration uses a contortionist’s extreme bodily manipulation as inspiration for sonic manipulations in an accompanying piece of music. The second exploration uses electric amplification of acoustic sounds as a transformative enhancement of existing elements of circus performance. Finally, a sensor based system of real-time sonification of body gestures is explored and ideas from the sonification of dance are translated into the realm of circus.
|
|
| 9. |
- Friberg, Anders, et al.
(författare)
-
Analysis by synthesis
- 2014
-
Ingår i: Music in the Social and Behavioral Sciences. - Los Angeles : Sage Publications. - 9781452283036
-
Bokkapitel (refereegranskat)
|
|
| 10. |
- Friberg, Anders, et al.
(författare)
-
Expressive timing
- 2014
-
Ingår i: Music in the Social and Behavioral Sciences. - Los Angeles : Sage Publications. - 9781452283036 ; , s. 440-442
-
Bokkapitel (refereegranskat)
|
|
