| 1. |
- Bresin, Roberto, 1963-, et al.
(författare)
-
Robust Non-Verbal Expression in Humanoid Robots: New Methods for Augmenting Expressive Movements with Sound
- 2021
-
Konferensbidrag (refereegranskat)abstract
- The aim of the SONAO project is to establish new methods basedon sonification of expressive movements for achieving a robust interaction between users and humanoid robots. We want to achievethis by combining competences of the research team members inthe fields of social robotics, sound and music computing, affective computing, and body motion analysis. We want to engineersound models for implementing effective mappings between stylized body movements and sound parameters that will enable anagent to express high-level body motion qualities through sound.These mappings are paramount for supporting feedback to andunderstanding robot body motion. The project will result in thedevelopment of new theories, guidelines, models, and tools forthe sonic representation of high-level body motion qualities in interactive applications. This work is part of the growing researchfield known as data sonification, in which we combine methodsand knowledge from the fields of interactive sonification, embodied cognition, multisensory perception, non-verbal and gesturalcommunication in robots.
|
|
| 2. |
- Bresin, Roberto, 1963-, et al.
(författare)
-
Sonification of the self vs. sonification of the other : Differences in the sonification of performed vs. observed simple hand movements
- 2020
-
Ingår i: International journal of human-computer studies. - : Elsevier BV. - 1071-5819 .- 1095-9300. ; 144
-
Tidskriftsartikel (refereegranskat)abstract
- Existing works on interactive sonification of movements, i.e., the translation of human movement qualities from the physical to the auditory domain, usually adopt a predetermined approach: the way in which movement features modulate the characteristics of sound is fixed. In our work we want to go one step further and demonstrate that the user role can influence the tuning of the mapping between movement cues and sound parameters. Here, we aim to verify if and how the mapping changes when the user is either the performer or the observer of a series of body movements (tracing a square or an infinite shape with the hand in the air). We asked participants to tune movement sonification while they were directly performing the sonified movement vs. while watching another person performing the movement and listening to its sonification. Results show that the tuning of the sonification chosen by participants is influenced by three variables: role of the user (performer vs observer), movement quality (the amount of Smoothness and Directness in the movement), and physical parameters of the movements (velocity and acceleration). Performers focused more on the quality of their movement, while observers focused more on the sonic rendering, making it more expressive and more connected to low-level physical features.
|
|
| 3. |
- Bresin, Roberto, 1963-, et al.
(författare)
-
SOUND FOREST/LJUDSKOGEN: A LARGE-SCALE STRING-BASED INTERACTIVE MUSICAL INSTRUMENT
- 2016
-
Ingår i: Sound and Music Computing 2016. - : SMC Sound&Music Computing NETWORK. - 9783000537004 ; , s. 79-84
-
Konferensbidrag (refereegranskat)abstract
- In this paper we present a string-based, interactive, largescale installation for a new museum dedicated to performing arts, Scenkonstmuseet, which will be inaugurated in 2017 in Stockholm, Sweden. The installation will occupy an entire room that measures 10x5 meters. We aim to create a digital musical instrument (DMI) that facilitates intuitive musical interaction, thereby enabling visitors to quickly start creating music either alone or together. The interface should be able to serve as a pedagogical tool; visitors should be able to learn about concepts related to music and music making by interacting with the DMI. Since the lifespan of the installation will be approximately five years, one main concern is to create an experience that will encourage visitors to return to the museum for continued instrument exploration. In other words, the DMI should be designed to facilitate long-term engagement. Finally, an important aspect in the design of the installation is that the DMI should be accessible and provide a rich experience for all museum visitors, regardless of age or abilities.
|
|
| 4. |
|
|
| 5. |
- Falkenberg, Kjetil, Docent, 1972-, et al.
(författare)
-
Creating digital musical instruments with and for children: Including vocal sketching as a method for engaging in codesign
- 2020
-
Ingår i: Human Technology. - : Centre of Sociological Research, NGO. - 1795-6889. ; 16:3, s. 348-371
-
Tidskriftsartikel (refereegranskat)abstract
- A class of master of science students and a group of preschool children codesigned new digital musical instruments based on workshop interviews involving vocal sketching, a method for imitating and portraying sounds. The aim of the study was to explore how the students and children would approach vocal sketching as one of several design methods. The children described musical instruments to the students using vocal sketching and other modalities (verbal, drawing, gestures). The resulting instruments built by the students were showcased at the Swedish Museum of Performing Arts in Stockholm. Although all the children tried vocal sketching during preparatory tasks, few employed the method during the workshop. However, the instruments seemed to meet the children’s expectations. Consequently, even though the vocal sketching method alone provided few design directives in the given context, we suggest that vocal sketching, under favorable circumstances, can be an engaging component that complements other modalities in codesign involving children.
|
|
| 6. |
- Frid, Emma, 1988-, et al.
(författare)
-
A Dual-Task Experimental Methodology for Exploration of Saliency of Auditory Notifications in a Retail Soundscape
- 2023
-
Ingår i: Proceedings of the 28th International Conference on Auditory Display (ICAD2023): Sonification for the Masses, 2023.
-
Konferensbidrag (refereegranskat)abstract
- This paper presents an experimental design of a dual-task experiment aimed at exploring the salience of auditory notifications. The first task is a Sustained Attention to Response Task (SART) and the second task involves listening to a complex store soundscape that includes ambient sounds, background music and auditory notifications. In this task, subjects are asked to press a button when an auditory notification is detected. The proposed method is based on a triangulation approach in which quantitative variables are combined with perceptual ratings and free-text question replies to obtain a holistic picture of how the sound environment is perceived. Results from this study can be used to inform the design of systems presenting music and peripheral auditory notifications in a retail environment.
|
|
| 7. |
- Frid, Emma, 1988-
(författare)
-
Accessible Digital Musical Instruments : A Survey of Inclusive Instruments Presented at the NIME, SMC and ICMC Conferences
- 2018
-
Ingår i: Proceedings of the International Computer Music Conference 2018. - San Francisco : The International Computer Music Association. ; , s. 53-59
-
Konferensbidrag (refereegranskat)abstract
- This paper describes a survey of accessible Digital Musical Instruments (ADMIs) presented at the NIME, SMC and ICMC conferences. It outlines the history of research concerned with facilitating inclusion in music making and discusses advances, current state of developments and trends in the field. Based on a systematic analysis of DMIs presented at the three conferences, seven control interface types could be identified: tangible, nontangible, audio, touch-screen, gaze, BCMIs and adapted instruments. Most of the ADMIs were tangible interfaces or physical controllers. Many of the instruments were designed for persons with physical disabilities or children with health conditions or impairments. Little attention was paid to DMIs for blind users. Although the haptic modality could play an important role in musical interaction in this context, relatively few of the ADMIs (26.7%) incorporated vibrotactile feedback. A discussion on future directions for inclusive design of DMIs is presented.
|
|
| 8. |
- Frid, Emma, 1988-
(författare)
-
Accessible Digital Musical Instruments : A Review of Musical Interfaces in Inclusive Music Practice
- 2019
-
Ingår i: Multimodal Technologies and Interaction. - : MDPI. - 2414-4088. ; 3:3
-
Tidskriftsartikel (refereegranskat)abstract
- Current advancements in music technology enable the creation of customized Digital Musical Instruments (DMIs). This paper presents a systematic review of Accessible Digital Musical Instruments (ADMIs) in inclusive music practice. History of research concerned with facilitating inclusion in music-making is outlined, and current state of developments and trends in the field are discussed. Although the use of music technology in music therapy contexts has attracted more attention in recent years, the topic has been relatively unexplored in Computer Music literature. This review investigates a total of 113 publications focusing on ADMIs. Based on the 83 instruments in this dataset, ten control interface types were identified: tangible controllers, touchless controllers, Brain–Computer Music Interfaces (BCMIs), adapted instruments, wearable controllers or prosthetic devices, mouth-operated controllers, audio controllers, gaze controllers, touchscreen controllers and mouse-controlled interfaces. The majority of the AMDIs were tangible or physical controllers. Although the haptic modality could potentially play an important role in musical interaction for many user groups, relatively few of the ADMIs (15.6%) incorporated vibrotactile feedback. Aspects judged to be important for successful ADMI design were instrument adaptability and customization, user participation, iterative prototyping, and interdisciplinary development teams.
|
|
| 9. |
- Frid, Emma, et al.
(författare)
-
An Exploratory Study On The Effect Of Auditory Feedback On Gaze Behavior In a Virtual Throwing Task With and Without Haptic Feedback
- 2017
-
Ingår i: Proceedings of the 14th Sound and Music Computing Conference. - Espoo, Finland : Aalto University. - 9789526037295 ; , s. 242-249
-
Konferensbidrag (refereegranskat)abstract
- This paper presents findings from an exploratory study on the effect of auditory feedback on gaze behavior. A total of 20 participants took part in an experiment where the task was to throw a virtual ball into a goal in different conditions: visual only, audiovisual, visuohaptic and audio- visuohaptic. Two different sound models were compared in the audio conditions. Analysis of eye tracking metrics indicated large inter-subject variability; difference between subjects was greater than difference between feedback conditions. No significant effect of condition could be observed, but clusters of similar behaviors were identified. Some of the participants’ gaze behaviors appeared to have been affected by the presence of auditory feedback, but the effect of sound model was not consistent across subjects. We discuss individual behaviors and illustrate gaze behavior through sonification of gaze trajectories. Findings from this study raise intriguing questions that motivate future large-scale studies on the effect of auditory feedback on gaze behavior.
|
|
| 10. |
|
|
