| 1. |
- Bresin, Roberto, 1963-, et al.
(författare)
-
Robust Non-Verbal Expression in Humanoid Robots: New Methods for Augmenting Expressive Movements with Sound
- 2021
-
Konferensbidrag (refereegranskat)abstract
- The aim of the SONAO project is to establish new methods basedon sonification of expressive movements for achieving a robust interaction between users and humanoid robots. We want to achievethis by combining competences of the research team members inthe fields of social robotics, sound and music computing, affective computing, and body motion analysis. We want to engineersound models for implementing effective mappings between stylized body movements and sound parameters that will enable anagent to express high-level body motion qualities through sound.These mappings are paramount for supporting feedback to andunderstanding robot body motion. The project will result in thedevelopment of new theories, guidelines, models, and tools forthe sonic representation of high-level body motion qualities in interactive applications. This work is part of the growing researchfield known as data sonification, in which we combine methodsand knowledge from the fields of interactive sonification, embodied cognition, multisensory perception, non-verbal and gesturalcommunication in robots.
|
|
| 2. |
|
|
| 3. |
- Frid, Emma, 1988-, et al.
(författare)
-
Designing and reporting research on sound design and music for health : Methods and frameworks for impact
- 2021
-
Ingår i: Doing Research in Sound Design. - London : Focal Press. ; , s. 125-150
-
Bokkapitel (refereegranskat)abstract
- This chapter presents key methodological aspects to consider for researchers in the fields of sound design and music computing when evaluating and making strategic choices for conducting research targeting health, accessibility and disability. We present practical suggestions for how to effectively increase the impact in the research community based on existing methods commonly used in evidence-based research. Although many of the described models, frameworks and methods are not novel, they have so far only been extensively applied in music therapy studies and music medicine interventions, but not in sound design research nor music computing. The frameworks presented here are gathered from, primarily, practices concerning systematic reviews. We conclude with a discussion about the current state of the field and provide examples of how proposed frameworks and guidelines can be used when reporting results from quantitative research studies to systematic reviews.
|
|
| 4. |
- Frid, Emma, 1988-, et al.
(författare)
-
Mapping Inter-Cardiovascular Time-Frequency Coherence to Harmonic Tension in Sonification of Ensemble Interaction Between a COVID-19 Patient and the Medical Team
- 2021
-
Ingår i: Proceedings of the International Conference on Auditory Display (ICAD) 2021.
-
Konferensbidrag (refereegranskat)abstract
- This paper presents exploratory work on sonic and visual representations of heartbeats of a COVID-19 patient and a medical team. The aim of this work is to sonify heart signals to reflect how a medical team comes together during a COVID-19 treatment, i.e. to highlight other aspects of the COVID-19 pandemic than those usually portrayed through sonification, which often focuses on the number of cases. The proposed framework highlights synergies between sound and heart signals through mapping between timefrequency coherence (TFC) of heart signals and harmonic tension and dissonance in music. Results from a listening experiment suggested that the proposed mapping between TFC and harmonic tension was successful in terms of communicating low versus high coherence between heart signals, with an overall accuracy of 69%, which was significantly higher than chance. In the light of the performed work, we discuss how links between heart- and sound signals can be further explored through sonification to promote understanding of aspects related to cardiovascular health.
|
|
| 5. |
|
|
| 6. |
- Frid, Emma, 1988-, et al.
(författare)
-
Perceptual Evaluation of Blended Sonification of Mechanical Robot Sounds Produced by Emotionally Expressive Gestures : Augmenting Consequential Sounds to Improve Non-verbal Robot Communication
- 2021
-
Ingår i: International Journal of Social Robotics. - : Springer Nature. - 1875-4791 .- 1875-4805.
-
Tidskriftsartikel (refereegranskat)abstract
- This paper presents two experiments focusing on perception of mechanical sounds produced by expressive robot movement and blended sonifications thereof. In the first experiment, 31 participants evaluated emotions conveyed by robot sounds through free-form text descriptions. The sounds were inherently produced by the movements of a NAO robot and were not specifically designed for communicative purposes. Results suggested no strong coupling between the emotional expression of gestures and how sounds inherent to these movements were perceived by listeners; joyful gestures did not necessarily result in joyful sounds. A word that reoccurred in text descriptions of all sounds, regardless of the nature of the expressive gesture, was “stress”. In the second experiment, blended sonification was used to enhance and further clarify the emotional expression of the robot sounds evaluated in the first experiment. Analysis of quantitative ratings of 30 participants revealed that the blended sonification successfully contributed to enhancement of the emotional message for sound models designed to convey frustration and joy. Our findings suggest that blended sonification guided by perceptual research on emotion in speech and music can successfully improve communication of emotions through robot sounds in auditory-only conditions.
|
|
| 7. |
- Frid, Emma, 1988-, et al.
(författare)
-
Reimagining (Accessible) Digital Musical Instruments: A Survey on Electronic Music-Making Tools
- 2021
-
Ingår i: Proceedings of the International Conference on New Interfaces for Musical Expression (NIME) 2021.
-
Konferensbidrag (refereegranskat)abstract
- This paper discusses findings from a survey on interfaces for making electronic music. We invited electronic music makers of varying experience to reflect on their practice and setup and to imagine and describe their ideal interface for music-making. We also asked them to reflect on the state of gestural controllers, machine learning, and artificial intelligence in their practice. We had 118 people respond to the survey, with 40.68% professional musicians, and 10.17% identifying as living with a disability or access requirement. Results highlight limitations of music-making setups as perceived by electronic music makers, reflections on how imagined novel interfaces could address such limitations, and positive attitudes towards ML and AI in general.
|
|
| 8. |
|
|
