Search: onr:"swepub:oai:DiVA.org:kth-277059" >
Sonification of the...
Sonification of the self vs. sonification of the other : Differences in the sonification of performed vs. observed simple hand movements
-
- Bresin, Roberto, 1963- (author)
- KTH,Medieteknik och interaktionsdesign, MID,Sound and Music Computing
-
- Mancini, Maurizio (author)
- University College Cork National University of Ireland: Cork, IE
-
- Elblaus, Ludvig, 1981- (author)
- KTH,Medieteknik och interaktionsdesign, MID,Sound and Music Computing
-
show more...
-
- Frid, Emma, 1988- (author)
- KTH,Medieteknik och interaktionsdesign, MID,Sound and Music Computing
-
show less...
-
(creator_code:org_t)
- Elsevier BV, 2020
- 2020
- English.
-
In: International journal of human-computer studies. - : Elsevier BV. - 1071-5819 .- 1095-9300. ; 144
- Related links:
-
https://doi.org/10.1...
-
show more...
-
http://www.sciencedi...
-
https://doi.org/10.1...
-
https://urn.kb.se/re...
-
https://doi.org/10.1...
-
show less...
Abstract
Subject headings
Close
- Existing works on interactive sonification of movements, i.e., the translation of human movement qualities from the physical to the auditory domain, usually adopt a predetermined approach: the way in which movement features modulate the characteristics of sound is fixed. In our work we want to go one step further and demonstrate that the user role can influence the tuning of the mapping between movement cues and sound parameters. Here, we aim to verify if and how the mapping changes when the user is either the performer or the observer of a series of body movements (tracing a square or an infinite shape with the hand in the air). We asked participants to tune movement sonification while they were directly performing the sonified movement vs. while watching another person performing the movement and listening to its sonification. Results show that the tuning of the sonification chosen by participants is influenced by three variables: role of the user (performer vs observer), movement quality (the amount of Smoothness and Directness in the movement), and physical parameters of the movements (velocity and acceleration). Performers focused more on the quality of their movement, while observers focused more on the sonic rendering, making it more expressive and more connected to low-level physical features.
Subject headings
- TEKNIK OCH TEKNOLOGIER -- Annan teknik -- Interaktionsteknik (hsv//swe)
- ENGINEERING AND TECHNOLOGY -- Other Engineering and Technologies -- Interaction Technologies (hsv//eng)
- TEKNIK OCH TEKNOLOGIER -- Annan teknik -- Övrig annan teknik (hsv//swe)
- ENGINEERING AND TECHNOLOGY -- Other Engineering and Technologies -- Other Engineering and Technologies not elsewhere specified (hsv//eng)
- NATURVETENSKAP -- Data- och informationsvetenskap -- Medieteknik (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Media and Communication Technology (hsv//eng)
- NATURVETENSKAP -- Data- och informationsvetenskap -- Annan data- och informationsvetenskap (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Other Computer and Information Science (hsv//eng)
Keyword
- Sonification
- Mapping
- Hand movement
- Performance
- User role
- Media Technology
- Medieteknik
- Människa-datorinteraktion
- Human-computer Interaction
Publication and Content Type
- ref (subject category)
- art (subject category)
Find in a library
To the university's database