Learning Body Movement Sonification in an Hour

• Sonification in general, and sonification of body movements in particular, can be of great interest for different purposes, including research activities and artistic work. Up till recently, it has often been a time-consuming and sometimes expensive procedure to explore the field which can make sonification difficult for beginners to enter. The current study aims to solve these challenges by using radically inclusive and accessible technologies for learning and sharing sonification applications. It uses Google MediaPipe, the p5.js online editor, and WebAudioXML (WAXML) as a platform where it is possible to learn, create, and share sonification of body movements without having any earlier experiences from sonification, audio programming, or web development. The platform was evaluated during a one-hour workshop using observations and user responses through an online form. The result is promising and shows that web technologies work well on various computers and that all participants succeeded in meeting the goals for the workshop within the limited time. The answers from the online form also give insights into further development of platforms for learning sonification and ideas for new syntax and features for WAXML. 

Subject headings

NATURVETENSKAP  -- Data- och informationsvetenskap -- Medieteknik (hsv//swe)

NATURAL SCIENCES  -- Computer and Information Sciences -- Media and Communication Technology (hsv//eng)

Keyword

Web Audio

Body Gestures

Sonification

Web Audio

Kroppsrörelse

Sonification

Publication and Content Type

vet (subject category)

pro (subject category)