Mapping Inter-Cardiovascular Time-Frequency Coherence to Harmonic Tension in Sonification of Ensemble Interaction Between a COVID-19 Patient and the Medical Team

Frid, Emma,1988-KTH,Medieteknik och interaktionsdesign, MID,Sciences et Technologies de la Musique et du Son Laboratoire, STMS, CNRS, Ircam, Sorbonne Université, Ministère de la Culture, Paris, France (author)

QC 20210629
This paper presents exploratory work on sonic and visual representations of heartbeats of a COVID-19 patient and a medical team. The aim of this work is to sonify heart signals to reflect how a medical team comes together during a COVID-19 treatment, i.e. to highlight other aspects of the COVID-19 pandemic than those usually portrayed through sonification, which often focuses on the number of cases. The proposed framework highlights synergies between sound and heart signals through mapping between timefrequency coherence (TFC) of heart signals and harmonic tension and dissonance in music. Results from a listening experiment suggested that the proposed mapping between TFC and harmonic tension was successful in terms of communicating low versus high coherence between heart signals, with an overall accuracy of 69%, which was significantly higher than chance. In the light of the performed work, we discuss how links between heart- and sound signals can be further explored through sonification to promote understanding of aspects related to cardiovascular health.

Orini, MicheleUniversity College London (author)
Martinelli, GiampaoloBarts Health NHS Trust, St. Bartholomew’s Hospital (author)
Chew, ElaineSciences et Technologies de la Musique et du Son Laboratoire, STMS, CNRS, Ircam, Sorbonne Université, Ministère de la Culture, Paris, France (author)
KTHMedieteknik och interaktionsdesign, MID (creator_code:org_t)

By the author/editor: Frid, Emma, 1988 ...; Orini, Michele; Martinelli, Giam ...; Chew, Elaine

About the subject

ENGINEERING AND TECHNOLOGY: ENGINEERING AND ...; and Other Engineerin ...; and Media Engineerin ...

NATURAL SCIENCES: NATURAL SCIENCES; and Computer and Inf ...; and Human Computer I ...

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.