Mapping Inter-Cardiovascular Time-Frequency Coherence to Harmonic Tension in Sonification of Ensemble Interaction Between a COVID-19 Patient and the Medical Team

• This paper presents exploratory work on sonic and visual representations of heartbeats of a COVID-19 patient and a medical team. The aim of this work is to sonify heart signals to reflect how a medical team comes together during a COVID-19 treatment, i.e. to highlight other aspects of the COVID-19 pandemic than those usually portrayed through sonification, which often focuses on the number of cases. The proposed framework highlights synergies between sound and heart signals through mapping between timefrequency coherence (TFC) of heart signals and harmonic tension and dissonance in music. Results from a listening experiment suggested that the proposed mapping between TFC and harmonic tension was successful in terms of communicating low versus high coherence between heart signals, with an overall accuracy of 69%, which was significantly higher than chance. In the light of the performed work, we discuss how links between heart- and sound signals can be further explored through sonification to promote understanding of aspects related to cardiovascular health.

Ämnesord

TEKNIK OCH TEKNOLOGIER  -- Annan teknik -- Mediateknik (hsv//swe)

ENGINEERING AND TECHNOLOGY  -- Other Engineering and Technologies -- Media Engineering (hsv//eng)

NATURVETENSKAP  -- Data- och informationsvetenskap -- Människa-datorinteraktion (hsv//swe)

NATURAL SCIENCES  -- Computer and Information Sciences -- Human Computer Interaction (hsv//eng)

HUMANIORA  -- Konst -- Musik (hsv//swe)

HUMANITIES  -- Arts -- Music (hsv//eng)

Nyckelord

sonification

ECG

heart signal analysis

soniHED

Media Technology

Medieteknik

Art, Technology and Design

Konst, teknik och design

Human-computer Interaction

Människa-datorinteraktion

Publikations- och innehållstyp

ref (ämneskategori)

kon (ämneskategori)