When You Hear the Chime : Movable Books and the Dramaturgical Functions of Sound in Mixed Reality Interactive Narrative Design

• In this paper we outline the pre-digital histories of recorded and synthesized sound, exploring their entanglements with both the literal codex and larger literary imaginary. In particular, we focus on intersections of sound and movable books, offering the rich genealogy of the movable book as a fertile addition to the IDN (interactive digital narrative) family tree, as an example of pre-computational interactive narrative with a long history. Drawing on this intermedial history, along with our own experience designing an MR (mixed reality) movable book, we offer a taxonomy of dramaturgical functions of sound in MR IDN. We demonstrate the use of this taxonomy in analysis of our own work, and suggest opportunities for expanding the taxonomy in support of future speculative research and design imaginaries for IDNs. 

Subject headings

HUMANIORA  -- Språk och litteratur -- Litteraturvetenskap (hsv//swe)

HUMANITIES  -- Languages and Literature -- General Literary Studies (hsv//eng)

NATURVETENSKAP  -- Data- och informationsvetenskap -- Medieteknik (hsv//swe)

NATURAL SCIENCES  -- Computer and Information Sciences -- Media and Communication Technology (hsv//eng)

SAMHÄLLSVETENSKAP  -- Medie- och kommunikationsvetenskap -- Medievetenskap (hsv//swe)

SOCIAL SCIENCES  -- Media and Communications -- Media Studies (hsv//eng)

TEKNIK OCH TEKNOLOGIER  -- Annan teknik -- Interaktionsteknik (hsv//swe)

ENGINEERING AND TECHNOLOGY  -- Other Engineering and Technologies -- Interaction Technologies (hsv//eng)

Keyword

Human computer interaction

Mixed reality

Digital history

Family tree

Imaginaries

Interactive digital narratives

Interactive narrative

Literals

Movable books

Narrative designs

Synthesized sounds

Taxonomies

Sound

GAME Research Group

GAME Research Group

Publication and Content Type

ref (subject category)

kon (subject category)