Audio-Visual Interactive Art: Investigating the effect of gaze-controlled audio on visual attention and short-term memory

• This article presents the development and testing of a system for interactive art. The system utilises eye tracking technology to detect the eye movements of people looking at a painting, and then uses this data to trigger sounds related to the painting. The system was developed in collaboration with a visual artist and a musician with the ultimate aim to integrate it into a new piece of interactive art. Described here in detail is the design and development of a prototype which was tested using a copy of a painting by Hieronymus Bosch: The Garden of Earthly Delights. Through this system we tested whether gaze-controlled audio affects visual attention and short term memory.

Ämnesord

TEKNIK OCH TEKNOLOGIER  -- Annan teknik -- Mediateknik (hsv//swe)

ENGINEERING AND TECHNOLOGY  -- Other Engineering and Technologies -- Media Engineering (hsv//eng)

Nyckelord

Eye tracking technology

Sound

Interactive art

Publikations- och innehållstyp

ref (ämneskategori)

kon (ämneskategori)