Automatic Analysis of Infant Engagement during Play : An End-to-end Learning and Explainable AI Pilot Experiment

• Infant engagement during play is an active area of research, relatedto the development of cognition. Automatic detection of engagementcould benefit the research process, but existing techniquesused for automatic affect detection are unsuitable for this scenario,since they rely on the automatic extraction of facial and posturalfeatures trained on clear video capture of adults. This study showsthat end-to-end Deep Learning methods can successfully detectengagement of infants, without the need of clear facial video, whentrained for a specific interaction task. It further shows that attentionmapping techniques can provide explainability, thereby enablingtrust and insight into a model’s reasoning process.

Ämnesord

NATURVETENSKAP  -- Data- och informationsvetenskap -- Datavetenskap (hsv//swe)

NATURAL SCIENCES  -- Computer and Information Sciences -- Computer Sciences (hsv//eng)

Publikations- och innehållstyp

ref (ämneskategori)

kon (ämneskategori)