Multimodal Capture of Patient Behaviour for Improved Detection of Early Dementia: Clinical Feasibility and Preliminary Results

Multimodal Capture of Patient Behaviour for Improved Detection of Early Dementia : Clinical Feasibility and Preliminary Results

QC 20211022
Non-invasive automatic screening for Alzheimer's disease has the potential to improve diagnostic accuracy while lowering healthcare costs. Previous research has shown that patterns in speech, language, gaze, and drawing can help detect early signs of cognitive decline. In this paper, we describe a highly multimodal system for unobtrusively capturing data during real clinical interviews conducted as part of cognitive assessments for Alzheimer's disease. The system uses nine different sensor devices (smartphones, a tablet, an eye tracker, a microphone array, and a wristband) to record interaction data during a specialist's first clinical interview with a patient, and is currently in use at Karolinska University Hospital in Stockholm, Sweden. Furthermore, complementary information in the form of brain imaging, psychological tests, speech therapist assessment, and clinical meta-data is also available for each patient. We detail our data-collection and analysis procedure and present preliminary findings that relate measures extracted from the multimodal recordings to clinical assessments and established biomarkers, based on data from 25 patients gathered thus far. Our findings demonstrate feasibility for our proposed methodology and indicate that the collected data can be used to improve clinical assessments of early dementia.

Moell, BirgerKTH,Tal, musik och hörsel, TMH(Swepub:kth)u126tyxp (author)
Håkansson, KristerKarolinska Inst, Dept Neurobiol Care Sci & Soc, Stockholm, Sweden.;Karolinska Univ Hosp, Stockholm, Sweden. (author)
Henter, Gustav Eje,Assistant ProfessorKTH,Tal, musik och hörsel, TMH(Swepub:kth)u1cj22n0 (author)
Kucherenko, Taras,1994-KTH,Robotik, perception och lärande, RPL(Swepub:kth)u1igz10x (author)
Mikheeva, OlgaKTH,Robotik, perception och lärande, RPL(Swepub:kth)u1m9gj48 (author)
Hagman, GöranKarolinska Inst, Dept Neurobiol Care Sci & Soc, Stockholm, Sweden.;Karolinska Univ Hosp, Stockholm, Sweden. (author)
Holleman, JasperKarolinska Inst, Dept Neurobiol Care Sci & Soc, Stockholm, Sweden.;Karolinska Univ Hosp, Stockholm, Sweden. (author)
Kivipelto, MiiaKarolinska Inst, Dept Neurobiol Care Sci & Soc, Stockholm, Sweden.;Karolinska Univ Hosp, Stockholm, Sweden. (author)
Kjellström, Hedvig,1973-KTH,Robotik, perception och lärande, RPL(Swepub:kth)u1izkbhh (author)
Gustafson, Joakim,Professor,1966-KTH,Tal, musik och hörsel, TMH(Swepub:kth)u183famk (author)
Beskow, JonasKTH,Tal, musik och hörsel, TMH(Swepub:kth)u1g7i6t9 (author)
KTHTal, musik och hörsel, TMH (creator_code:org_t)

By the author/editor: Jonell, Patrik; Moell, Birger; Håkansson, Krist ...; Henter, Gustav E ...; Kucherenko, Tara ...; Mikheeva, Olga; show more...; Hagman, Göran; Holleman, Jasper; Kivipelto, Miia; Kjellström, Hedv ...; Gustafson, Joaki ...; Beskow, Jonas; show less...

About the subject

NATURAL SCIENCES: NATURAL SCIENCES; and Computer and Inf ...; and Language Technol ...

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.