One algorithm to rule them all? : An evaluation and discussion of ten eye movement event-detection algorithms

Andersson, RichardLund University,Lunds universitet,Kognitionsvetenskap,Filosofiska institutionen,Institutioner,Humanistiska och teologiska fakulteterna,Cognitive Science,Department of Philosophy,Departments,Joint Faculties of Humanities and Theology (author)

Almost all eye-movement researchers use algorithms to parse raw data and detect distinct types of eye movement events, such as fixations, saccades, and pursuit, and then base their results on these. Surprisingly, these algorithms are rarely evaluated. We evaluated the classifications of ten eye-movement event detection algorithms, on data from an SMI HiSpeed 1250 system, and compared them to manual ratings of two human experts. The evaluation focused on fixations, saccades, and post-saccadic oscillations. The evaluation used both event duration parameters, and sample-by-sample comparisons to rank the algorithms. The resulting event durations varied substantially as a function of what algorithm was used. This evaluation differed from previous evaluations by considering a relatively large set of algorithms, multiple events, and data from both static and dynamic stimuli. The main conclusion is that current detectors of only fixations and saccades work reasonably well for static stimuli, but barely better than chance for dynamic stimuli. Differing results across evaluation methods make it difficult to select one winner for fixation detection. For saccade detection, however, the algorithm by Larsson, Nyström and Stridh (IEEE Transaction on Biomedical Engineering, 60(9):2484–2493,2013) outperforms all algorithms in data from both static and dynamic stimuli. The data also show how improperly selected algorithms applied to dynamic data misestimate fixation and saccade properties.

Larsson, LinnéaLund University,Lunds universitet,Avdelningen för Biomedicinsk teknik,Institutionen för biomedicinsk teknik,Institutioner vid LTH,Lunds Tekniska Högskola,Department of Biomedical Engineering,Departments at LTH,Faculty of Engineering, LTH(Swepub:lu)eit-lla (author)
Holmqvist, KennethLund University,Lunds universitet,Humanistlaboratoriet,Fakultetsgemensamma verksamheter,Humanistiska och teologiska fakulteterna,Lund University Humanities Lab,Units,Joint Faculties of Humanities and Theology(Swepub:lu)lucs-kho (author)
Stridh, MartinLund University,Lunds universitet,Avdelningen för Biomedicinsk teknik,Institutionen för biomedicinsk teknik,Institutioner vid LTH,Lunds Tekniska Högskola,Department of Biomedical Engineering,Departments at LTH,Faculty of Engineering, LTH(Swepub:lu)tde-mst (author)
Nyström, MarcusLund University,Lunds universitet,Humanistlaboratoriet,Fakultetsgemensamma verksamheter,Humanistiska och teologiska fakulteterna,Lund University Humanities Lab,Units,Joint Faculties of Humanities and Theology(Swepub:lu)it-mny (author)
KognitionsvetenskapFilosofiska institutionen (creator_code:org_t)

In:Behavior Research Methods: Springer Science and Business Media LLC49:2, s. 616-6371554-3528

By the author/editor: Andersson, Richa ...; Larsson, Linnéa; Holmqvist, Kenne ...; Stridh, Martin; Nyström, Marcus

About the subject

ENGINEERING AND TECHNOLOGY: ENGINEERING AND ...; and Electrical Engin ...; and Signal Processin ...

ENGINEERING AND TECHNOLOGY: ENGINEERING AND ...; and Medical Engineer ...; and Other Medical En ...

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.