Different ways of evaluating a Swedish grammar checker

QC 20111114
Three different ways of evaluating a Swedish grammar checker are presented and discussed in this article. The first evaluationconcerns measuring the program's detection capacity on five text genres. The measures (precision and recall) are often used inevaluating grammar checkers. However, in order to test and improve the usability of grammar checking software, they need to becomplemented with user-oriented methods. Consequently, the second and the third evaluations presented in the article both involveusers. The second evaluation focuses on user reactions to grammar error presentations, especially with regard to false alarms anderroneous error identification. The third and last evaluation focuses on problems in supporting users' cognitive revision processes. Italso examines user motives behind choosing to correct or not to correct problems highlighted by the program. Advantages anddisadvantages of the different evaluation methods are discussed.

Knutsson, OlaKTH,Numerisk analys och datalogi, NADA(Swepub:kth)u1def5ji (författare)
Severinson Eklundh, KerstinKTH,Numerisk analys och datalogi, NADA(Swepub:kth)u10nawam (författare)
KTHNumerisk analys och datalogi, NADA (creator_code:org_t)

Ingår i:Proceedings of the third international conference on language resources and evaluation (LREC), s. 262-267

Av författaren/redakt...: Domeij, Rickard; Knutsson, Ola; Severinson Eklun ...

Om ämnet

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.