Maximizing the Area under the ROC Curve with Decision Lists and Rule Sets

Boström, HenrikHögskolan i Skövde,Institutionen för kommunikation och information,Forskningscentrum för Informationsteknologi,Högskolan i Skövde, Institutionen för kommunikation och information (author)

QC 20180119
Decision lists (or ordered rule sets) have two attractive properties compared to unordered rule sets: they require a simpler classi¯cation procedure and they allow for a more compact representation. However, it is an open question what effect these properties have on the area under the ROC curve (AUC). Two ways of forming decision lists are considered in this study: by generating a sequence of rules, with a default rule for one of the classes, and by imposing an order upon rules that have been generated for all classes. An empirical investigation shows that the latter method gives a significantly higher AUC than the former, demonstrating that the compactness obtained by using one of the classes as a default is indeed associated with a cost. Furthermore, by using all applicable rules rather than the first in an ordered set, an even further significant improvement in AUC is obtained, demonstrating that the simple classification procedure is also associated with a cost. The observed gains in AUC for unordered rule sets compared to decision lists can be explained by that learning rules for all classes as well as combining multiple rules allow for examples to be ranked according to a more fine-grained scale compared to when applying rules in a fixed order and providing a default rule for one of the classes.

Högskolan i SkövdeInstitutionen för kommunikation och information (creator_code:org_t)

In:Proceedings of the 7th SIAM International Conference on Data Mining: Society for Industrial and Applied Mathematics, s. 27-349780898716306

About the subject

NATURAL SCIENCES: NATURAL SCIENCES; and Computer and Inf ...; and Computer Vision ...

NATURAL SCIENCES: NATURAL SCIENCES; and Mathematics; and Discrete Mathema ...

NATURAL SCIENCES: NATURAL SCIENCES; and Computer and Inf ...; and Computer Science ...

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.