Sökning: id:"swepub:oai:DiVA.org:hj-61450" >
Conformal Predictio...
Conformal Prediction for Accuracy Guarantees in Classification with Reject Option
-
- Johansson, Ulf (författare)
- Jönköping University,Jönköping AI Lab (JAIL),Department of Computing, Jönköping University, Jönköping, Sweden
-
- Löfström, Tuwe, 1977- (författare)
- Jönköping University,Jönköping AI Lab (JAIL),Department of Computing, Jönköping University, Jönköping, Sweden
-
- Sönströd, Cecilia (författare)
- Jönköping University,JTH, Avdelningen för datavetenskap,Department of Computing, Jönköping University, Jönköping, Sweden
-
visa fler...
-
- Löfström, Helena (författare)
- Högskolan i Borås,Jönköping University,Internationella Handelshögskolan,Akademin för bibliotek, information, pedagogik och IT,Jönköping International Business School, Jönköping, Sweden,InnovationLab
-
visa färre...
-
(creator_code:org_t)
- Springer, 2023
- 2023
- Engelska.
-
Ingår i: Modeling Decisions for Artificial Intelligence. - : Springer. - 9783031334979 ; , s. 133-145, s. 133-145
- Relaterad länk:
-
https://urn.kb.se/re...
-
visa fler...
-
https://doi.org/10.1...
-
https://urn.kb.se/re...
-
visa färre...
Abstract
Ämnesord
Stäng
- A standard classifier is forced to predict the label of every test instance, even when confidence in the predictions is very low. In many scenarios, it would, however, be better to avoid making these predictions, maybe leaving them to a human expert. A classifier with that alternative is referred to as a classifier with reject option. In this paper, we propose an algorithm that, for a particular data set, automatically suggests a number of accuracy levels, which it will be able to meet perfectly, using a classifier with reject option. Since the basis of the suggested algorithm is conformal prediction, it comes with strong validity guarantees. The experimentation, using 25 publicly available two-class data sets, confirms that the algorithm obtains empirical accuracies very close to the requested levels. In addition, in an outright comparison with probabilistic predictors, including models calibrated with Platt scaling, the suggested algorithm clearly outperforms the alternatives.
Ämnesord
- NATURVETENSKAP -- Data- och informationsvetenskap -- Systemvetenskap, informationssystem och informatik (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Information Systems (hsv//eng)
- NATURVETENSKAP -- Data- och informationsvetenskap -- Datavetenskap (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Computer Sciences (hsv//eng)
Nyckelord
- Classification (of information)
- Accuracy level
- Conformal predictions
- Data set
- Human expert
- Probabilistics
- Scalings
- Test instances
- Forecasting
Publikations- och innehållstyp
- ref (ämneskategori)
- kon (ämneskategori)
Hitta via bibliotek
Till lärosätets databas