onr:"swepub:oai:DiVA.org:kth-5394"
Search: onr:"swepub:oai:DiVA.org:kth-5394" > Estimation and Comp...
- 1 of 1
- Previous record
- Next record
- To hitlist
Estimation and Comparison of CAD System Performance in Clinical Settings
-
- Bornefalk, Hans (author)
- KTH,Fysik
- (creator_code:org_t)
- Elsevier BV, 2005
- 2005
- English.
- In: Academic Radiology. - : Elsevier BV. - 1076-6332 .- 1878-4046. ; 12:6, s. 687-694
- Journal article (peer-reviewed)
Abstract
Subject headings
Close
- Rationale and Objectives. Computer-aided detection (CAD) systems are frequently compared using free-response receiver operating characteristic (FROC) curves. While there are ample statistical methods for comparing FROC curves, when one is interested in comparing the outcomes of 2 CAD systems applied in a typical clinical setting, there is the additional matter of correctly determining the system operating point. This article shows how the effect of the sampling error on determining the correct CAD operating point can be captured. By incorporating this uncertainty, a method is presented that allows estimation of the probability with which a particular CAD system performs better than another on unseen data in a clinical setting. Materials and Methods. The distribution of possible clinical outcomes from 2 artificial CAD systems with different FROC curves is examined. The sampling error is captured by the distribution of possible system thresholds of the classifying machine that yields a specified sensitivity. After introducing a measure of superiority, the probability of one system being superior to the other can be determined. Results. It is shown that for 2 typical mammography CAD systems, each trained on independent representative datasets of 100 cases, the FROC curves must be separated by 0.20 false positives per image in order to conclude that there is a 90% probability that one is better than the other in a clinical setting. Also, there is no apparent gain in increasing the size of the training set beyond 100 cases. Discussion. CAD systems for mammography are modeled for illustrative purposes, but the method presented is applicable to any computer-aided detection system evaluated with FROC curves. The presented method is designed to construct confidence intervals around possible clinical outcomes and to assess the importance of training set size and separation between FROC curves of systems trained on different datasets.
Keyword
- CAD; performance evaluation; sampling error; confidence interval; mammography; operating point estimation
- NATURAL SCIENCES
- NATURVETENSKAP
Publication and Content Type
- ref (subject category)
- art (subject category)
Find in a library
- Academic Radiology (Search for host publication in LIBRIS)
To the university's database
- 1 of 1
- Previous record
- Next record
- To hitlist
Find more in SwePub
- By the author/editor
- Bornefalk, Hans
- Articles in the publication
- Academic Radiolo ...
- By the university
- Royal Institute of Technology
Search outside SwePub
- Extend your search to:
- Google Book Search
- Google Scholar
Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.
- Copyright © LIBRIS - National Library Systems
- LIBRIS.kb.se
