id:"swepub:oai:DiVA.org:uu-418997"
Search: id:"swepub:oai:DiVA.org:uu-418997" > Uncovering hidden r...
- 1 of 1
- Previous record
- Next record
- To hitlist
- Koriakina, Nadezhda,1991-Uppsala universitet,Avdelningen för visuell information och interaktion,Bildanalys och människa-datorinteraktion,Methods for Image Data Analysis (MIDA) (author)
Uncovering hidden reasoning of convolutional neural networks in biomedical image classification by using attribution methods
- Article/chapterEnglish2020
Publisher, publication year, extent ...
- 2020
- printrdacarrier
Numbers
- LIBRIS-ID:oai:DiVA.org:uu-418997
- https://urn.kb.se/resolve?urn=urn:nbn:se:uu:diva-418997URI
Supplementary language notes
- Language:English
- Summary in:English
Part of subdatabase
- SwePubSwePub
Classification
Notes
- Convolutional neural networks (CNNs) are very popular in biomedical image processing and analysis, due to their impressive performance on numerous tasks. However, the performance comes at a cost of limited interpretability, which may harm users' trust in methods and their results. Robust and trustworthy methods are particularly in demand in the medical domain due to the sensitivity of the matter. There is a limited understanding of what CNNs base their decisions on, and, in particular, how their performance is related to what they are paying attention to. In this study, we utilize popular attribution methods, with the aim to explore relations between properties of a network's attention and its accuracy and certainty in classification. An intuitive reasoning is that in order for a network to make good decisions, it has to be consistent in what to draw attention to. We take a step towards understanding CNNs' behavior by identifying a relation between the model performance and the variability of its attention map.We observe two biomedical datasets and two commonly used architectures. We train several identical models of the same architecture on the given data; these identical models differ due to stochasticity of initialization and training. We analyse the variability of the predictions from such collections of networks where we observe all the network instances and their classifications independently. We utilize Gradient-weighted Class Activation Mapping (Grad-CAM) and Layer-wise Relevance Propagation (LRP), frequently employed attribution methods, for the activation analysis. Given a collection of trained CNNs, we compute, for each image of the test set: (i) the mean and standard deviation (SD) of the accuracy, over the networks in the collection; (ii) the mean and SD of the respective attention maps. We plot these measures against each other for the different combinations of network architectures and datasets, in order to expose possible relations between them.Our results reveal that there exists a relation between the variability of accuracy for collections of identical models and the variability of corresponding attention maps and that this relation is consistent among the considered combinations of datasets and architectures. We observe that the aggregated standard deviation of attention maps has a quadratic relation to the average accuracy of the sets of models and a linear relation to the standard deviation of accuracy. Motivated by the results, we are also performing subsequent experiments to reveal the relation between the score and attention, as well as to understand the impact of different images to the prediction by using mentioned statistics for each image and clustering techniques. These constitute important steps towards improved explainability and a generally clearer picture of the decision-making process of CNNs for biomedical data.
Subject headings and genre
- TEKNIK OCH TEKNOLOGIER Medicinteknik Medicinsk bildbehandling hsv//swe
- ENGINEERING AND TECHNOLOGY Medical Engineering Medical Image Processing hsv//eng
- NATURVETENSKAP Data- och informationsvetenskap Annan data- och informationsvetenskap hsv//swe
- NATURAL SCIENCES Computer and Information Sciences Other Computer and Information Science hsv//eng
- Oral cancer
- attribution methods
- deep convolutional neural networks
- Artificiell intelligens
- Artificial Intelligence
- Computerized Image Processing
- Datoriserad bildbehandling
Added entries (persons, corporate bodies, meetings, titles ...)
- Sladoje, NatasaUppsala universitet,Avdelningen för visuell information och interaktion,Bildanalys och människa-datorinteraktion,Methods for Image Data Analysis (MIDA)(Swepub:uu)namat934 (author)
- Wetzer, ElisabethUppsala universitet,Avdelningen för visuell information och interaktion,Bildanalys och människa-datorinteraktion,Methods for Image Data Analysis (MIDA)(Swepub:uu)eliwe323 (author)
- Lindblad, JoakimUppsala universitet,Bildanalys och människa-datorinteraktion,Avdelningen för visuell information och interaktion,Methods for Image Data Analysis (MIDA)(Swepub:uu)joali534 (author)
- Uppsala universitetAvdelningen för visuell information och interaktion (creator_code:org_t)
Related titles
- In:4th NEUBIAS Conference, Bordeaux, France
Internet link
To the university's database
- 1 of 1
- Previous record
- Next record
- To hitlist
Find more in SwePub
- By the author/editor
- Koriakina, Nadez ...
- Sladoje, Natasa
- Wetzer, Elisabet ...
- Lindblad, Joakim
- About the subject
-
- ENGINEERING AND TECHNOLOGY
- ENGINEERING AND ...
- and Medical Engineer ...
- and Medical Image Pr ...
-
- NATURAL SCIENCES
- NATURAL SCIENCES
- and Computer and Inf ...
- and Other Computer a ...
- Articles in the publication
- 4th NEUBIAS Conf ...
- By the university
- Uppsala University
Search outside SwePub
- Extend your search to:
- Google Book Search
- Google Scholar
Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.
- Copyright © LIBRIS - National Library Systems
- LIBRIS.kb.se
