Search: onr:"swepub:oai:DiVA.org:uu-382400" >
"Why did you do tha...
-
Paçacı, Görkem,1986-Uppsala universitet,Institutionen för informatik och media
(author)
"Why did you do that?" : Explaining black box models with Inductive Synthesis
- Article/chapterEnglish2019
Publisher, publication year, extent ...
-
2019-06-08
-
Cham :Springer Nature,2019
-
electronicrdacarrier
Numbers
-
LIBRIS-ID:oai:DiVA.org:uu-382400
-
https://urn.kb.se/resolve?urn=urn:nbn:se:uu:diva-382400URI
-
https://doi.org/10.1007/978-3-030-22750-0_27DOI
Supplementary language notes
-
Language:English
-
Summary in:English
Part of subdatabase
Classification
-
Subject category:ref swepub-contenttype
-
Subject category:kon swepub-publicationtype
Notes
-
By their nature, the composition of black box models is opaque. This makes the ability to generate explanations for the response to stimuli challenging. The importance of explaining black box models has become increasingly important given the prevalence of AI and ML systems and the need to build legal and regulatory frameworks around them. Such explanations can also increase trust in these uncertain systems. In our paper we present RICE, a method for generating explanations of the behaviour of black box models by (1) probing a model to extract model output examples using sensitivity analysis; (2) applying CNPInduce, a method for inductive logic program synthesis, to generate logic programs based on critical input-output pairs; and (3) interpreting the target program as a human-readable explanation. We demonstrate the application of our method by generating explanations of an artificial neural network trained to follow simple traffic rules in a hypothetical self-driving car simulation. We conclude with a discussion on the scalability and usability of our approach and its potential applications to explanation-critical scenarios.
Subject headings and genre
Added entries (persons, corporate bodies, meetings, titles ...)
-
Johnson, David,1979-Uppsala universitet,Institutionen för informatik och media(Swepub:uu)davjo605
(author)
-
McKeever, Steve,1969-Uppsala universitet,Informationssystem(Swepub:uu)stemc181
(author)
-
Hamfelt, AndreasUppsala universitet,Informationssystem(Swepub:uu)andhamlt
(author)
-
Uppsala universitetInstitutionen för informatik och media
(creator_code:org_t)
Related titles
-
In:International Conference on Computational Science (ICCS)Cham : Springer Nature
Internet link
To the university's database