Fibers of Failure: Classifying Errors in Predictive Processes

Fibers of Failure : Classifying Errors in Predictive Processes

QC 20200818
Predictive models are used in many different fields of science and engineering and are always prone to make faulty predictions. These faulty predictions can be more or less malignant depending on the model application. We describe fibers of failure (FIFA), a method to classify failure modes of predictive processes. Our method uses MAPPER, an algorithm from topological data analysis (TDA), to build a graphical model of input data stratified by prediction errors. We demonstrate two ways to use the failure mode groupings: either to produce a correction layer that adjusts predictions by similarity to the failure modes; or to inspect members of the failure modes to illustrate and investigate what characterizes each failure mode. We demonstrate FIFA on two scenarios: a convolutional neural network (CNN) predicting MNIST images with added noise, and an artificial neural network (ANN) predicting the electrical energy consumption of an electric arc furnace (EAF). The correction layer on the CNN model improved its prediction accuracy significantly while the inspection of failure modes for the EAF model provided guiding insights into the domain-specific reasons behind several high-error regions.

Vejdemo-Johansson, MikaelCUNY Coll Staten Isl, Dept Math, 2800 Victory Blvd, Staten Isl, NY 10314 USA.;CUNY, Comp Sci, Grad Ctr, 365 5th Ave, New York, NY 10016 USA. (author)
Carlsson, GunnarStanford Univ, Dept Math, 450 Serra Mall, Stanford, CA 94305 USA.;Unbox AI, Stanford, CA 94305 USA. (author)
Jönsson, Pär G.KTH,Materialvetenskap(Swepub:kth)u118w09b (author)
KTHMaterialvetenskap (creator_code:org_t)

By the author/editor: Carlsson, Leo S.; Vejdemo-Johansso ...; Carlsson, Gunnar; Jönsson, Pär G.

About the subject

NATURAL SCIENCES: NATURAL SCIENCES; and Computer and Inf ...; and Computer Science ...

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.