Search: onr:"swepub:oai:research.chalmers.se:ee4264e8-cab4-4bf4-a555-ef3c71e7239d" >
Bayesian causal inf...
Bayesian causal inference in automotive software engineering and online evaluation
-
- Liu, Yuchu, 1992 (author)
- Chalmers tekniska högskola,Chalmers University of Technology,Volvo Cars
-
- Issa Mattos, David (author)
- Volvo Cars
-
- Bosch, Jan, 1967 (author)
- Chalmers tekniska högskola,Chalmers University of Technology
-
show more...
-
- Holmström Olsson, Helena (author)
- Malmö universitet,Malmö university
-
- Lantz, Jonn (author)
- Volvo Cars
-
show less...
-
(creator_code:org_t)
- 2022
- 2022
- English.
- Related links:
-
https://doi.org/10.4...
-
show more...
-
https://research.cha...
-
show less...
Abstract
Subject headings
Close
- Randomised field experiments, such as A/B testing, have long been the gold standard for evaluating software changes. In the automotive domain, running randomised field experiments is not always desired, possible, or even ethical. In the face of such restrictions, we show how to utilise observational studies in combination with Bayesian causal inference to understand real-world impacts from complex automotive software updates and help development organisations arrive at causal conclusions. In this study, we present three causal inference models in the Bayesian framework and their corresponding cases to address three commonly experienced challenges of software evaluation in the automotive domain. We apply Bayesian propensity score matching for producing balanced control and treatment groups, Bayesian regression discontinuity for identifying covariate dependent treatment assignments, and Bayesian difference-in-differences for causal inference on treatment effect overtime. We demonstrate the potential of causal inference with our industry collaborators with studies conducted on a fleet of vehicles. The cases are presented in details as well as the related the theory of causal assumption to the practice of running observational studies. Finally, we discuss the potential and pitfalls of the Bayesian causal models.
Subject headings
- NATURVETENSKAP -- Data- och informationsvetenskap -- Programvaruteknik (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Software Engineering (hsv//eng)
- NATURVETENSKAP -- Data- och informationsvetenskap -- Datavetenskap (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Computer Sciences (hsv//eng)
Keyword
- Automotive Software
- Causal Inference
- Online Experimentation
- Software Engineering
- Bayesian Statistics
Publication and Content Type
- art (subject category)
- vet (subject category)
Find in a library
To the university's database