Search: WFRF:(Broman David 1977 ) >
Delayed sampling an...
Delayed sampling and automatic Rao-Blackwellization of probabilistic programs
-
- Murray, Lawrence (author)
- Uppsala universitet,Avdelningen för systemteknik,Reglerteknik,Uppsala University
-
- Lundén, Daniel (author)
- KTH,Programvaruteknik och datorsystem, SCS,KTH Royal Inst Technol, Stockholm, Sweden
-
- Kudlicka, Jan (author)
- Uppsala universitet,Datalogi,Uppsala University
-
show more...
-
- Broman, David, 1977- (author)
- KTH,Programvaruteknik och datorsystem, SCS,KTH Royal Inst Technol, Stockholm, Sweden
-
- Schön, Thomas B., Professor, 1977- (author)
- Uppsala universitet,Avdelningen för systemteknik,Reglerteknik
-
show less...
-
(creator_code:org_t)
- PMLR, 2018
- 2018
- English.
-
In: Proceedings of the 21st International Conference on Artificial Intelligence and Statistics (AISTATS), Lanzarote, Spain, April, 2018. - : PMLR.
- Related links:
-
http://proceedings.m...
-
show more...
-
https://www.aistats....
-
https://kth.diva-por... (primary) (Raw object)
-
https://urn.kb.se/re...
-
https://urn.kb.se/re...
-
show less...
Abstract
Subject headings
Close
- We introduce a dynamic mechanism for the solution of analytically-tractable substructure in probabilistic programs, using conjugate priors and affine transformations to reduce variance in Monte Carlo estimators. For inference with Sequential Monte Carlo, this automatically yields improvements such as locallyoptimal proposals and Rao–Blackwellization. The mechanism maintains a directed graph alongside the running program that evolves dynamically as operations are triggered upon it. Nodes of the graph represent random variables, edges the analytically-tractable relationships between them. Random variables remain in the graph for as long as possible, to be sampled only when they are used by the program in a way that cannot be resolved analytically. In the meantime, they are conditioned on as many observations as possible. We demonstrate the mechanism with a few pedagogical examples, as well as a linearnonlinear state-space model with simulated data, and an epidemiological model with real data of a dengue outbreak in Micronesia. In all cases one or more variables are automatically marginalized out to significantly reduce variance in estimates of the marginal likelihood, in the final case facilitating a randomweight or pseudo-marginal-type importance sampler for parameter estimation. We have implemented the approach in Anglican and a new probabilistic programming language called Birch.
Subject headings
- NATURVETENSKAP -- Matematik -- Sannolikhetsteori och statistik (hsv//swe)
- NATURAL SCIENCES -- Mathematics -- Probability Theory and Statistics (hsv//eng)
- NATURVETENSKAP -- Data- och informationsvetenskap -- Datavetenskap (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Computer Sciences (hsv//eng)
Publication and Content Type
- ref (subject category)
- kon (subject category)
To the university's database