Particle Metropolis-Hastings using gradient and Hessian information

Dahlin, Johan,1986-Linköpings universitet,Reglerteknik,Tekniska högskolan (author)

On the day of the defence date the status of this article was Manuscript.
Particle Metropolis-Hastings (PMH) allows for Bayesian parameter inference in nonlinear state space models by combining MCMC and particle filtering. The latter is used to estimate the intractable likelihood. In its original formulation, PMH makes use of a marginal MCMC proposal for the parameters, typically a Gaussian random walk. However, this can lead to a poor exploration of the parameter space and an inefficient use of the generated particles.We propose two alternative versions of PMH that incorporate gradient and Hessian information about the posterior into the proposal. This information is more or less obtained as a byproduct of the likelihood estimation. Indeed, we show how to estimate the required information using a fixed-lag particle smoother, with a computational cost growing linearly in the number of particles. We conclude that the proposed methods can: (i) decrease the length of the burn-in phase, (ii) increase the mixing of the Markov chain at the stationary phase, and (iii) make the proposal distribution scale invariant which simplifies tuning.

Lindsten, FredrikLinköpings universitet,Reglerteknik,Tekniska högskolan(Swepub:liu)freli29 (author)
Schön, Thomas,1977-Uppsala universitet,Avdelningen för systemteknik,Reglerteknik,Dept. of Information Technology, Uppsala University, Uppsala, Sweden(Swepub:uu)thosc112 (author)
Linköpings universitetReglerteknik (creator_code:org_t)

By the author/editor: Dahlin, Johan, 1 ...; Lindsten, Fredri ...; Schön, Thomas, 1 ...

About the subject

ENGINEERING AND TECHNOLOGY: ENGINEERING AND ...; and Electrical Engin ...; and Control Engineer ...

ENGINEERING AND TECHNOLOGY: ENGINEERING AND ...; and Electrical Engin ...; and Signal Processin ...

NATURAL SCIENCES: NATURAL SCIENCES; and Mathematics; and Probability Theo ...

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.