DeepBayes—An estimator for parameter estimation in stochastic nonlinear dynamical models

QC 20231129
Stochastic nonlinear dynamical systems are ubiquitous in modern, real-world applications. Yet, estimating the unknown parameters of stochastic, nonlinear dynamical models remains a challenging problem. The majority of existing methods employ maximum likelihood or Bayesian estimation. However, these methods suffer from some limitations, most notably the substantial computational time for inference coupled with limited flexibility in application. In this work, we propose DeepBayes estimators that leverage the power of deep recurrent neural networks. The method consists of first training a recurrent neural network to minimize the mean-squared estimation error over a set of synthetically generated data using models drawn from the model set of interest. The a priori trained estimator can then be used directly for inference by evaluating the network with the estimation data. The deep recurrent neural network architectures can be trained offline and ensure significant time savings during inference. We experiment with two popular recurrent neural networks — long short term memory network (LSTM) and gated recurrent unit (GRU). We demonstrate the applicability of our proposed method on different example models and perform detailed comparisons with state-of-the-art approaches. We also provide a study on a real-world nonlinear benchmark problem. The experimental evaluations show that the proposed approach is asymptotically as good as the Bayes estimator.

Abdalmoaty, MohamedAutomatic Control Laboratory and NCCR Automation, ETH Zürich, Switzerland (author)
Chatterjee, SaikatKTH,Teknisk informationsvetenskap(Swepub:kth)u178avxi (author)
Hjalmarsson, Håkan,1962-KTH,Reglerteknik,Centre for Advanced BioProduction by Continuous Processing, AdBIOPRO(Swepub:kth)u10a8l40 (author)
KTHTeknisk informationsvetenskap (creator_code:org_t)

By the author/editor: Ghosh, Anubhab; Abdalmoaty, Moha ...; Chatterjee, Saik ...; Hjalmarsson, Håk ...

About the subject

ENGINEERING AND TECHNOLOGY: ENGINEERING AND ...; and Electrical Engin ...; and Control Engineer ...

ENGINEERING AND TECHNOLOGY: ENGINEERING AND ...; and Electrical Engin ...; and Other Electrical ...

NATURAL SCIENCES: NATURAL SCIENCES; and Mathematics; and Probability Theo ...

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.