Search: onr:"swepub:oai:DiVA.org:kth-218100" >
Learning Stochastic...
Learning Stochastic Nonlinear Dynamical Systems Using Non-stationary Linear Predictors
-
- Abdalmoaty, Mohamed, 1986- (author)
- KTH,Reglerteknik,System Identification,KTH, Reglerteknik
-
- Hjalmarsson, Håkan, Professor (thesis advisor)
- KTH,Reglerteknik,KTH, Reglerteknik
-
- Olsson, Jimmy, Associate Professor (opponent)
- KTH,Matematisk statistik,KTH, Matematisk statistik
-
(creator_code:org_t)
- ISBN 9789177296249
- Stockholm, Sweden : KTH Royal Institute of Technology, 2017
- English 186 s.
-
Series: TRITA-EE, 1653-5146 ; 2017:172
- Related links:
-
https://kth.diva-por... (primary) (Raw object)
-
show more...
-
http://urn.kb.se/res...
-
https://urn.kb.se/re...
-
https://urn.kb.se/re...
-
show less...
Abstract
Subject headings
Close
- The estimation problem of stochastic nonlinear parametric models is recognized to be very challenging due to the intractability of the likelihood function. Recently, several methods have been developed to approximate the maximum likelihood estimator and the optimal mean-square error predictor using Monte Carlo methods. Albeit asymptotically optimal, these methods come with several computational challenges and fundamental limitations.The contributions of this thesis can be divided into two main parts. In the first part, approximate solutions to the maximum likelihood problem are explored. Both analytical and numerical approaches, based on the expectation-maximization algorithm and the quasi-Newton algorithm, are considered. While analytic approximations are difficult to analyze, asymptotic guarantees can be established for methods based on Monte Carlo approximations. Yet, Monte Carlo methods come with their own computational difficulties; sampling in high-dimensional spaces requires an efficient proposal distribution to reduce the number of required samples to a reasonable value.In the second part, relatively simple prediction error method estimators are proposed. They are based on non-stationary one-step ahead predictors which are linear in the observed outputs, but are nonlinear in the (assumed known) input. These predictors rely only on the first two moments of the model and the computation of the likelihood function is not required. Consequently, the resulting estimators are defined via analytically tractable objective functions in several relevant cases. It is shown that, under mild assumptions, the estimators are consistent and asymptotically normal. In cases where the first two moments are analytically intractable due to the complexity of the model, it is possible to resort to vanilla Monte Carlo approximations. Several numerical examples demonstrate a good performance of the suggested estimators in several cases that are usually considered challenging.
Subject headings
- TEKNIK OCH TEKNOLOGIER -- Elektroteknik och elektronik -- Reglerteknik (hsv//swe)
- ENGINEERING AND TECHNOLOGY -- Electrical Engineering, Electronic Engineering, Information Engineering -- Control Engineering (hsv//eng)
- TEKNIK OCH TEKNOLOGIER -- Elektroteknik och elektronik -- Signalbehandling (hsv//swe)
- ENGINEERING AND TECHNOLOGY -- Electrical Engineering, Electronic Engineering, Information Engineering -- Signal Processing (hsv//eng)
- TEKNIK OCH TEKNOLOGIER -- Elektroteknik och elektronik -- Annan elektroteknik och elektronik (hsv//swe)
- ENGINEERING AND TECHNOLOGY -- Electrical Engineering, Electronic Engineering, Information Engineering -- Other Electrical Engineering, Electronic Engineering, Information Engineering (hsv//eng)
- NATURVETENSKAP -- Matematik -- Sannolikhetsteori och statistik (hsv//swe)
- NATURAL SCIENCES -- Mathematics -- Probability Theory and Statistics (hsv//eng)
Keyword
- Stochastic Nonlinear Systems
- Nonlinear System Identification
- Learning Dynamical Models
- Maximum Likelihood
- Estimation
- Process Disturbance
- Prediction Error Method
- Non-stationary Linear Predictors
- Intractable Likelihood
- Latent Variable Models
- Electrical Engineering
- Elektro- och systemteknik
Publication and Content Type
- vet (subject category)
- lic (subject category)
Find in a library
To the university's database