Sökning: onr:"swepub:oai:DiVA.org:kth-311779" >
Data driven modelin...
Data driven modeling in the presence of time series structure: : Improved bounds and effective algorithms
-
- Mazhar, Othmane, Ph.D. student, 1990- (författare)
- KTH,Matematisk statistik,Reglerteknik
-
- Djehiche, Boualem, 1962- (preses)
- KTH,Matematisk statistik,Matematik
-
- Dahleh, Munther, Professor (opponent)
- MIT, Boston
-
(creator_code:org_t)
- ISBN 9789180402101
- Stockholm, Sweden : Kungliga Tekniska högskolan, 2022
- Engelska 229 s.
-
Serie: TRITA-SCI-FOU ; 2022;12
- Relaterad länk:
-
https://kth.diva-por... (primary) (Raw object)
-
visa fler...
-
https://urn.kb.se/re...
-
visa färre...
Abstract
Ämnesord
Stäng
- This thesis consists of five appended papers devoted to modeling tasks where the desired models are learned from data sets with an underlying time series structure. We develop a statistical methodology for providing efficient estimators and analyzing their non-asymptotic behavior. We further suggest novel algorithmic design techniques for obtaining practical procedures to compute these estimators. Specifically, we study time series models of increasing levels of difficulty. In the first paper, we study change point and clustering systems where the dynamic structure of the time series is entirely encoded in the combinatorial properties of the estimated parameters. We then investigate in the second paper Finite Input Response (FIR) models, which exhibit a time-shifted random design. The obtained results are then generalized in the third paper to linear Hidden Markov models since they are infinite impulse response models with a particular polynomial structure. Finally, in the fourth and fifth papers, we investigate linear time-invariant (LTI) state-space models where the covariates generated along the path of the system are not just dependent but also dependent on the estimated parameter. Hence, the spectral properties of this estimated parameter affect the estimation performance. Throughout this journey, we develop a statistical methodology for deriving statistically efficient estimators. This statistical methodology relays on the idea that efficient estimators should strike a compromise between a signal term and a noise term. The signal term is intimately related to the spectral properties of the design matrix, and the noise term is intimately associated with the covariates multiplication process. To quantify both of these terms and obtain upper bounds for the estimation errors, we develop new concentration and deviation inequalities based on chaining integrals and self-normalized martingale inequalities. We also obtain lower bounds for the estimation errors by extending the Cramér-Rao inequality to a biased estimator and alow-rank Fisher information and provide an information geometric construction of carefully chosen priors on sets of matrices to obtain a van Tree inequality describing the minimax rate for the estimation problem. Finally, on the algorithmic side, we design efficient estimation procedures based on dynamic programming, penalized least squares, and the Ho-Kalman algorithm to take into account the data’s time series structure.
Ämnesord
- NATURVETENSKAP -- Matematik -- Sannolikhetsteori och statistik (hsv//swe)
- NATURAL SCIENCES -- Mathematics -- Probability Theory and Statistics (hsv//eng)
Nyckelord
- Time series
- Non-asymptotic estimation
- Minimax
- Change point detection
- Hidden Markov model
- State space model
- Least square
- Penalized Regression
- Random covariance matrix
- Concentration inequality
- Chaining integral
- Self-normalized martingale inequality
- Cramér-Rao inequality
- van Trees inequality
- Matematisk statistik
- Mathematical Statistics
Publikations- och innehållstyp
- vet (ämneskategori)
- dok (ämneskategori)
Hitta via bibliotek
Till lärosätets databas