| 11. |
- Abdalmoaty, Mohamed, 1986-, et al.
(författare)
-
Simulated Pseudo Maximum Likelihood Identification of Nonlinear Models
- 2017
-
Ingår i: The 20th IFAC World Congress. - : Elsevier. ; 50:1, s. 14058-14063
-
Konferensbidrag (refereegranskat)abstract
- Nonlinear stochastic parametric models are widely used in various fields. However, for these models, the problem of maximum likelihood identification is very challenging due to the intractability of the likelihood function. Recently, several methods have been developed to approximate the analytically intractable likelihood function and compute either the maximum likelihood or a Bayesian estimator. These methods, albeit asymptotically optimal, are computationally expensive. In this contribution, we present a simulation-based pseudo likelihood estimator for nonlinear stochastic models. It relies only on the first two moments of the model, which are easy to approximate using Monte-Carlo simulations on the model. The resulting estimator is consistent and asymptotically normal. We show that the pseudo maximum likelihood estimator, based on a multivariate normal family, solves a prediction error minimization problem using a parameterized norm and an implicit linear predictor. In the light of this interpretation, we compare with the predictor defined by an ensemble Kalman filter. Although not identical, simulations indicate a close relationship. The performance of the simulated pseudo maximum likelihood method is illustrated in three examples. They include a challenging state-space model of dimension 100 with one output and 2 unknown parameters, as well as an application-motivated model with 5 states, 2 outputs and 5 unknown parameters.
|
|
| 12. |
- Abdalmoaty, Mohamed, 1986-, et al.
(författare)
-
The Gaussian MLE versus the Optimally weighted LSE
- 2020
-
Ingår i: IEEE signal processing magazine (Print). - : Institute of Electrical and Electronics Engineers (IEEE). - 1053-5888 .- 1558-0792. ; 37:6, s. 195-199
-
Tidskriftsartikel (refereegranskat)abstract
- In this note, we derive and compare the asymptotic covariance matrices of two parametric estimators: the Gaussian Maximum Likelihood Estimator (MLE), and the optimally weighted Least-Squares Estimator (LSE). We assume a general model parameterization where the model's mean and variance are jointly parameterized, and consider Gaussian and non-Gaussian data distributions.
|
|
| 13. |
- Agüero, Juan C., et al.
(författare)
-
Accuracy of linear multiple-input multiple-output (MIMO) models obtained by maximum likelihood estimation
- 2012
-
Ingår i: Automatica. - : Elsevier BV. - 0005-1098 .- 1873-2836. ; 48:4, s. 632-637
-
Tidskriftsartikel (refereegranskat)abstract
- In this paper, we study the accuracy of linear multiple-input multiple-output (MIMO) models obtained by maximum likelihood estimation. We present a frequency-domain representation for the information matrix for general linear MIMO models. We show that the variance of estimated parametric models for linear MIMO systems satisfies a fundamental integral trade-off. This trade-off is expressed as a multivariable 'water-bed' effect. An extension to spectral estimation is also discussed.
|
|
| 14. |
|
|
| 15. |
- Akcay, H., et al.
(författare)
-
On the choice of norms in system identification
- 1996
-
Ingår i: IEEE Transactions on Automatic Control. - Linköping : Institute of Electrical and Electronics Engineers (IEEE). - 0018-9286. ; 41:9, s. 1367-1372
-
Tidskriftsartikel (refereegranskat)abstract
- In this paper we discuss smooth and sensitive norms for prediction error system identification when the disturbances are magnitude bounded. Formal conditions for sensitive norms, which give an order of magnitude faster convergence of the parameter estimate variance, are developed. However, it also is shown that the parameter estimate variance convergence rate of sensitive norms is arbitrarily bad for certain distributions. A necessary condition for a norm to be statistically robust with respect to the family F(C) of distributions with support [-C, C] for some arbitrary C > 0 is that its second derivative does not vanish on the support. A direct consequence of this observation is that the quadratic norm is statistically robust among all ℓp-norms, p ≀ 2 < ∞ for F(C). ©1996 IEEE.
|
|
| 16. |
- Akçay, Hüseyin, et al.
(författare)
-
On the Choice of Norms in System Identification
- 1994
-
Ingår i: Proceedings of the 10th IFAC Symposium on System Identification. - Linköping : Linköping University. - 9780080422251 ; , s. 103-108
-
Rapport (övrigt vetenskapligt/konstnärligt)abstract
- In this paper we discuss smooth and sensitive norms for prediction error system identification when the disturbances are magnitude bounded. Formal conditions for sensitive norms, which give an order of magnitude faster convergence of the parameter estimate variance, are developed. However, it also is shown that the parameter estimate variance convergence rate of sensitive norms is arbitrarily bad for certain distributions. A necessary condition for a norm to be statistically robust with respect to the family F(C) of distributions with support [-C, C] for some arbitrary C>0 is that its second derivative does not vanish on the support. A direct consequence of this observation is that the quadratic norm is statistically robust among all lp-norms, p⩽2<∞ for F(C).
|
|
| 17. |
|
|
| 18. |
- Akçay, Hüseyin, et al.
(författare)
-
The Least-Squares Identification of FIR Systems Subject to Worst-Case Noise
- 1993
-
Rapport (övrigt vetenskapligt/konstnärligt)abstract
- The least-squares identification of FIR systems is analyzed assuming that the noise is a bounded signal and the input signal is a pseudo-random binary sequence. A lower bound on the worst-case transfer function error shows that the lest-square estimate of the transfer function diverges as the order of the FIR system is increased. This implies that, in the presence of the worst-case noise, the trade-off between the estimation error due to the disturbance and the bias error (due to unmodeled dynamics) is significantly different from the corresponding trade-off in the random error case: with a worst-case formulation, the model complexity should not increase indefinitely as the size of the data set increases.
|
|
| 19. |
- Akçay, Hüseyin, et al.
(författare)
-
The Least-Squares Identification of FIR Systems Subject to Worst-Case Noise
- 1994
-
Ingår i: Proceedings of the 10th IFAC Symposium on System Identification. - Linköping : Linköping University. - 9780080422251 ; 23:5, s. 329-338
-
Rapport (övrigt vetenskapligt/konstnärligt)abstract
- The least-squares identification of FIR systems is analyzed assuming that the noise is a bounded signal and the input signal is a pseudo-random binary sequence. A lower bound on the worst-case transfer function error shows that the least-square estimate of the transfer function diverges as the order of the FIR system is increased. This implies that, in the presence of the worst-case noise, the trade-off between the estimation error due to the disturbance and the bias error (due to unmodeled dynamics) is significantly different from the corresponding trade-off in the random error case: with a worst-case formulation, the model complexity should not increase indefinitely as the size of the data set increases.
|
|
| 20. |
- Alberer, Daniel, et al.
(författare)
-
System Identification for Automotive Systems : Opportunities and Challenges
- 2012
-
Ingår i: Identification for automotive systems. - London : Springer Nature. ; , s. 1-
-
Konferensbidrag (refereegranskat)abstract
- Without control many essential targets of the automotive industry could not be achieved. As control relies directly or indirectly on models and model quality directly influences the control performance, especially in feed-forward structures as widely used in the automotive world, good models are needed. Good first principle models would be the first choice, and their determination is frequently difficult or even impossible. Against this background methods and tools developed by the system identification community could be used to obtain fast and reliably models, but a large gap seems to exist: neither these methods are sufficiently well known in the automotive community, nor enough attention is paid by the system identification community to the needs of the automotive industry. This introduction summarizes the state of the art and highlights possible critical issues for a future cooperation as they arose from an ACCM Workshop on Identification for Automotive Systems recently held in Linz, Austria.
|
|
