| 1. |
- Abdalmoaty, Mohamed, 1986-, et al.
(författare)
-
Identification of Stochastic Nonlinear Models Using Optimal Estimating Functions
- 2020
-
Ingår i: Automatica. - : Elsevier. - 0005-1098 .- 1873-2836. ; 119
-
Tidskriftsartikel (refereegranskat)abstract
- The first part of the paper examines the asymptotic properties of linear prediction error method estimators, which were recently suggested for the identification of nonlinear stochastic dynamical models. It is shown that their accuracy depends not only on the shape of the unknown distribution of the data, but also on how the model is parameterized. Therefore, it is not obvious in general which linear prediction error method should be preferred. In the second part, the estimating functions approach is introduced and used to construct estimators that are asymptotically optimal with respect to a specific class of estimators. These estimators rely on a partial probabilistic parametric models, and therefore neither require the computations of the likelihood function nor any marginalization integrals. The convergence and consistency of the proposed estimators are established under standard regularity and identifiability assumptions akin to those of prediction error methods. The paper is concluded by several numerical simulation examples.
|
|
| 2. |
- Abdalmoaty, Mohamed, 1986-, et al.
(författare)
-
Linear Prediction Error Methods for Stochastic Nonlinear Models
- 2019
-
Ingår i: Automatica. - : Elsevier. - 0005-1098 .- 1873-2836. ; 105, s. 49-63
-
Tidskriftsartikel (refereegranskat)abstract
- The estimation problem for stochastic parametric nonlinear dynamical models is recognized to be challenging. The main difficulty is the intractability of the likelihood function and the optimal one-step ahead predictor. In this paper, we present relatively simple prediction error methods based on non-stationary predictors that are linear in the outputs. They can be seen as extensions of the linear identification methods for the case where the hypothesized model is stochastic and nonlinear. The resulting estimators are defined by analytically tractable objective functions in several common cases. It is shown that, under certain identifiability and standard regularity conditions, the estimators are consistent and asymptotically normal. We discuss the relationship between the suggested estimators and those based on second-order equivalent models as well as the maximum likelihood method. The paper is concluded with a numerical simulation example as well as a real-data benchmark problem.
|
|
| 3. |
- Abdalmoaty, Mohamed R., 1986-, et al.
(författare)
-
Application of a Linear PEM Estimator to a Stochastic Wiener-Hammerstein Benchmark Problem⁎
- 2018
-
Ingår i: IFAC-PapersOnLine. - : Elsevier B.V.. - 2405-8963. ; 51:15, s. 784-789
-
Tidskriftsartikel (refereegranskat)abstract
- The estimation problem of stochastic Wiener-Hammerstein models is recognized to be challenging, mainly due to the analytical intractability of the likelihood function. In this contribution, we apply a computationally attractive prediction error method estimator to a real-data stochastic Wiener-Hammerstein benchmark problem. The estimator is defined using a deterministic predictor that is nonlinear in the input. The prediction error method results in tractable expressions, and Monte Carlo approximations are not necessary. This allows us to tackle several issues considered challenging from the perspective of the current mainstream approach. Under mild conditions, the estimator can be shown to be consistent and asymptotically normal. The results of the method applied to the benchmark data are presented and discussed.
|
|
| 4. |
- Abdalmoaty, Mohamed Rasheed, 1986-, et al.
(författare)
-
Consistent Estimators of Stochastic MIMO Wiener Models based on Suboptimal Predictors
- 2018
-
Ingår i: 2018 IEEE Conference on Decision and Control (CDC). - : IEEE. - 9781538613955 - 9781538613948 - 9781538613962 ; , s. 3842-3847
-
Konferensbidrag (refereegranskat)abstract
- We consider a parameter estimation problem in a general class of stochastic multiple-inputs multiple-outputs Wiener models, where the likelihood function is, in general, analytically intractable. When the output signal is a scalar independent stochastic process, the likelihood function of the parameters is given by a product of scalar integrals. In this case, numerical integration may be efficiently used to approximately solve the maximum likelihood problem. Otherwise, the likelihood function is given by a challenging multidimensional integral. In this contribution, we argue that by ignoring the temporal and spatial dependence of the stochastic disturbances, a computationally attractive estimator based on a suboptimal predictor can be constructed by evaluating scalar integrals regardless of the number of outputs. Under some conditions, the convergence of the resulting estimators can be established and consistency is achieved under certain identifiability hypothesis. We highlight the relationship between the resulting estimators and a recently proposed prediction error method estimator. We also remark that the method can be used for a wider class of stochastic nonlinear models. The performance of the method is demonstrated by a numerical simulation example using a 2-inputs 2-outputs model with 9 parameters.
|
|
| 5. |
- Abdalmoaty, Mohamed R. H., 1986-, et al.
(författare)
-
Identification of Non-Linear Differential-Algebraic Equation Models with Process Disturbances
- 2021
-
Ingår i: 2021 60th IEEE Conference on Decision and Control (CDC). - : IEEE. - 9781665436595 - 9781665436588 - 9781665436601 ; , s. 2300-2305
-
Konferensbidrag (refereegranskat)abstract
- Differential-algebraic equations (DAEs) arise naturally as a result of equation-based object-oriented modeling. In many cases, these models contain unknown parameters that have to be estimated using experimental data. However, often the system is subject to unknown disturbances which, if not taken into account in the estimation, can severely affect the model's accuracy. For non-linear state-space models, particle filter methods have been developed to tackle this issue. Unfortunately, applying such methods to non-linear DAEs requires a transformation into a state-space form, which is particularly difficult to obtain for models with process disturbances. In this paper, we propose a simulation-based prediction error method that can be used for non-linear DAEs where disturbances are modeled as continuous-time stochastic processes. To the authors' best knowledge, there are no general methods successfully dealing with parameter estimation for this type of model. One of the challenges in particle filtering methods are random variations in the minimized cost function due to the nature of the algorithm. In our approach, a similar phenomenon occurs and we explicitly consider how to sample the underlying continuous process to mitigate this problem. The method is illustrated numerically on a pendulum example. The results suggest that the method is able to deliver consistent estimates.
|
|
| 6. |
- Abdalmoaty, Mohamed R., 1986-, et al.
(författare)
-
Identification of a Class of Nonlinear Dynamical Networks⁎
- 2018
-
Ingår i: IFAC-PapersOnLine. - : Elsevier B.V.. - 2405-8963. ; 51:15, s. 868-873
-
Tidskriftsartikel (refereegranskat)abstract
- Identification of dynamic networks has attracted considerable interest recently. So far the main focus has been on linear time-invariant networks. Meanwhile, most real-life systems exhibit nonlinear behaviors; consider, for example, two stochastic linear time-invariant systems connected in series, each of which has a nonlinearity at its output. The estimation problem in this case is recognized to be challenging, due to the analytical intractability of both the likelihood function and the optimal one-step ahead predictors of the measured nodes. In this contribution, we introduce a relatively simple prediction error method that may be used for the estimation of nonlinear dynamical networks. The estimator is defined using a deterministic predictor that is nonlinear in the known signals. The estimation problem can be defined using closed-form analytical expressions in several non-trivial cases, and Monte Carlo approximations are not necessarily required. We show, that this is the case for some block-oriented networks with no feedback loops and where all the nonlinear modules are polynomials. Consequently, the proposed method can be applied in situations considered challenging by current approaches. The performance of the estimation method is illustrated on a numerical simulation example.
|
|
| 7. |
- Abdalmoaty, Mohamed, 1986-, et al.
(författare)
-
Simulated Pseudo Maximum Likelihood Identification of Nonlinear Models
- 2017
-
Ingår i: The 20th IFAC World Congress. - : Elsevier. ; 50:1, s. 14058-14063
-
Konferensbidrag (refereegranskat)abstract
- Nonlinear stochastic parametric models are widely used in various fields. However, for these models, the problem of maximum likelihood identification is very challenging due to the intractability of the likelihood function. Recently, several methods have been developed to approximate the analytically intractable likelihood function and compute either the maximum likelihood or a Bayesian estimator. These methods, albeit asymptotically optimal, are computationally expensive. In this contribution, we present a simulation-based pseudo likelihood estimator for nonlinear stochastic models. It relies only on the first two moments of the model, which are easy to approximate using Monte-Carlo simulations on the model. The resulting estimator is consistent and asymptotically normal. We show that the pseudo maximum likelihood estimator, based on a multivariate normal family, solves a prediction error minimization problem using a parameterized norm and an implicit linear predictor. In the light of this interpretation, we compare with the predictor defined by an ensemble Kalman filter. Although not identical, simulations indicate a close relationship. The performance of the simulated pseudo maximum likelihood method is illustrated in three examples. They include a challenging state-space model of dimension 100 with one output and 2 unknown parameters, as well as an application-motivated model with 5 states, 2 outputs and 5 unknown parameters.
|
|
| 8. |
- Abdalmoaty, Mohamed, 1986-, et al.
(författare)
-
The Gaussian MLE versus the Optimally weighted LSE
- 2020
-
Ingår i: IEEE signal processing magazine (Print). - : Institute of Electrical and Electronics Engineers (IEEE). - 1053-5888 .- 1558-0792. ; 37:6, s. 195-199
-
Tidskriftsartikel (refereegranskat)abstract
- In this note, we derive and compare the asymptotic covariance matrices of two parametric estimators: the Gaussian Maximum Likelihood Estimator (MLE), and the optimally weighted Least-Squares Estimator (LSE). We assume a general model parameterization where the model's mean and variance are jointly parameterized, and consider Gaussian and non-Gaussian data distributions.
|
|
| 9. |
- Agüero, Juan C., et al.
(författare)
-
Accuracy of linear multiple-input multiple-output (MIMO) models obtained by maximum likelihood estimation
- 2012
-
Ingår i: Automatica. - : Elsevier BV. - 0005-1098 .- 1873-2836. ; 48:4, s. 632-637
-
Tidskriftsartikel (refereegranskat)abstract
- In this paper, we study the accuracy of linear multiple-input multiple-output (MIMO) models obtained by maximum likelihood estimation. We present a frequency-domain representation for the information matrix for general linear MIMO models. We show that the variance of estimated parametric models for linear MIMO systems satisfies a fundamental integral trade-off. This trade-off is expressed as a multivariable 'water-bed' effect. An extension to spectral estimation is also discussed.
|
|
| 10. |
|
|
| 11. |
- Akcay, H., et al.
(författare)
-
On the choice of norms in system identification
- 1996
-
Ingår i: IEEE Transactions on Automatic Control. - Linköping : Institute of Electrical and Electronics Engineers (IEEE). - 0018-9286. ; 41:9, s. 1367-1372
-
Tidskriftsartikel (refereegranskat)abstract
- In this paper we discuss smooth and sensitive norms for prediction error system identification when the disturbances are magnitude bounded. Formal conditions for sensitive norms, which give an order of magnitude faster convergence of the parameter estimate variance, are developed. However, it also is shown that the parameter estimate variance convergence rate of sensitive norms is arbitrarily bad for certain distributions. A necessary condition for a norm to be statistically robust with respect to the family F(C) of distributions with support [-C, C] for some arbitrary C > 0 is that its second derivative does not vanish on the support. A direct consequence of this observation is that the quadratic norm is statistically robust among all ℓp-norms, p ≀ 2 < ∞ for F(C). ©1996 IEEE.
|
|
| 12. |
|
|
| 13. |
- Alberer, Daniel, et al.
(författare)
-
System Identification for Automotive Systems : Opportunities and Challenges
- 2012
-
Ingår i: Identification for automotive systems. - London : Springer Nature. ; , s. 1-
-
Konferensbidrag (refereegranskat)abstract
- Without control many essential targets of the automotive industry could not be achieved. As control relies directly or indirectly on models and model quality directly influences the control performance, especially in feed-forward structures as widely used in the automotive world, good models are needed. Good first principle models would be the first choice, and their determination is frequently difficult or even impossible. Against this background methods and tools developed by the system identification community could be used to obtain fast and reliably models, but a large gap seems to exist: neither these methods are sufficiently well known in the automotive community, nor enough attention is paid by the system identification community to the needs of the automotive industry. This introduction summarizes the state of the art and highlights possible critical issues for a future cooperation as they arose from an ACCM Workshop on Identification for Automotive Systems recently held in Linz, Austria.
|
|
| 14. |
- Andersson, Malin, et al.
(författare)
-
Informative battery charging : integrating fast charging and optimal experiments
- 2023
-
Konferensbidrag (refereegranskat)abstract
- This paper presents informative battery charging, a novel approach for battery model parameter estimation during fast charge. Our solution comprises three distinct contributions: first, we develop a semi-explicit solution to an optimal fast charging problem for equivalent circuit models with health-conscious voltage constraints; second, we design optimal experiments for battery model parameter estimation; and third, we suggest a strategy for how the fast charging and experimentation currents can be combined while still satisfying constraints and maintaining acceptable charging times. Numerical results show that model parameters can be identified with lower variance if an optimal experiment is added to the charging procedure.
|
|
| 15. |
|
|
| 16. |
- Auvert, Marine, et al.
(författare)
-
On Router Control for Congestion Avoidance
- 2002
-
Konferensbidrag (refereegranskat)abstract
- This short paper deals with active queue management for computer networks. The goal is to develop control mechanisms for routers in heterogeneous networks that reduce traffic fluctuations. The proposed control strategy operates with local information (such as estimated arrival rates) and actively use the buffers to smooth traffic, and thus it avoids the buildup and propagation of traffic bursts.
|
|
| 17. |
- Barenthin, Märta, et al.
(författare)
-
Applications of mixed H2 and H∞ input design in identification
- 2005
-
Konferensbidrag (refereegranskat)abstract
- The objective of this contribution is to quantify benefits of optimal input design compared to the use of standard identification input signals, e.g. PRBS signals for some common, and important, application areas of system identification. Two benchmark problems taken from process control and control of flexible mechanical structures are considered. We present results both when the design is based on knowledge of the true system (in general the optimal design depends on the system itself) and for a practical two step procedure when an initial model estimate is used in the design instead of the true system. The results show that there is a substantial reduction in experiment time and input excitation level. A discussion on the sensitivity of the optimal input design to model estimates is provided.
|
|
| 18. |
- Barenthin, Märta, et al.
(författare)
-
Gain estimation for Hammerstein systems
- 2006
-
Ingår i: IFAC Proceedings Volumes (IFAC-PapersOnline). ; , s. 784-789
-
Konferensbidrag (refereegranskat)abstract
- In this paper, we discuss and compare three different approaches for L2- gain estimation of Hammerstein systems. The objective is to find the input signal that maximizes the gain. A fundamental difference between two of the approaches is the class, or structure, of the input signals. The first approach involves describing functions and therefore the class of input signals is sinusoids. In this case we assume that we have a model of the system and we search for the amplitude and frequency that give the largest gain. In the second approach, no structure on the input signal is assumed in advance and the system does not have to be modelled first. The maximizing input is found using an iterative procedure called power iterations. In the last approach, a new iterative procedure tailored for memoryless nonlinearities is used to find the maximizing input for the unmodelled nonlinear part of the Hammerstein system. The approaches are illustrated by numerical examples.
|
|
| 19. |
- Barenthin, Märta, et al.
(författare)
-
Identification and control: Joint input design and H-infinity state feedback with ellipsoidal parametric uncertainty via LMIs
- 2008
-
Ingår i: Automatica. - : Elsevier BV. - 0005-1098 .- 1873-2836. ; 44:2, s. 543-551
-
Tidskriftsartikel (refereegranskat)abstract
- One obstacle in connecting robust control with models generated from prediction error identification is that very few control design methods are able to directly cope with the ellipsoidal parametric uncertainty regions that are generated by such identification methods. In this contribution we present a joint robust state feedback control/input design procedure which guarantees stability and prescribed closed-loop performance using models identified from experimental data. This means that given H-infinity specifications on the closed-loop transfer function are translated into sufficient requirements on the input signal spectrum used to identify the process. The condition takes the form of a linear matrix inequality.
|
|
| 20. |
- Barenthin, Märta, et al.
(författare)
-
Identification for control of multivariable systems: Controller validation and experiment design via LMIs
- 2008
-
Ingår i: Automatica. - : Elsevier BV. - 0005-1098 .- 1873-2836. ; 44:12, s. 3070-3078
-
Tidskriftsartikel (refereegranskat)abstract
- This paper presents a new controller validation method for linear multivariable time-invariant models. Classical prediction error system identification methods deliver uncertainty regions which are nonstandard in the robust control literature. Our controller validation criterion computes an upper bound for the worst case performance, measured in terms of the H-infinity-norm of a weighted closed loop transfer matrix, achieved by a given controller over all plants in such uncertainty sets. This upper bound on the worst case performance is computed via an LMI-based optimization problem and is deduced via the separation of graph framework. Our main technical contribution is to derive, within that framework, a very general parametrization for the set of multipliers corresponding to the nonstandard uncertainty regions resulting from PE identification of MIMO systems. The proposed approach also allows for iterative experiment design. The results of this paper are asymptotic in the data length and it is assumed that the model structure is flexible enough to capture the true system.
|
|
| 21. |
- Barenthin, Märta, et al.
(författare)
-
Mixed H-2 and H-Infinity$ Input Design for Multivariable Systems
- 2006
-
Ingår i: 14th IFAC Symposium on System Identification. ; , s. 1335-1340
-
Konferensbidrag (refereegranskat)abstract
- In this contribution a new procedure for input design for identification of linear multivariable systems is proposed. The goal is to minimize the input power used in the system identification experiment. The quality constraint on the estimated model is formulated in H∞. The input design problem is converted to linear matrix inequalities by a separation of graphs theorem. For illustration, the proposed method is applied on a chemical distillation column and the result shows that it is optimal to amplify the low gain direction of the plant.
|
|
| 22. |
- Barenthin, Märta, et al.
(författare)
-
Validation of stability for an induction machine drive using power iterations
- 2005
-
Ingår i: Proceedings of the 16th IFAC World Congress, 2005. - Prague. - 9783902661753 ; , s. 892-897
-
Konferensbidrag (refereegranskat)abstract
- This work is an extension of the paper (Mosskull et al., 2003), in which the modelling, identification and stability of an nonlinear induction machine drive is studied. The validation of the stability margins of the system is refined by an improved estimate of the induced L2 loop gain of the system. This is done with a procedure called power iterations where input sequences suitable for estimating the gain are generated iteratively through experiments on the system. The power iterations result in higher gain estimates compared to the experiments previously presented. This implies that more accurate estimates are obtained as, in general, only lower bounds can be obtained as estimates for the gain. The new gain estimates are well below one, which suggests that the feedback system is stable. The experiments are performed on an industrial hardware/software simulation platform. in this paper we also discuss the power iterations from a more general point of view. The usefulness of the method for gain estimation of nonlinear systems is illustrated through simulation examples. The basic principles of the method are provided.
|
|
| 23. |
- Bereza-Jarocinski, Robert, et al.
(författare)
-
Stochastic Approximation for Identification of Non-Linear Differential-Algebraic Equations with Process Disturbances
- 2022
-
Ingår i: 2022 IEEE 61ST CONFERENCE ON DECISION AND CONTROL (CDC). - : Institute of Electrical and Electronics Engineers (IEEE). - 9781665467612 - 9781665467605 - 9781665467629 ; , s. 6712-6717
-
Konferensbidrag (refereegranskat)abstract
- Differential-algebraic equations, commonly used to model physical systems, are the basis for many equation-based object-oriented modeling languages. When systems described by such equations are influenced by unknown process disturbances, estimating unknown parameters from experimental data becomes difficult. This is because of problems with the existence of well-defined solutions and the computational tractability of estimators. In this paper, we propose a way to minimize a cost function-whose minimizer is a consistent estimator of the true parameters-using stochastic gradient descent. This approach scales significantly better with the number of unknown parameters than other currently available methods for the same type of problem. The performance of the method is demonstrated through a simulation study with three unknown parameters. The experiments show a significantly reduced variance of the estimator, compared to an output error method neglecting the influence of process disturbances, as well as an ability to reduce the estimation bias of parameters that the output error method particularly struggles with.
|
|
| 24. |
- Bombois, Xavier, et al.
(författare)
-
Identification for robust H-2 deconvolution filtering
- 2010
-
Ingår i: Automatica. - : Elsevier BV. - 0005-1098 .- 1873-2836. ; 46:3, s. 577-584
-
Tidskriftsartikel (refereegranskat)abstract
- This paper addresses robust deconvolution filtering when the system and noise dynamics are obtained by parametric system identification. Consistent with standard identification methods, the uncertainty in the estimated parameters is represented by an ellipsoidal uncertainty region. Three problems are considered: (1) computation of the worst case H-2 performance of a given deconvolution filter in this uncertainty set; (2) design of a filter which minimizes the worst case H-2 performance in this uncertainty set; (3) input design for the identification experiment, subject to a limited input power budget, such that the filter in (2) gives the smallest possible worst case H-2 performance. It is shown that there are convex relaxations of the optimization problems corresponding to (1) and (2) while the third problem can be treated via iterating between two convex optimization problems.
|
|
| 25. |
- Bombois, X., et al.
(författare)
-
Network topology detection via uncertainty analysis of an identified static model
- 2021
-
Ingår i: IFAC PAPERSONLINE. - : Elsevier BV. - 2405-8963. ; , s. 595-600
-
Konferensbidrag (refereegranskat)abstract
- In this paper, we propose a methodology to detect the topology of a dynamic network that is based on the analysis of the uncertainty of the static characteristic of the matrix of transfer functions between the external excitations and the node signals.
|
|
