Connections Between Optimisation-Based Regressor Selection and Analysis of Variance

• Earlier contributions have shown that Analysis of Variance (ANOVA) can be successfully used for finding good regressors for nonlinear models in a nonlinear black-box system identification context. In this paper, it is shown that the ANOVA problem can be recast as an optimisation problem. Two modified, convex versions of the ANOVA optimisation problem are then proposed, and it turns out that they are closely related to the nn-garrote and wavelet shrinkage methods, respectively. In the case of balanced data, it is also shown that the methods have a nice orthogonality property in the sense that different groups of parameters can be computed independently.

Ämnesord

TEKNIK OCH TEKNOLOGIER  -- Elektroteknik och elektronik -- Reglerteknik (hsv//swe)

ENGINEERING AND TECHNOLOGY  -- Electrical Engineering, Electronic Engineering, Information Engineering -- Control Engineering (hsv//eng)

Nyckelord

ANOVA

1-norm

Lasso

Nn-garrote

Nonlinear identification

Regressor selection

TECHNOLOGY

TEKNIKVETENSKAP

Automatic control

Publikations- och innehållstyp

ref (ämneskategori)

kon (ämneskategori)