Residential College | false |
Status | 已發表Published |
A Regularized Variable Projection Algorithm for Separable Nonlinear Least-Squares Problems | |
Chen G.-Y.1; Gan M.1; Chen C.L.P.4; Li H.-X.2 | |
2019-02-01 | |
Source Publication | IEEE Transactions on Automatic Control |
ISSN | 0018-9286 |
Volume | 64Issue:2Pages:526-537 |
Abstract | Separable nonlinear least-squares (SNLLS) problems arise frequently in many research fields, such as system identification and machine learning. The variable projection (VP) method is a very powerful tool for solving such problems. In this paper, we consider the regularization of ill-conditioned SNLLS problems based on the VP method. Selecting an appropriate regularization parameter is difficult because of the nonlinear optimization procedure. We propose to determine the regularization parameter using the weighted generalized cross-validation method at every iteration. This makes the original objective function changing during the optimization procedure. To circumvent this problem, we use an inequation to produce a consistent demand of decreasing at successive iterations. The approximation of the Jacobian of the regularized problem is also discussed. The proposed regularized VP algorithm is tested by the parameter estimation problem of several statistical models. Numerical results demonstrate the effectiveness of the proposed algorithm. |
Keyword | Data Fitting Regularization Separable Nonlinear Least Squares (Snlls) Variable Projection (Vp) Weighted Generalized Cross Validation (Wgcv) |
DOI | 10.1109/TAC.2018.2838045 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Automation & Control Systems ; Engineering |
WOS Subject | Automation & Control Systems ; Engineering, Electrical & Electronic |
WOS ID | WOS:000457375100006 |
Scopus ID | 2-s2.0-85047056543 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Gan M. |
Affiliation | 1.Fuzhou University 2.City University of Hong Kong 3.Central South University China 4.Universidade de Macau 5.Institute of Automation Chinese Academy of Sciences 6.Ministry of Education China 7.Dalian Maritime University |
Recommended Citation GB/T 7714 | Chen G.-Y.,Gan M.,Chen C.L.P.,et al. A Regularized Variable Projection Algorithm for Separable Nonlinear Least-Squares Problems[J]. IEEE Transactions on Automatic Control, 2019, 64(2), 526-537. |
APA | Chen G.-Y.., Gan M.., Chen C.L.P.., & Li H.-X. (2019). A Regularized Variable Projection Algorithm for Separable Nonlinear Least-Squares Problems. IEEE Transactions on Automatic Control, 64(2), 526-537. |
MLA | Chen G.-Y.,et al."A Regularized Variable Projection Algorithm for Separable Nonlinear Least-Squares Problems".IEEE Transactions on Automatic Control 64.2(2019):526-537. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment