Residential College | false |
Status | 已發表Published |
Online Identification of Nonlinear Systems With Separable Structure | |
Chen, Guang Yong1; Gan, Min1; Chen, Long2; Chen, C. L.P.3 | |
2022-11-03 | |
Source Publication | IEEE Transactions on Neural Networks and Learning Systems |
ISSN | 2162-237X |
Volume | 35Issue:6Pages:8695-8701 |
Abstract | Separable nonlinear models (SNLMs) are of great importance in system modeling, signal processing, and machine learning because of their flexible structure and excellent description of nonlinear behaviors. The online identification of such models is quite challenging, and previous related work usually ignores the special structure where the estimated parameters can be partitioned into a linear and a nonlinear part. In this brief, we propose an efficient first-order recursive algorithm for SNLMs by introducing the variable projection (VP) step. The proposed algorithm utilizes the recursive least-squares method to eliminate the linear parameters, resulting in a reduced function. Then, the stochastic gradient descent (SGD) algorithm is employed to update the parameters of the reduced function. By considering the tight coupling relationship between linear parameters and nonlinear parameters, the proposed first-order VP algorithm is more efficient and robust than the traditional SGD algorithm and alternating optimization algorithm. More importantly, since the proposed algorithm just uses the first-order information, it is easier to apply it to large-scale models. Numerical results on examples of different sizes confirm the effectiveness and efficiency of the proposed algorithm. |
Keyword | Feedforward Neural Networks (Fnns) Separable Nonlinear Models (Snlms) Stochastic Gradient Descent (Sgd) Method Variable Projection (Vp) Method |
DOI | 10.1109/TNNLS.2022.3215756 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Computer Science ; Engineering |
WOS Subject | Computer Science, Artificial Intelligence ; Computer Science, Hardware & Architecture ; Computer Science, Theory & Methods ; Engineering, Electrical & Electronic |
WOS ID | WOS:001252651500102 |
Publisher | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 445 HOES LANE, PISCATAWAY, NJ 08855-4141 |
Scopus ID | 2-s2.0-85141642094 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | Faculty of Science and Technology |
Corresponding Author | Chen, C. L.P. |
Affiliation | 1.College of Computer and Data Science, Fuzhou University, Fuzhou, China 2.University of Macau, Faculty of Science and Technology, Macau, Macau 3.College of Computer Science and Technology, Qingdao University, Qingdao, China |
Recommended Citation GB/T 7714 | Chen, Guang Yong,Gan, Min,Chen, Long,et al. Online Identification of Nonlinear Systems With Separable Structure[J]. IEEE Transactions on Neural Networks and Learning Systems, 2022, 35(6), 8695-8701. |
APA | Chen, Guang Yong., Gan, Min., Chen, Long., & Chen, C. L.P. (2022). Online Identification of Nonlinear Systems With Separable Structure. IEEE Transactions on Neural Networks and Learning Systems, 35(6), 8695-8701. |
MLA | Chen, Guang Yong,et al."Online Identification of Nonlinear Systems With Separable Structure".IEEE Transactions on Neural Networks and Learning Systems 35.6(2022):8695-8701. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment