UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
An Efficient Algorithm for the Incremental Broad Learning System by Inverse Cholesky Factorization of a Partitioned Matrix
Zhu, Hufei1; Liu, Zhulin2; Philip Chen, C. L.2,3; Liang, Yanyang1
2021-01-18
Source PublicationIEEE Access
ISSN2169-3536
Volume9Pages:19294-19303
Abstract

In this paper, we propose an efficient algorithm to accelerate the existing Broad Learning System (BLS) algorithm for new added nodes. The existing BLS algorithm computes the output weights from the pseudoinverse with the ridge regression approximation, and updates the pseudoinverse iteratively. As a comparison, the proposed BLS algorithm computes the output weights from the inverse Cholesky factor of the Hermitian matrix in the calculation of the pseudoinverse, and updates the inverse Cholesky factor efficiently. Since the Hermitian matrix in the definition of the pseudoinverse is smaller than the pseudoinverse, the proposed BLS algorithm can reduce the computational complexity, and usually requires less than \frac {2}{3} of complexities with respect to the existing BLS algorithm. Our experiments on the Modified National Institute of Standards and Technology (MNIST) dataset show that the speedups in accumulative training time and each additional training time of the proposed BLS over the existing BLS are 24.81% 37.99% and 36.45% 58.96%, respectively, and the speedup in total training time is 37.99%. In our experiments, the proposed BLS and the existing BLS both achieve the same testing accuracy when the tiny differences (≤ 0.05%) caused by the numerical errors are neglected, and the above-mentioned tiny differences and numerical errors become zeroes and ignorable, respectively, when the ridge parameter is not too small.

KeywordAdded Nodes Broad Learning System (Bls) Efficient Algorithms Incremental Learning Inverse Cholesky Factorization Partitioned Matrix Pseudoinverse Random Vector Functional-link Neural Networks (Rvflnn) Single Layer Feedforward Neural Networks (Slfn)
DOI10.1109/ACCESS.2021.3052102
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaComputer Science ; Engineering ; Telecommunications
WOS SubjectComputer Science, Information Systems ; Engineering, Electrical & Electronic ; Telecommunications
WOS IDWOS:000619315100001
PublisherIEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC445 HOES LANE, PISCATAWAY, NJ 08855-4141
Scopus ID2-s2.0-85099733091
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionFaculty of Science and Technology
Corresponding AuthorLiu, Zhulin
Affiliation1.Faculty of Intelligent Manufacturing, Wuyi University, Jiangmen, China
2.School of Computer Science and Engineering, South China University of Technology, Guangzhou, China
3.Faculty of Science and Technology, University of Macau, Macao
Recommended Citation
GB/T 7714
Zhu, Hufei,Liu, Zhulin,Philip Chen, C. L.,et al. An Efficient Algorithm for the Incremental Broad Learning System by Inverse Cholesky Factorization of a Partitioned Matrix[J]. IEEE Access, 2021, 9, 19294-19303.
APA Zhu, Hufei., Liu, Zhulin., Philip Chen, C. L.., & Liang, Yanyang (2021). An Efficient Algorithm for the Incremental Broad Learning System by Inverse Cholesky Factorization of a Partitioned Matrix. IEEE Access, 9, 19294-19303.
MLA Zhu, Hufei,et al."An Efficient Algorithm for the Incremental Broad Learning System by Inverse Cholesky Factorization of a Partitioned Matrix".IEEE Access 9(2021):19294-19303.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Zhu, Hufei]'s Articles
[Liu, Zhulin]'s Articles
[Philip Chen, C. L.]'s Articles
Baidu academic
Similar articles in Baidu academic
[Zhu, Hufei]'s Articles
[Liu, Zhulin]'s Articles
[Philip Chen, C. L.]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Zhu, Hufei]'s Articles
[Liu, Zhulin]'s Articles
[Philip Chen, C. L.]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.