UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
Accelerated PALM for Nonconvex Low-rank Matrix Recovery with Theoretical Analysis
Zhang, Hengmin1; Wen, Bihan1; Zha, Zhiyuan1; Zhang, Bob2; Tang, Yang3; Yu, Guo4; Du, Wenli3
2024-04
Source PublicationIEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY
ISSN1051-8215
Volume34Issue:4Pages:2304-2317
Abstract

Low-rank matrix recovery is a major challenge in machine learning and computer vision, particularly for large-scale data matrices, as popular methods involving nuclear norm and singular value decomposition (SVD) are associated with high computational costs and biased estimators. To overcome this challenge, we propose a novel approach to learning low-rank matrices based on the matrix volume and a nonconvex logarithmic function. The matrix volume is the product of all the nonzero singular values of a matrix and has unique geometric properties and connections with other convex and nonconvex functions. We establish a generalized nonconvex regularization problem using the penalty function strategy and introduce an accelerated proximal alternating linearized minimization (AccPALM) algorithm with double acceleration, which combines Nesterov’s acceleration and power strategy. The algorithm reduces computational costs and has provable convergence results under the Kurdyka-Łojasiewicz (KŁ) inequality with mild conditions. Our approach shows superior accuracy, efficiency, and convergence behavior compared to other low-rank matrix learning methods on robust matrix completion (RMC) and low-rank representation (LRR) tasks. We analyze the impact of algorithm parameters on convergence and performance and present visually appealing results to further demonstrate the effectiveness of our approach. The proposed methodology represents a promising advance in the field of low-rank matrix recovery, and its effectiveness has been validated via extensive numerical experiments. The source code for the proposed algorithms is accessible at https://github.com/ZhangHengMin/AccPALMcodes.

KeywordNonconvex Rank Relaxations Matrix Volume Proximal Alternating Linearized Minimization Robust Matrix Completion Low-rank Representation
DOI10.1109/TCSVT.2023.3306811
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaEngineering
WOS SubjectEngineering, Electrical & Electronic
WOS IDWOS:001197960500074
PublisherIEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 445 HOES LANE, PISCATAWAY, NJ 08855-4141
Scopus ID2-s2.0-85168703044
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionFaculty of Science and Technology
DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding AuthorWen, Bihan
Affiliation1.School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore
2.Department of Computer and Information Science, Faculty of Science and Technology, PAMI Research Group, University of Macau, Macau, P.R. China
3.Ministry of Education, School of Information Science and Engineering, Key Laboratory of Smart Manufacturing in Energy Chemical Process, East China University of Science and Technology, Shanghai, P.R. China
4.Institute of Intelligent Manufacturing, Nanjing Tech University, Nanjing, China
Recommended Citation
GB/T 7714
Zhang, Hengmin,Wen, Bihan,Zha, Zhiyuan,et al. Accelerated PALM for Nonconvex Low-rank Matrix Recovery with Theoretical Analysis[J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34(4), 2304-2317.
APA Zhang, Hengmin., Wen, Bihan., Zha, Zhiyuan., Zhang, Bob., Tang, Yang., Yu, Guo., & Du, Wenli (2024). Accelerated PALM for Nonconvex Low-rank Matrix Recovery with Theoretical Analysis. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 34(4), 2304-2317.
MLA Zhang, Hengmin,et al."Accelerated PALM for Nonconvex Low-rank Matrix Recovery with Theoretical Analysis".IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY 34.4(2024):2304-2317.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Zhang, Hengmin]'s Articles
[Wen, Bihan]'s Articles
[Zha, Zhiyuan]'s Articles
Baidu academic
Similar articles in Baidu academic
[Zhang, Hengmin]'s Articles
[Wen, Bihan]'s Articles
[Zha, Zhiyuan]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Zhang, Hengmin]'s Articles
[Wen, Bihan]'s Articles
[Zha, Zhiyuan]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.