Residential College | false |
Status | 已發表Published |
Accelerated PALM for Nonconvex Low-rank Matrix Recovery with Theoretical Analysis | |
Zhang, Hengmin1; Wen, Bihan1; Zha, Zhiyuan1; Zhang, Bob2; Tang, Yang3; Yu, Guo4; Du, Wenli3 | |
2024-04 | |
Source Publication | IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY |
ISSN | 1051-8215 |
Volume | 34Issue:4Pages:2304-2317 |
Abstract | Low-rank matrix recovery is a major challenge in machine learning and computer vision, particularly for large-scale data matrices, as popular methods involving nuclear norm and singular value decomposition (SVD) are associated with high computational costs and biased estimators. To overcome this challenge, we propose a novel approach to learning low-rank matrices based on the matrix volume and a nonconvex logarithmic function. The matrix volume is the product of all the nonzero singular values of a matrix and has unique geometric properties and connections with other convex and nonconvex functions. We establish a generalized nonconvex regularization problem using the penalty function strategy and introduce an accelerated proximal alternating linearized minimization (AccPALM) algorithm with double acceleration, which combines Nesterov’s acceleration and power strategy. The algorithm reduces computational costs and has provable convergence results under the Kurdyka-Łojasiewicz (KŁ) inequality with mild conditions. Our approach shows superior accuracy, efficiency, and convergence behavior compared to other low-rank matrix learning methods on robust matrix completion (RMC) and low-rank representation (LRR) tasks. We analyze the impact of algorithm parameters on convergence and performance and present visually appealing results to further demonstrate the effectiveness of our approach. The proposed methodology represents a promising advance in the field of low-rank matrix recovery, and its effectiveness has been validated via extensive numerical experiments. The source code for the proposed algorithms is accessible at https://github.com/ZhangHengMin/AccPALMcodes. |
Keyword | Nonconvex Rank Relaxations Matrix Volume Proximal Alternating Linearized Minimization Robust Matrix Completion Low-rank Representation |
DOI | 10.1109/TCSVT.2023.3306811 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Engineering |
WOS Subject | Engineering, Electrical & Electronic |
WOS ID | WOS:001197960500074 |
Publisher | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 445 HOES LANE, PISCATAWAY, NJ 08855-4141 |
Scopus ID | 2-s2.0-85168703044 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | Faculty of Science and Technology DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Wen, Bihan |
Affiliation | 1.School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 2.Department of Computer and Information Science, Faculty of Science and Technology, PAMI Research Group, University of Macau, Macau, P.R. China 3.Ministry of Education, School of Information Science and Engineering, Key Laboratory of Smart Manufacturing in Energy Chemical Process, East China University of Science and Technology, Shanghai, P.R. China 4.Institute of Intelligent Manufacturing, Nanjing Tech University, Nanjing, China |
Recommended Citation GB/T 7714 | Zhang, Hengmin,Wen, Bihan,Zha, Zhiyuan,et al. Accelerated PALM for Nonconvex Low-rank Matrix Recovery with Theoretical Analysis[J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34(4), 2304-2317. |
APA | Zhang, Hengmin., Wen, Bihan., Zha, Zhiyuan., Zhang, Bob., Tang, Yang., Yu, Guo., & Du, Wenli (2024). Accelerated PALM for Nonconvex Low-rank Matrix Recovery with Theoretical Analysis. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 34(4), 2304-2317. |
MLA | Zhang, Hengmin,et al."Accelerated PALM for Nonconvex Low-rank Matrix Recovery with Theoretical Analysis".IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY 34.4(2024):2304-2317. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment