Residential College | false |
Status | 已發表Published |
Linear Regression Problem Relaxations Solved by Nonconvex ADMM with Convergence Analysis | |
Zhang,Hengmin1; Gao,Junbin2; Qian,Jianjun3; Yang,Jian3; Xu,Chunyan3; Zhang,Bob4 | |
2024-02 | |
Source Publication | IEEE Transactions on Circuits and Systems for Video Technology |
ISSN | 1051-8215 |
Volume | 34Issue:2Pages:828 - 838 |
Abstract | In this work, we focus on studying the differentiable relaxations of several linear regression problems, where the original formulations are usually both nonsmooth with one nonconvex term. Unfortunately, in most cases, the standard alternating direction method of multipliers (ADMM) cannot guarantee global convergence when addressing these kinds of problems. To address this issue, by smoothing the convex term and applying a linearization technique before designing the iteration procedures, we employ nonconvex ADMM to optimize challenging nonconvex-convex composite problems. In our theoretical analysis, we prove the boundedness of the generated variable sequence and then guarantee that it converges to a stationary point. Meanwhile, a potential function is derived from the augmented Lagrange function, and we further verify that the objective function is monotonically nonincreasing. Under the Kurdyka-Łojasiewicz (KŁ) property, the global convergence is analyzed step by step. Finally, experiments on face reconstruction, image classification, and subspace clustering tasks are conducted to show the superiority of our algorithms over several state-of-the-art ones. |
Keyword | Convergence Global Convergence Analysis Kurdyka-łojasiewicz (Kł) Property Linear Programming Linear Regression Minimization Nonconvex Admm Nonconvex Composite Problem Nonsmooth Con-vex Function Optimization Sparse Matrices Task Analysis |
DOI | 10.1109/TCSVT.2023.3291821 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Engineering |
WOS Subject | Engineering, Electrical & Electronic |
WOS ID | WOS:001173373700012 |
Publisher | Institute of Electrical and Electronics Engineers Inc. |
Scopus ID | 2-s2.0-85164385558 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Qian,Jianjun; Yang,Jian |
Affiliation | 1.School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 2.Discipline of Business Analytics, The University of Sydney Business School, The University of Sydney, Sydney, NSW, Australia 3.PCA Laboratory, Key Laboratory of Intelligent Perception and Systems for High-Dimensional Information of Ministry of Education, Nanjiang University of Science and Technology, Nanjiang, China 4.Department of Computer and Information Science, Pattern Recognition and Machine Intelligence Research Group, University of Macau, Macau, China |
Recommended Citation GB/T 7714 | Zhang,Hengmin,Gao,Junbin,Qian,Jianjun,et al. Linear Regression Problem Relaxations Solved by Nonconvex ADMM with Convergence Analysis[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2024, 34(2), 828 - 838. |
APA | Zhang,Hengmin., Gao,Junbin., Qian,Jianjun., Yang,Jian., Xu,Chunyan., & Zhang,Bob (2024). Linear Regression Problem Relaxations Solved by Nonconvex ADMM with Convergence Analysis. IEEE Transactions on Circuits and Systems for Video Technology, 34(2), 828 - 838. |
MLA | Zhang,Hengmin,et al."Linear Regression Problem Relaxations Solved by Nonconvex ADMM with Convergence Analysis".IEEE Transactions on Circuits and Systems for Video Technology 34.2(2024):828 - 838. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment