Residential Collegefalse
Status已發表Published
Linear Regression Problem Relaxations Solved by Nonconvex ADMM with Convergence Analysis
Zhang,Hengmin1; Gao,Junbin2; Qian,Jianjun3; Yang,Jian3; Xu,Chunyan3; Zhang,Bob4
2024-02
Source PublicationIEEE Transactions on Circuits and Systems for Video Technology
ISSN1051-8215
Volume34Issue:2Pages:828 - 838
Abstract

In this work, we focus on studying the differentiable relaxations of several linear regression problems, where the original formulations are usually both nonsmooth with one nonconvex term. Unfortunately, in most cases, the standard alternating direction method of multipliers (ADMM) cannot guarantee global convergence when addressing these kinds of problems. To address this issue, by smoothing the convex term and applying a linearization technique before designing the iteration procedures, we employ nonconvex ADMM to optimize challenging nonconvex-convex composite problems. In our theoretical analysis, we prove the boundedness of the generated variable sequence and then guarantee that it converges to a stationary point. Meanwhile, a potential function is derived from the augmented Lagrange function, and we further verify that the objective function is monotonically nonincreasing. Under the Kurdyka-Łojasiewicz (KŁ) property, the global convergence is analyzed step by step. Finally, experiments on face reconstruction, image classification, and subspace clustering tasks are conducted to show the superiority of our algorithms over several state-of-the-art ones.

KeywordConvergence Global Convergence Analysis Kurdyka-łojasiewicz (Kł) Property Linear Programming Linear Regression Minimization Nonconvex Admm Nonconvex Composite Problem Nonsmooth Con-vex Function Optimization Sparse Matrices Task Analysis
DOI10.1109/TCSVT.2023.3291821
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaEngineering
WOS SubjectEngineering, Electrical & Electronic
WOS IDWOS:001173373700012
PublisherInstitute of Electrical and Electronics Engineers Inc.
Scopus ID2-s2.0-85164385558
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionDEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding AuthorQian,Jianjun; Yang,Jian
Affiliation1.School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore
2.Discipline of Business Analytics, The University of Sydney Business School, The University of Sydney, Sydney, NSW, Australia
3.PCA Laboratory, Key Laboratory of Intelligent Perception and Systems for High-Dimensional Information of Ministry of Education, Nanjiang University of Science and Technology, Nanjiang, China
4.Department of Computer and Information Science, Pattern Recognition and Machine Intelligence Research Group, University of Macau, Macau, China
Recommended Citation
GB/T 7714
Zhang,Hengmin,Gao,Junbin,Qian,Jianjun,et al. Linear Regression Problem Relaxations Solved by Nonconvex ADMM with Convergence Analysis[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2024, 34(2), 828 - 838.
APA Zhang,Hengmin., Gao,Junbin., Qian,Jianjun., Yang,Jian., Xu,Chunyan., & Zhang,Bob (2024). Linear Regression Problem Relaxations Solved by Nonconvex ADMM with Convergence Analysis. IEEE Transactions on Circuits and Systems for Video Technology, 34(2), 828 - 838.
MLA Zhang,Hengmin,et al."Linear Regression Problem Relaxations Solved by Nonconvex ADMM with Convergence Analysis".IEEE Transactions on Circuits and Systems for Video Technology 34.2(2024):828 - 838.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Zhang,Hengmin]'s Articles
[Gao,Junbin]'s Articles
[Qian,Jianjun]'s Articles
Baidu academic
Similar articles in Baidu academic
[Zhang,Hengmin]'s Articles
[Gao,Junbin]'s Articles
[Qian,Jianjun]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Zhang,Hengmin]'s Articles
[Gao,Junbin]'s Articles
[Qian,Jianjun]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.