Residential Collegefalse
Status已發表Published
Structured residual sparsity for video compressive sensing reconstruction
Zha, Zhiyuan1; Wen, Bihan2; Yuan, Xin3; Zhang, Jiachao4; Zhou, Jiantao5; Zhu, Ce6
2024-09-01
Source PublicationSignal Processing
ISSN0165-1684
Volume222Pages:109513
Abstract

Recent advancements in the residual sparsity strategy have garnered widespread attention in video compressive sensing (CS) reconstruction. However, most of the existing residual sparsity-based video CS reconstruction methods usually suffer from some limitations that lead to undesired visual artifacts. Firstly, these methods only rely on a patch sparsity scheme that is limited by their focus on the local structures of each video frame, neglecting the nonlocal self-similarity (NSS) property inherent to each video frame. Secondly, these methods concentrate on utilizing the NSS property of external reference frames for multi-hypothesis (MH) prediction while disregarding the internal NSS property of the current frame. In this paper, we propose a new structured residual sparsity (SRS) approach for video CS reconstruction, which jointly exploits the NSS properties of the current frame and its reference frames. Specifically, due to the unavailability of the original video frames, we first devise an effective intraframe CS (EICS) reconstruction method that leverages the internal NSS property of each frame. This approach enables us to obtain initial recovery frames, which then facilitate the execution of MH prediction. Following this, we generate a residual frame for the current frame by employing the MH prediction. Then, we propose a novel SRS model jointly using the NSS properties of the current frame and its reference frames to explore both the correlations of intraframe and interframe for reconstructing the current frame. Furthermore, for the sake of optimization feasibility, we develop an effective alternating direction method of multipliers (ADMM) algorithm to address the objective. Our experimental findings reveal that the proposed SRS not only yields superior quantitative results, but also uncovers finer details and causes fewer visual artifacts compared to many popular or state-of-the-art video CS reconstruction approaches.

KeywordVideo Cs Reconstruction Structured Residual Sparsity Nonlocal Self-similarity Multi-hypothesis Prediction Admm
DOI10.1016/j.sigpro.2024.109513
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaEngineering
WOS SubjectEngineering, Electrical & Electronic
WOS IDWOS:001235374600001
PublisherELSEVIERRADARWEG 29, 1043 NX AMSTERDAM, NETHERLANDS
Scopus ID2-s2.0-85191309253
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionTHE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU)
Faculty of Science and Technology
DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding AuthorZha, Zhiyuan
Affiliation1.College of Communication Engineering, Jilin University, Changchun, 130012, China
2.School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore, 639798, China
3.School of Engineering, Westlake University, Hangzhou, Zhejiang, 310024, China
4.Artificial Intelligence Institute of Industrial Technology, Nanjing Institute of Technology, Nanjing, 211167, China
5.The State Key Laboratory of Internet of Things for Smart City, and Department of Computer and Information Science, University of Macau, 999078, Macao Special Administrative Region of China
6.School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu, 611731, China
Recommended Citation
GB/T 7714
Zha, Zhiyuan,Wen, Bihan,Yuan, Xin,et al. Structured residual sparsity for video compressive sensing reconstruction[J]. Signal Processing, 2024, 222, 109513.
APA Zha, Zhiyuan., Wen, Bihan., Yuan, Xin., Zhang, Jiachao., Zhou, Jiantao., & Zhu, Ce (2024). Structured residual sparsity for video compressive sensing reconstruction. Signal Processing, 222, 109513.
MLA Zha, Zhiyuan,et al."Structured residual sparsity for video compressive sensing reconstruction".Signal Processing 222(2024):109513.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Zha, Zhiyuan]'s Articles
[Wen, Bihan]'s Articles
[Yuan, Xin]'s Articles
Baidu academic
Similar articles in Baidu academic
[Zha, Zhiyuan]'s Articles
[Wen, Bihan]'s Articles
[Yuan, Xin]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Zha, Zhiyuan]'s Articles
[Wen, Bihan]'s Articles
[Yuan, Xin]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.