Residential College | false |
Status | 已發表Published |
Structured residual sparsity for video compressive sensing reconstruction | |
Zha, Zhiyuan1; Wen, Bihan2; Yuan, Xin3; Zhang, Jiachao4; Zhou, Jiantao5; Zhu, Ce6 | |
2024-09-01 | |
Source Publication | Signal Processing |
ISSN | 0165-1684 |
Volume | 222Pages:109513 |
Abstract | Recent advancements in the residual sparsity strategy have garnered widespread attention in video compressive sensing (CS) reconstruction. However, most of the existing residual sparsity-based video CS reconstruction methods usually suffer from some limitations that lead to undesired visual artifacts. Firstly, these methods only rely on a patch sparsity scheme that is limited by their focus on the local structures of each video frame, neglecting the nonlocal self-similarity (NSS) property inherent to each video frame. Secondly, these methods concentrate on utilizing the NSS property of external reference frames for multi-hypothesis (MH) prediction while disregarding the internal NSS property of the current frame. In this paper, we propose a new structured residual sparsity (SRS) approach for video CS reconstruction, which jointly exploits the NSS properties of the current frame and its reference frames. Specifically, due to the unavailability of the original video frames, we first devise an effective intraframe CS (EICS) reconstruction method that leverages the internal NSS property of each frame. This approach enables us to obtain initial recovery frames, which then facilitate the execution of MH prediction. Following this, we generate a residual frame for the current frame by employing the MH prediction. Then, we propose a novel SRS model jointly using the NSS properties of the current frame and its reference frames to explore both the correlations of intraframe and interframe for reconstructing the current frame. Furthermore, for the sake of optimization feasibility, we develop an effective alternating direction method of multipliers (ADMM) algorithm to address the objective. Our experimental findings reveal that the proposed SRS not only yields superior quantitative results, but also uncovers finer details and causes fewer visual artifacts compared to many popular or state-of-the-art video CS reconstruction approaches. |
Keyword | Video Cs Reconstruction Structured Residual Sparsity Nonlocal Self-similarity Multi-hypothesis Prediction Admm |
DOI | 10.1016/j.sigpro.2024.109513 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Engineering |
WOS Subject | Engineering, Electrical & Electronic |
WOS ID | WOS:001235374600001 |
Publisher | ELSEVIERRADARWEG 29, 1043 NX AMSTERDAM, NETHERLANDS |
Scopus ID | 2-s2.0-85191309253 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | THE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU) Faculty of Science and Technology DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Zha, Zhiyuan |
Affiliation | 1.College of Communication Engineering, Jilin University, Changchun, 130012, China 2.School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore, 639798, China 3.School of Engineering, Westlake University, Hangzhou, Zhejiang, 310024, China 4.Artificial Intelligence Institute of Industrial Technology, Nanjing Institute of Technology, Nanjing, 211167, China 5.The State Key Laboratory of Internet of Things for Smart City, and Department of Computer and Information Science, University of Macau, 999078, Macao Special Administrative Region of China 6.School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu, 611731, China |
Recommended Citation GB/T 7714 | Zha, Zhiyuan,Wen, Bihan,Yuan, Xin,et al. Structured residual sparsity for video compressive sensing reconstruction[J]. Signal Processing, 2024, 222, 109513. |
APA | Zha, Zhiyuan., Wen, Bihan., Yuan, Xin., Zhang, Jiachao., Zhou, Jiantao., & Zhu, Ce (2024). Structured residual sparsity for video compressive sensing reconstruction. Signal Processing, 222, 109513. |
MLA | Zha, Zhiyuan,et al."Structured residual sparsity for video compressive sensing reconstruction".Signal Processing 222(2024):109513. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment