Electronics, Communication & Automation Technology

Feature-Domain Proximal High-Dimensional Gradient Descent Network for Image Compressed Sensing

Expand
  • School of Electronics and Information,South China University of Technology,Guangzhou 510640,Guangdong,China
杨春玲(1970-),女,博士,教授,主要从事图像/视频压缩编码、图像质量评价研究。E-mail: eeclyang@scut.edu.cn

Received date: 2023-03-10

  Online published: 2023-06-20

Supported by

the Natural Science Foundation of Guangdong Province(2017A0303110282019A1515011949)

Abstract

Compressed sensing theory can be used to solve the problem of limited computing resources of information source acquisition equipment, but there is uncertainty in the signal reconstruction process. Traditional reconstruction algorithm is difficult to be applied in practice because of its high computational complexity. Recently, the reconstruction algorithm based on deep learning has broken the limitation of traditional algorithms, and has attracted wide attention with its fast reconstruction speed and high quality. Existing deep learning reconstruction algorithms can be divided into two types: “black box” and optimization-based inspired network. Compared with the “black box” network structure, the optimization-inspired deep network is easier to obtain high-precision recovery and more interpretable. However, the existing image compressed sensing reconstruction optimization-inspired networks only learn a single gradient in each optimization phase and has shortcomings such as insufficient use of measured information and difficulty in learning gradients, limiting the improvement of reconstruction performance. In order to make full use of the measurement and reduce the difficulty of gradient learning, the idea of high-dimensional space gradient learning was proposed to achieve more accurate gradient regression. On this basis, this paper proposed Feature-domain Proximal High-Dimensional Gradient Descent (FPHGD) algorithm, and designed a Feature-domain Proximal High-dimensional Gradient Descent Network (FPHGD-Net) to realize this algorithm, so as to obtain high-precision image reconstruction. In addition, three kinds of deep space proximal mapping network structures with different complexity were designed to meet different application. According to the spatial complexity from low to high, the corresponding models are respectively called FPHGD-Net-Tiny, FPHGD-Net and FPHGD-Net-Plus. Extensive experiment shows that, compared with OPINE-Net+, the average PSNR of the three proposed models on Set11 increase 1.34, 1.51 and 1.88 dB, and recover richer image details in the reconstruction of visual effects.

Cite this article

YANG Chunling, LIANG Ziwen . Feature-Domain Proximal High-Dimensional Gradient Descent Network for Image Compressed Sensing[J]. Journal of South China University of Technology(Natural Science), 2024 , 52(3) : 119 -130 . DOI: 10.12141/j.issn.1000-565X.230101

References

1 DONOHO D L .Compressed sensing[J].IEEE Transactions on Information Theory200652(4):1289-1306.
2 CHEN C, TRAMEL E W, FOWLER J E .Compresse-d-sensing recovery of images and video using multihypothesis predctions[C]∥Proceedings of 2011 Conference Record of the Forty Fifth Asilomar Conference on Signals,Systems and Computers (ASILOMAR).Pacific Grove:IEEE,2011:1193-1198.
3 ZHANG J, ZHAO D, GAO W .Group-based sparse r-epresentation for image restoration[J].IEEE Transacti-ons on Image Processing201423(8):3336-3351.
4 KULKARNI K, LOHIT S, TURAGA P,et al .Reconnet:non-iterative reconstruction of images from compressively sensed measurements[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Las Vegas:IEEE,2016:449-458.
5 YAO H, DAI F, ZHANG S,et al .Dr2-net:deep residual reconstruction network for image compressive sensing[J].Neurocomputing2019359(9):483-493.
6 SHI W, JIANG F, LIU S,et al .Image compressed sensing using convolutional neural network[J].IEEE Transactions on Image Processing201929:375-388.
7 CUI W, LIU S, JIANG F,et al .Image compressed sensing using non-local neural network[J].IEEE Transactions on Multimedia202125:816-830.
8 TIAN J, YUAN W, TU Y .Image compressed sensing using multi-scale residual generative adversarial network[J].The Visual Computer202238(12):4193-4202.
9 魏志超,杨春玲 .时域注意力特征对齐的视频压缩感知重构网络[J].电子学报202250(11):2584-2592.
  WEI Zhi-chao, YANG Chun-ling .Video compressed sensing reconstruction network based on temporal-attention feature alignment[J].Acta Electronica Sinica202250(11):2584-2592.
10 ZHANG J, GHANEM B .ISTA-net:interpretable optimization-inspired deep network for image compressive sensing[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Saly Lake City:IEEE,2018:1828-1837.
11 ZHANG J, ZHAO C, GAO W .Optimization-inspired compact deep compressive sensing[J].IEEE Journal of Selected Topics in Signal Processing202014(4):765-774.
12 YOU D, XIE J, ZHANG J .ISTA-Net++:flexible deep unfolding network for compressive sensing[C]∥Proceedings of the 2021 IEEE International Conference on Multimedia and Expo (ICME).Shenzhen:IEEE,2021:1-6.
13 YOU D, ZHANG J, XIE J,et al .Coast:controllable arbitrary-sampling network for compressive sensing[J].IEEE Transactions on Image Processing202130:6066-6080.
14 YANG Y, SUN J, LI H,et al .ADMM-CSNet:a deep learning approach for image compressive sensing[J].IEEE Transactions on Pattern Analysis and Machine Intelligence201842(3):521-538.
15 ZHANG Z, LIU Y, LIU J,et al .AMP-Net:denoising-based deep unfolding for compressive image sensing[J].IEEE Transactions on Image Processing202130:1487-1500.
16 SONG J, CHEN B, ZHANG J .Memory-augmented deep unfolding network for compressive sensing[C]∥Proceedings of the 29th ACM International Conference on Multimedia.New York:ACM,2021:4249-4258.
17 CHEN W, YANG C, YANG X .FSOINET:feature-space optimization-inspired network for image compressive sensing[C]∥Proceedings of the 2022 IEEE International Conference on Acoustics,Speech and Signal Processing (ICASSP).Singapore:IEEE,2022:2460-2464.
18 陈文俊,杨春玲 .图像压缩感知的特征域优化及自注意力增强神经网络重构算法[J].电子学报202250(11):2629-2637.
  CHEN Wen-jun, YANG Chun-ling .Feature-space optimization-inspired and self-attention enhanced neural network reconstruction algorithm for image compressive sensing[J].Acta Electronica Sinica202250(11):2629-2637.
19 MOU C, WANG Q, ZHANG J .Deep generalized unfolding networks for image restoration[C]∥Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.New Orleans:IEEE,2022:17399-17410.
20 CUI W, LIU S, ZHAO D .Fast hierarchical deep unfolding network for image compressed sensing[C]∥Proceedings of the 30th ACM International Conference on Multimedia.New York:ACM,2022:2739-2748.
21 SONG J, MOU C, WANG S,et al .Optimization-inspired cross-attention transformer for compressive sensing[C]∥Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.Vancouver:IEEE,2023:6174-6184.
22 LIAN Q, SU Y, SHI B,et al .LG-Net:local and global complementary priors induced multi-stage progressive network for compressed sensing[J].Signal Processing2023202:108737/1-13.
23 ZHANG H, YANG C .Dual-domain update and double-group optimization network for image compressive sensing[C]∥Proceedings of 2022 IEEE International Conference on Image Processing (ICIP).Bordeaux:IEEE,2022:1286-1290.
24 PARIKH N, BOYD S .Proximal algorithms[J].Foundations and Trends? in Optimization20141(3):127-239.
25 SHEN M, GAN H, NING C,et al .TransCS:a transformer-based hybrid architecture for image compressedsensing[J].IEEE Transactions on Image Processing202231:6991-7005.
26 SONG J, CHEN B, ZHANG J .Dynamic path-controllable deep unfolding network for compressive sensing[J].IEEE Transactions on Image Processing202332:2202-2214.
27 ZHOU Z, LIU F, SHEN H .IEF-CSNET:information enhancement and fusion network for compressed sensing reconstruction[J].Sensors202323(4):1886-2002.
28 BREIMAN L .Bagging predictors[J].Machine Learning199624(2):123-140.
29 FOWLER J E,MUN S, TRAMEL E W .Block-based compressed sensing of images and video[J].Foundations and Trends? in Signal Processing20124(4):297-416.
30 MARDANI M, SUN Q, DONOHO D,et al .Neural proximal gradient descent for compressive imaging[C]∥Proceedings of Advances in Neural Information Processing Systems.Montreal:NeurIPS,2018:9596-9606.
31 MARTIN D, FOWLKES C,TAL D,et al .A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics[C]∥Proceedings of the Eighth IEEE International Conference on Computer Vision.Vancouver:IEEE,2001:416-423.
32 AGUSTSSON E, TIMOFTE R .Ntire 2017 challenge on single image super-resolution:dataset and study[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops.Honolulu:IEEE,2017:126-135.
33 HUANG J B, SINGH A, AHUJA N .Single image superresolution from transformed self-exemplars[C]∥Proceedings of the IEEE Conference on Computer Visionand Pattern Recognition.Boston:IEEE,2015:5197-5206.
34 LOSHCHILOV I, HUTTER F .Decoupled weight decay regularization[C]∥Proceedings of the 7th International Conference on Learning Representations (ICLR).New Orleans:[s.n.],2019.
Outlines

/