电子、通信与自动控制

特征域近端高维梯度下降图像压缩感知重构网络

展开
  • 华南理工大学 电子与信息学院,广东 广州 510640
杨春玲(1970-),女,博士,教授,主要从事图像/视频压缩编码、图像质量评价研究。E-mail: eeclyang@scut.edu.cn

收稿日期: 2023-03-10

  网络出版日期: 2023-06-20

基金资助

广东省自然科学基金资助项目(2017A030311028,2019A1515011949)

Feature-Domain Proximal High-Dimensional Gradient Descent Network for Image Compressed Sensing

Expand
  • School of Electronics and Information,South China University of Technology,Guangzhou 510640,Guangdong,China
杨春玲(1970-),女,博士,教授,主要从事图像/视频压缩编码、图像质量评价研究。E-mail: eeclyang@scut.edu.cn

Received date: 2023-03-10

  Online published: 2023-06-20

Supported by

the Natural Science Foundation of Guangdong Province(2017A0303110282019A1515011949)

摘要

压缩感知理论可以被用于解决信源采集设备计算资源受限的问题,但信号重构过程存在不确定性。传统的重构算法计算复杂度高,难以在实际中应用。近期,基于深度学习的重构算法打破传统算法的局限性,以其速度快、质量高等特点受到了广泛关注。现有的深度学习重构算法可以划分为“黑盒子”以及基于优化启发网络两种类型。与“黑盒子”式的网络结构相比,基于优化启发的深度网络更容易获得高精度的恢复,同时也更具可解释性。然而现有基于优化启发的图像压缩感知重构网络在每个优化阶段仅学习单一梯度,存在测量值信息利用不足、难以准确地学习梯度等缺点,限制了重构性能的提升。为了更充分地利用测量值信息,降低梯度学习的难度,本文提出了高维空间梯度学习思想,实现更准确的梯度回归。在此基础上,本文提出了特征域近端高维梯度下降(FPHGD)算法,并设计了实现该算法的深度神经网络(FPHGD-Net)以获得高精度图像重构结果。此外,本文设计了3种不同复杂度的深度空间近端映射网络结构,以满足不同的应用条件,按空间复杂度从低到高,相应模型分别为FPHGD-Net-Tiny、FPHGD-Net、FPHGD-Net-Plus。实验结果表明,与OPINE-Net+相比,所提3种模型在Set11数据上的平均PSNR分别提升1.34、1.51和1.88 dB,并且在重构视觉效果上,能够恢复出更丰富的图像细节。

本文引用格式

杨春玲, 梁梓文 . 特征域近端高维梯度下降图像压缩感知重构网络[J]. 华南理工大学学报(自然科学版), 2024 , 52(3) : 119 -130 . DOI: 10.12141/j.issn.1000-565X.230101

Abstract

Compressed sensing theory can be used to solve the problem of limited computing resources of information source acquisition equipment, but there is uncertainty in the signal reconstruction process. Traditional reconstruction algorithm is difficult to be applied in practice because of its high computational complexity. Recently, the reconstruction algorithm based on deep learning has broken the limitation of traditional algorithms, and has attracted wide attention with its fast reconstruction speed and high quality. Existing deep learning reconstruction algorithms can be divided into two types: “black box” and optimization-based inspired network. Compared with the “black box” network structure, the optimization-inspired deep network is easier to obtain high-precision recovery and more interpretable. However, the existing image compressed sensing reconstruction optimization-inspired networks only learn a single gradient in each optimization phase and has shortcomings such as insufficient use of measured information and difficulty in learning gradients, limiting the improvement of reconstruction performance. In order to make full use of the measurement and reduce the difficulty of gradient learning, the idea of high-dimensional space gradient learning was proposed to achieve more accurate gradient regression. On this basis, this paper proposed Feature-domain Proximal High-Dimensional Gradient Descent (FPHGD) algorithm, and designed a Feature-domain Proximal High-dimensional Gradient Descent Network (FPHGD-Net) to realize this algorithm, so as to obtain high-precision image reconstruction. In addition, three kinds of deep space proximal mapping network structures with different complexity were designed to meet different application. According to the spatial complexity from low to high, the corresponding models are respectively called FPHGD-Net-Tiny, FPHGD-Net and FPHGD-Net-Plus. Extensive experiment shows that, compared with OPINE-Net+, the average PSNR of the three proposed models on Set11 increase 1.34, 1.51 and 1.88 dB, and recover richer image details in the reconstruction of visual effects.

参考文献

1 DONOHO D L .Compressed sensing[J].IEEE Transactions on Information Theory200652(4):1289-1306.
2 CHEN C, TRAMEL E W, FOWLER J E .Compresse-d-sensing recovery of images and video using multihypothesis predctions[C]∥Proceedings of 2011 Conference Record of the Forty Fifth Asilomar Conference on Signals,Systems and Computers (ASILOMAR).Pacific Grove:IEEE,2011:1193-1198.
3 ZHANG J, ZHAO D, GAO W .Group-based sparse r-epresentation for image restoration[J].IEEE Transacti-ons on Image Processing201423(8):3336-3351.
4 KULKARNI K, LOHIT S, TURAGA P,et al .Reconnet:non-iterative reconstruction of images from compressively sensed measurements[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Las Vegas:IEEE,2016:449-458.
5 YAO H, DAI F, ZHANG S,et al .Dr2-net:deep residual reconstruction network for image compressive sensing[J].Neurocomputing2019359(9):483-493.
6 SHI W, JIANG F, LIU S,et al .Image compressed sensing using convolutional neural network[J].IEEE Transactions on Image Processing201929:375-388.
7 CUI W, LIU S, JIANG F,et al .Image compressed sensing using non-local neural network[J].IEEE Transactions on Multimedia202125:816-830.
8 TIAN J, YUAN W, TU Y .Image compressed sensing using multi-scale residual generative adversarial network[J].The Visual Computer202238(12):4193-4202.
9 魏志超,杨春玲 .时域注意力特征对齐的视频压缩感知重构网络[J].电子学报202250(11):2584-2592.
  WEI Zhi-chao, YANG Chun-ling .Video compressed sensing reconstruction network based on temporal-attention feature alignment[J].Acta Electronica Sinica202250(11):2584-2592.
10 ZHANG J, GHANEM B .ISTA-net:interpretable optimization-inspired deep network for image compressive sensing[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Saly Lake City:IEEE,2018:1828-1837.
11 ZHANG J, ZHAO C, GAO W .Optimization-inspired compact deep compressive sensing[J].IEEE Journal of Selected Topics in Signal Processing202014(4):765-774.
12 YOU D, XIE J, ZHANG J .ISTA-Net++:flexible deep unfolding network for compressive sensing[C]∥Proceedings of the 2021 IEEE International Conference on Multimedia and Expo (ICME).Shenzhen:IEEE,2021:1-6.
13 YOU D, ZHANG J, XIE J,et al .Coast:controllable arbitrary-sampling network for compressive sensing[J].IEEE Transactions on Image Processing202130:6066-6080.
14 YANG Y, SUN J, LI H,et al .ADMM-CSNet:a deep learning approach for image compressive sensing[J].IEEE Transactions on Pattern Analysis and Machine Intelligence201842(3):521-538.
15 ZHANG Z, LIU Y, LIU J,et al .AMP-Net:denoising-based deep unfolding for compressive image sensing[J].IEEE Transactions on Image Processing202130:1487-1500.
16 SONG J, CHEN B, ZHANG J .Memory-augmented deep unfolding network for compressive sensing[C]∥Proceedings of the 29th ACM International Conference on Multimedia.New York:ACM,2021:4249-4258.
17 CHEN W, YANG C, YANG X .FSOINET:feature-space optimization-inspired network for image compressive sensing[C]∥Proceedings of the 2022 IEEE International Conference on Acoustics,Speech and Signal Processing (ICASSP).Singapore:IEEE,2022:2460-2464.
18 陈文俊,杨春玲 .图像压缩感知的特征域优化及自注意力增强神经网络重构算法[J].电子学报202250(11):2629-2637.
  CHEN Wen-jun, YANG Chun-ling .Feature-space optimization-inspired and self-attention enhanced neural network reconstruction algorithm for image compressive sensing[J].Acta Electronica Sinica202250(11):2629-2637.
19 MOU C, WANG Q, ZHANG J .Deep generalized unfolding networks for image restoration[C]∥Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.New Orleans:IEEE,2022:17399-17410.
20 CUI W, LIU S, ZHAO D .Fast hierarchical deep unfolding network for image compressed sensing[C]∥Proceedings of the 30th ACM International Conference on Multimedia.New York:ACM,2022:2739-2748.
21 SONG J, MOU C, WANG S,et al .Optimization-inspired cross-attention transformer for compressive sensing[C]∥Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.Vancouver:IEEE,2023:6174-6184.
22 LIAN Q, SU Y, SHI B,et al .LG-Net:local and global complementary priors induced multi-stage progressive network for compressed sensing[J].Signal Processing2023202:108737/1-13.
23 ZHANG H, YANG C .Dual-domain update and double-group optimization network for image compressive sensing[C]∥Proceedings of 2022 IEEE International Conference on Image Processing (ICIP).Bordeaux:IEEE,2022:1286-1290.
24 PARIKH N, BOYD S .Proximal algorithms[J].Foundations and Trends? in Optimization20141(3):127-239.
25 SHEN M, GAN H, NING C,et al .TransCS:a transformer-based hybrid architecture for image compressedsensing[J].IEEE Transactions on Image Processing202231:6991-7005.
26 SONG J, CHEN B, ZHANG J .Dynamic path-controllable deep unfolding network for compressive sensing[J].IEEE Transactions on Image Processing202332:2202-2214.
27 ZHOU Z, LIU F, SHEN H .IEF-CSNET:information enhancement and fusion network for compressed sensing reconstruction[J].Sensors202323(4):1886-2002.
28 BREIMAN L .Bagging predictors[J].Machine Learning199624(2):123-140.
29 FOWLER J E,MUN S, TRAMEL E W .Block-based compressed sensing of images and video[J].Foundations and Trends? in Signal Processing20124(4):297-416.
30 MARDANI M, SUN Q, DONOHO D,et al .Neural proximal gradient descent for compressive imaging[C]∥Proceedings of Advances in Neural Information Processing Systems.Montreal:NeurIPS,2018:9596-9606.
31 MARTIN D, FOWLKES C,TAL D,et al .A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics[C]∥Proceedings of the Eighth IEEE International Conference on Computer Vision.Vancouver:IEEE,2001:416-423.
32 AGUSTSSON E, TIMOFTE R .Ntire 2017 challenge on single image super-resolution:dataset and study[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops.Honolulu:IEEE,2017:126-135.
33 HUANG J B, SINGH A, AHUJA N .Single image superresolution from transformed self-exemplars[C]∥Proceedings of the IEEE Conference on Computer Visionand Pattern Recognition.Boston:IEEE,2015:5197-5206.
34 LOSHCHILOV I, HUTTER F .Decoupled weight decay regularization[C]∥Proceedings of the 7th International Conference on Learning Representations (ICLR).New Orleans:[s.n.],2019.
文章导航

/