华南理工大学学报(自然科学版) ›› 2020, Vol. 48 ›› Issue (5): 82-91.doi: 10.12141/j.issn.1000-565X.190312

• 电子、通信与自动控制 • 上一篇    下一篇

基于残差学习的多阶段图像压缩感知神经网络

杨春玲 裴翰奇   

  1. 华南理工大学 电子与信息学院,广东 广州 510640
  • 收稿日期:2019-05-30 修回日期:2019-11-13 出版日期:2020-05-25 发布日期:2020-05-01
  • 通信作者: 杨春玲(1970-),女,教授,主要从事图像/视频压缩编码、图像质量评价研究。 E-mail:eeclyang@scut.edu.cn
  • 作者简介:杨春玲(1970-),女,教授,主要从事图像/视频压缩编码、图像质量评价研究。
  • 基金资助:
    广东省自然科学基金资助项目 (2017A030311028,2016A030313455)

Multistage Image Compressive Sensing Neural Network Based on Residual Learning 

YANG Chunling PEI Hanqi   

  1. School of Electronic and Information Engineering,South China University of Technology,Guangzhou 510640,Guandong,China
  • Received:2019-05-30 Revised:2019-11-13 Online:2020-05-25 Published:2020-05-01
  • Contact: 杨春玲(1970-),女,教授,主要从事图像/视频压缩编码、图像质量评价研究。 E-mail:eeclyang@scut.edu.cn
  • About author:杨春玲(1970-),女,教授,主要从事图像/视频压缩编码、图像质量评价研究。
  • Supported by:
    Supported by the Natural Science Foundation of Guangdong Province (2017A030311028,2016A030313455)

摘要: 在传统的图像压缩感知研究中存在两个主要问题: 在采样端,传统的线性采样方式存在一定程度的局限性; 在重构端,传统的优化重构算法有着高耗时的缺陷。新发展的图像压缩感知神经网络框架虽然很好地解决了重构速度问题,但重构效果一般。为了解决上述问题,文中提出一种基于残差学习的多阶段图像压缩感知网络———MSRe-sICS,其中具体包含 3 个子网络: 采样子网络,初始重构子网络与图像增强子网络。在观测端,提出的非线性采样子网络,利用残差学习打破了传统采样方法的局限性,在采样值中保留了更加丰富的图像信息; 在重构端,通过引入插值卷积,初始重构子网络从采样值中进行特征整合以获取质量优良的初始重构图像,最终利用残差学习与插值卷积,提出多阶段图像增强子网络以进一步细化重建图像,提升最终效果。大量仿真实验结果表明,与现有最优的图像压缩感知重构算法相比,MSResICS 拥有更加优良的图像压缩感知重构精度。

关键词: 图像压缩感知, 残差学习, 深度网络, 采样机制

Abstract: There are two main problems in traditional Image Compressive Sensing (ICS): in sampling aspect,traditional linear sampling methods have some limitations; in reconstruction aspect,optimization-based reconstruc-tion methods are highly time-consuming. Newly proposed ICS Neural Network can successfully deal with the speed problem in reconstruction,but lacks the accuracy of traditional algorithms. To solve this problem,a novel multi-stage ICS network based on residual learning (MSResICS) was proposed. It consists of three sub-networks,namely,sampling sub-network,initial reconstruction sub-network,and image enhancement sub-network. In sampling stage,with the help of residual learning,a nonlinear sampling sub-network was designed,which breaks the limitation of conventional sampling method and retains richer image information in samples. In reconstruction stage,the initial reconstruction sub-network extracts features from samples and obtain an initial reconstructed image of high quality by introducing interpolation convolution. With residual learning and interpolation convolution,a mul-tistage image enhancing sub-network was proposed to further refine the reconstruction image and improve the quality of final result. Extensive simulations show that MSResICS has a better reconstruction accuracy than the existing opti-mal ICS reconstruction methods.

Key words: image compressive sensing, residual learning, deep network, sampling mechanism

中图分类号: