电子、通信与自动控制

基于残差学习的多阶段图像压缩感知神经网络

展开
  • 华南理工大学 电子与信息学院,广东 广州 510640
杨春玲(1970-),女,教授,主要从事图像/视频压缩编码、图像质量评价研究。

收稿日期: 2019-05-30

  修回日期: 2019-11-13

  网络出版日期: 2020-05-01

基金资助

广东省自然科学基金资助项目 (2017A030311028,2016A030313455)

Multistage Image Compressive Sensing Neural Network Based on Residual Learning 

Expand
  • School of Electronic and Information Engineering,South China University of Technology,Guangzhou 510640,Guandong,China
杨春玲(1970-),女,教授,主要从事图像/视频压缩编码、图像质量评价研究。

Received date: 2019-05-30

  Revised date: 2019-11-13

  Online published: 2020-05-01

Supported by

Supported by the Natural Science Foundation of Guangdong Province (2017A030311028,2016A030313455)

摘要

在传统的图像压缩感知研究中存在两个主要问题: 在采样端,传统的线性采样方式存在一定程度的局限性; 在重构端,传统的优化重构算法有着高耗时的缺陷。新发展的图像压缩感知神经网络框架虽然很好地解决了重构速度问题,但重构效果一般。为了解决上述问题,文中提出一种基于残差学习的多阶段图像压缩感知网络———MSRe-sICS,其中具体包含 3 个子网络: 采样子网络,初始重构子网络与图像增强子网络。在观测端,提出的非线性采样子网络,利用残差学习打破了传统采样方法的局限性,在采样值中保留了更加丰富的图像信息; 在重构端,通过引入插值卷积,初始重构子网络从采样值中进行特征整合以获取质量优良的初始重构图像,最终利用残差学习与插值卷积,提出多阶段图像增强子网络以进一步细化重建图像,提升最终效果。大量仿真实验结果表明,与现有最优的图像压缩感知重构算法相比,MSResICS 拥有更加优良的图像压缩感知重构精度。

本文引用格式

杨春玲 裴翰奇 . 基于残差学习的多阶段图像压缩感知神经网络[J]. 华南理工大学学报(自然科学版), 2020 , 48(5) : 82 -91 . DOI: 10.12141/j.issn.1000-565X.190312

Abstract

There are two main problems in traditional Image Compressive Sensing (ICS): in sampling aspect,traditional linear sampling methods have some limitations; in reconstruction aspect,optimization-based reconstruc-tion methods are highly time-consuming. Newly proposed ICS Neural Network can successfully deal with the speed problem in reconstruction,but lacks the accuracy of traditional algorithms. To solve this problem,a novel multi-stage ICS network based on residual learning (MSResICS) was proposed. It consists of three sub-networks,namely,sampling sub-network,initial reconstruction sub-network,and image enhancement sub-network. In sampling stage,with the help of residual learning,a nonlinear sampling sub-network was designed,which breaks the limitation of conventional sampling method and retains richer image information in samples. In reconstruction stage,the initial reconstruction sub-network extracts features from samples and obtain an initial reconstructed image of high quality by introducing interpolation convolution. With residual learning and interpolation convolution,a mul-tistage image enhancing sub-network was proposed to further refine the reconstruction image and improve the quality of final result. Extensive simulations show that MSResICS has a better reconstruction accuracy than the existing opti-mal ICS reconstruction methods.
文章导航

/