Journal of South China University of Technology (Natural Science Edition) ›› 2020, Vol. 48 ›› Issue (5): 82-91.doi: 10.12141/j.issn.1000-565X.190312

• Electronics, Communication & Automation Technology • Previous Articles     Next Articles

Multistage Image Compressive Sensing Neural Network Based on Residual Learning 

YANG Chunling PEI Hanqi   

  1. School of Electronic and Information Engineering,South China University of Technology,Guangzhou 510640,Guandong,China
  • Received:2019-05-30 Revised:2019-11-13 Online:2020-05-25 Published:2020-05-01
  • Contact: 杨春玲(1970-),女,教授,主要从事图像/视频压缩编码、图像质量评价研究。 E-mail:eeclyang@scut.edu.cn
  • About author:杨春玲(1970-),女,教授,主要从事图像/视频压缩编码、图像质量评价研究。
  • Supported by:
    Supported by the Natural Science Foundation of Guangdong Province (2017A030311028,2016A030313455)

Abstract: There are two main problems in traditional Image Compressive Sensing (ICS): in sampling aspect,traditional linear sampling methods have some limitations; in reconstruction aspect,optimization-based reconstruc-tion methods are highly time-consuming. Newly proposed ICS Neural Network can successfully deal with the speed problem in reconstruction,but lacks the accuracy of traditional algorithms. To solve this problem,a novel multi-stage ICS network based on residual learning (MSResICS) was proposed. It consists of three sub-networks,namely,sampling sub-network,initial reconstruction sub-network,and image enhancement sub-network. In sampling stage,with the help of residual learning,a nonlinear sampling sub-network was designed,which breaks the limitation of conventional sampling method and retains richer image information in samples. In reconstruction stage,the initial reconstruction sub-network extracts features from samples and obtain an initial reconstructed image of high quality by introducing interpolation convolution. With residual learning and interpolation convolution,a mul-tistage image enhancing sub-network was proposed to further refine the reconstruction image and improve the quality of final result. Extensive simulations show that MSResICS has a better reconstruction accuracy than the existing opti-mal ICS reconstruction methods.

Key words: image compressive sensing, residual learning, deep network, sampling mechanism

CLC Number: