Most existing compressed video sensing ( CVS) algorithms with best reconstruction performance adopt a “prediction-residual reconstruction”strategy,which helps obtain high reconstruction quality by taking good advantage of intra-frame and inter-frame correlation.However,all of them ignore the residual structure characteristics and simply use SPL reconstruction algorithm which is only suitable for natural image compressed sensing.In order to solve this problem,a block classifying reconstruction algorithm on the basis of residual structure characteristics is proposed,which firstly classifies residual blocks according to their average energy and then adopts suitable algorithms to reconstruct residual blocks corresponding to their structure characteristics.Simulated results show that the proposed algorithm helps achieve higher reconstruction quality than SPL algorithm for video sequences with fast movements.