As the existing tracking algorithms are of poor performance in complex situations,a target tracking algo-rithm with structured sparse representation is proposed based on ranks.In this algorithm,first,a target dictionarycontaining targets and background information is constructed.Next,the candidate targets are represented linearlyvia the structured sparse representation,and the corresponding correlation coefficients are combined and ranked.Then,the residual error scores of the candidate targets are computed by using the residual errors of the target andthe background,and the scores are ranked later,from which the target state is finally determined.Experimental re-sults show that the proposed tracking algorithm is of high tracking accuracy and strong robustness.