Journal of South China University of Technology(Natural Science Edition) ›› 2022, Vol. 50 ›› Issue (1): 101-108, 131.doi: 10.12141/j.issn.1000-565X.210096

Special Issue: 2022年计算机科学与技术

• Computer Science & Technology • Previous Articles     Next Articles

Obstacle Avoidance Algorithm for Unmanned Aerial Vehicle Vision Based on Deep Learning

ZHANG Xiangzhu ZHANG Lijia SONG Yifan PEI Hailong   

  1. 1.School of Automation Science and Engineering,South China University of Technology,Guangzhou 510640,Guangdong,China;2.School of Computers,Guangdong University of Technology,Guangzhou 510006,Guangdong,China
  • Received:2021-02-26 Revised:2021-06-06 Online:2022-01-25 Published:2022-01-03
  • Contact: 张香竹(1986-),女,博士生,主要从事图像处理、无人机自主导航研究。 E-mail:xiangzhu_zhang@126.com
  • About author:张香竹(1986-),女,博士生,主要从事图像处理、无人机自主导航研究。
  • Supported by:
    Supported by the Scientific Instruments Development Program of NSFC (61527810) and the Science and Technology Planning Project of Guangdong Province(2017B010116005)

Abstract: In order to solve the obstacle avoidance problem of unmanned aerial vehicle (UAV) based on monocular vision, a quadrotor autonomous obstacle avoidance method based on monocular depth estimation and object detection was proposed.The monocular depth estimation model provides the pixel-level depth information of the obstacle, and the object detection model provides the location information of the obstacles.The depth map and object detection results of a single Red-Green-Blue image were obtained by convolutional neural network (CNN).The region division of the image was based on the object detection results, and the region depth was calculated based on the depth estimation results.The linear velocity and angular velocity of UAV were calculated by the planning algorithm based on the regional depth and regional division results, so as to realize the autonomous obstacle avoidance of UAV.In order to verify the autonomous obstacle avoidance performance of the algorithm, the Parrot Bebop2 UAV was employed to carry out real flight comparison experiments between the proposed algorithm and the direct flight algorithm.The results show that the proposed algorithm can be used for low speed autonomous obstacle avoi-dance of quadrotor.

Key words: unmanned aerial vehicle, quadrotor, monocular, obstacle avoidance algorithm, convolutional neural network, depth estimation, object detection

CLC Number: