Computer Science & Technology

Obstacle Avoidance Algorithm for Unmanned Aerial Vehicle Vision Based on Deep Learning

  • ZHANG Xiang-Zhu ,
  • ZHANG Li-Jia ,
  • SONG Yi-Fan ,
  • PEI Hai-Long
Expand
  • 1.School of Automation Science and Engineering,South China University of Technology,Guangzhou 510640,Guangdong,China;2.School of Computers,Guangdong University of Technology,Guangzhou 510006,Guangdong,China
张香竹(1986-),女,博士生,主要从事图像处理、无人机自主导航研究。

Received date: 2021-02-26

  Revised date: 2021-06-06

  Online published: 2021-06-17

Supported by

Supported by the Scientific Instruments Development Program of NSFC (61527810) and the Science and Technology Planning Project of Guangdong Province(2017B010116005)

Abstract

In order to solve the obstacle avoidance problem of unmanned aerial vehicle (UAV) based on monocular vision, a quadrotor autonomous obstacle avoidance method based on monocular depth estimation and object detection was proposed.The monocular depth estimation model provides the pixel-level depth information of the obstacle, and the object detection model provides the location information of the obstacles.The depth map and object detection results of a single Red-Green-Blue image were obtained by convolutional neural network (CNN).The region division of the image was based on the object detection results, and the region depth was calculated based on the depth estimation results.The linear velocity and angular velocity of UAV were calculated by the planning algorithm based on the regional depth and regional division results, so as to realize the autonomous obstacle avoidance of UAV.In order to verify the autonomous obstacle avoidance performance of the algorithm, the Parrot Bebop2 UAV was employed to carry out real flight comparison experiments between the proposed algorithm and the direct flight algorithm.The results show that the proposed algorithm can be used for low speed autonomous obstacle avoi-dance of quadrotor.

Cite this article

ZHANG Xiang-Zhu , ZHANG Li-Jia , SONG Yi-Fan , PEI Hai-Long . Obstacle Avoidance Algorithm for Unmanned Aerial Vehicle Vision Based on Deep Learning[J]. Journal of South China University of Technology(Natural Science), 2022 , 50(1) : 101 -108, 131 . DOI: 10.12141/j.issn.1000-565X.210096

Outlines

/