华南理工大学学报(自然科学版) ›› 2022, Vol. 50 ›› Issue (1): 101-108, 131.doi: 10.12141/j.issn.1000-565X.210096

所属专题: 2022年计算机科学与技术

• 计算机科学与技术 • 上一篇    下一篇

基于深度学习的无人机单目视觉避障算法

张香竹1 张立家2 宋逸凡1 裴海龙1   

  1. 1.华南理工大学 自动化科学与工程学院,广东 广州 510640;2.广东工业大学 计算机学院,广东 广州 510006
  • 收稿日期:2021-02-26 修回日期:2021-06-06 出版日期:2022-01-25 发布日期:2022-01-03
  • 通信作者: 张香竹(1986-),女,博士生,主要从事图像处理、无人机自主导航研究。 E-mail:xiangzhu_zhang@126.com
  • 作者简介:张香竹(1986-),女,博士生,主要从事图像处理、无人机自主导航研究。
  • 基金资助:
    国家自然科学基金重大科研仪器研制项目(61527810);广东省科技计划项目(2017B010116005)

Obstacle Avoidance Algorithm for Unmanned Aerial Vehicle Vision Based on Deep Learning

ZHANG Xiangzhu ZHANG Lijia SONG Yifan PEI Hailong   

  1. 1.School of Automation Science and Engineering,South China University of Technology,Guangzhou 510640,Guangdong,China;2.School of Computers,Guangdong University of Technology,Guangzhou 510006,Guangdong,China
  • Received:2021-02-26 Revised:2021-06-06 Online:2022-01-25 Published:2022-01-03
  • Contact: 张香竹(1986-),女,博士生,主要从事图像处理、无人机自主导航研究。 E-mail:xiangzhu_zhang@126.com
  • About author:张香竹(1986-),女,博士生,主要从事图像处理、无人机自主导航研究。
  • Supported by:
    Supported by the Scientific Instruments Development Program of NSFC (61527810) and the Science and Technology Planning Project of Guangdong Province(2017B010116005)

摘要: 针对基于单目视觉的无人机(UAV)避障问题,本研究提出基于单目深度估计和目标检测的四旋翼自主避障方法。其中,单目深度估计模型提供障碍物像素级别的深度信息,目标检测模型提供障碍物的位置信息。单张红绿蓝(RGB)图像的深度图和目标检测结果由卷积神经网络(CNN)获得;图像的区域划分以目标检测结果为依据,区域深度以深度估计结果为计算依据;规划算法依据区域深度和区域划分结果计算无人机的线速度和角速度,实现无人机的自主避障。为验证算法的自主避障性能,采用Parrot Bebop2无人机对本研究提出的算法与直飞算法进行实飞对比实验。结果表明:本研究提出的算法可用于四旋翼无人机的低速自主避障。

关键词: 无人机, 四旋翼, 单目, 避障算法, 卷积神经网络, 深度估计, 目标检测

Abstract: In order to solve the obstacle avoidance problem of unmanned aerial vehicle (UAV) based on monocular vision, a quadrotor autonomous obstacle avoidance method based on monocular depth estimation and object detection was proposed.The monocular depth estimation model provides the pixel-level depth information of the obstacle, and the object detection model provides the location information of the obstacles.The depth map and object detection results of a single Red-Green-Blue image were obtained by convolutional neural network (CNN).The region division of the image was based on the object detection results, and the region depth was calculated based on the depth estimation results.The linear velocity and angular velocity of UAV were calculated by the planning algorithm based on the regional depth and regional division results, so as to realize the autonomous obstacle avoidance of UAV.In order to verify the autonomous obstacle avoidance performance of the algorithm, the Parrot Bebop2 UAV was employed to carry out real flight comparison experiments between the proposed algorithm and the direct flight algorithm.The results show that the proposed algorithm can be used for low speed autonomous obstacle avoi-dance of quadrotor.

Key words: unmanned aerial vehicle, quadrotor, monocular, obstacle avoidance algorithm, convolutional neural network, depth estimation, object detection

中图分类号: