计算机科学与技术

基于深度学习的无人机单目视觉避障算法

  • 张香竹 ,
  • 张立家 ,
  • 宋逸凡 ,
  • 裴海龙
展开
  • 1.华南理工大学 自动化科学与工程学院,广东 广州 510640;2.广东工业大学 计算机学院,广东 广州 510006
张香竹(1986-),女,博士生,主要从事图像处理、无人机自主导航研究。

收稿日期: 2021-02-26

  修回日期: 2021-06-06

  网络出版日期: 2021-06-17

基金资助

国家自然科学基金重大科研仪器研制项目(61527810);广东省科技计划项目(2017B010116005)

Obstacle Avoidance Algorithm for Unmanned Aerial Vehicle Vision Based on Deep Learning

  • ZHANG Xiang-Zhu ,
  • ZHANG Li-Jia ,
  • SONG Yi-Fan ,
  • PEI Hai-Long
Expand
  • 1.School of Automation Science and Engineering,South China University of Technology,Guangzhou 510640,Guangdong,China;2.School of Computers,Guangdong University of Technology,Guangzhou 510006,Guangdong,China
张香竹(1986-),女,博士生,主要从事图像处理、无人机自主导航研究。

Received date: 2021-02-26

  Revised date: 2021-06-06

  Online published: 2021-06-17

Supported by

Supported by the Scientific Instruments Development Program of NSFC (61527810) and the Science and Technology Planning Project of Guangdong Province(2017B010116005)

摘要

针对基于单目视觉的无人机(UAV)避障问题,本研究提出基于单目深度估计和目标检测的四旋翼自主避障方法。其中,单目深度估计模型提供障碍物像素级别的深度信息,目标检测模型提供障碍物的位置信息。单张红绿蓝(RGB)图像的深度图和目标检测结果由卷积神经网络(CNN)获得;图像的区域划分以目标检测结果为依据,区域深度以深度估计结果为计算依据;规划算法依据区域深度和区域划分结果计算无人机的线速度和角速度,实现无人机的自主避障。为验证算法的自主避障性能,采用Parrot Bebop2无人机对本研究提出的算法与直飞算法进行实飞对比实验。结果表明:本研究提出的算法可用于四旋翼无人机的低速自主避障。

本文引用格式

张香竹 , 张立家 , 宋逸凡 , 裴海龙 . 基于深度学习的无人机单目视觉避障算法[J]. 华南理工大学学报(自然科学版), 2022 , 50(1) : 101 -108, 131 . DOI: 10.12141/j.issn.1000-565X.210096

Abstract

In order to solve the obstacle avoidance problem of unmanned aerial vehicle (UAV) based on monocular vision, a quadrotor autonomous obstacle avoidance method based on monocular depth estimation and object detection was proposed.The monocular depth estimation model provides the pixel-level depth information of the obstacle, and the object detection model provides the location information of the obstacles.The depth map and object detection results of a single Red-Green-Blue image were obtained by convolutional neural network (CNN).The region division of the image was based on the object detection results, and the region depth was calculated based on the depth estimation results.The linear velocity and angular velocity of UAV were calculated by the planning algorithm based on the regional depth and regional division results, so as to realize the autonomous obstacle avoidance of UAV.In order to verify the autonomous obstacle avoidance performance of the algorithm, the Parrot Bebop2 UAV was employed to carry out real flight comparison experiments between the proposed algorithm and the direct flight algorithm.The results show that the proposed algorithm can be used for low speed autonomous obstacle avoi-dance of quadrotor.
文章导航

/