Low-cost camera based sense and avoid in unmanned aerial vehicles: sensing and control methods

Abstract

In this paper, a low-cost camera based sense and avoid control scheme is proposed. First, for the unmanned aerial vehicle (UAV) sense and avoid problem, we propose and demonstrate a low cost solution with only one monocular, wide field of view camera. We adapted a deep learning based algorithm and made it lightweight enough to run on-board the UAV. We created a synthetic dataset to increase the size of the traning data set. Second, we developed a filter to estimate the 3D position and velocity of the moving obstacle. Third, based on the estimated information, we adapted the velocity obstacle approach to work in 3D. Finally, we implemented the algorithms in the software framework of our UAV testbed and conducted flight tests, demonstrating the effectiveness of the solution.