Dynamic Image Based Visual Servoing with Unmanned Aerial Vehicles

• Author / Creator

  Leung, Kenny

• In recent years rotary-wing unmanned aerial vehicles (UAVs) are seeing more uses in applications such as transmission line inspection, event filming, parcel delivery, and search-and-rescue missions. Recent improvements in embedded systems have lead to more research for improving unmanned aerial vehicle (UAV) autonomy. Traditionally for outdoor use, the inertial measurement unit (IMU) with magnetometer, barometer, or global positioning system (GPS) can be used for pose estimation, where the pose estimate is used for motion control. However, in GPS denied environments, such as indoors, other sensors need to be used for acquiring pose of the UAV in the environment. One method to solve for the vehicle’s pose is visual servoing, which uses a camera to collect information about the environment, and estimates the UAV’s pose for control. This thesis implements the proposed dynamic image-based visual servoing (DIBVS) controller in Fink et al. [1] using a newer experimental platform to improve the performance. This new platform utilizes the Robot Operating System (ROS) running on an on-board Nvidia Jetson TX1 (TX1) mini computer with a FLIR Chameleon 3 camera for the computer vision (CV) system. ROS is chosen to create a simple framework that would handle necessary components for the UAV, such as image capture and data transfer, while allowing for minimal software changes to test different algorithms. Using this framework, future research projects using the platform can save time troubleshooting issues testing hardware, and instead focus on problems related to the algorithms being tested. Also, future upgrades to the platform would need minimal changes to the software so long as the new system is able to run ROS. For the experiments, the CV system uses color to identify visual features used to compute image moments which are sent to a PX4 flight management unit (FMU) for control of the UAV over a target. The experimental results are compared to the values found in Fink et al. [1], where the new platform is found to have similar performance to the platform used in the reference paper. This result indicates successful implementation of the DIBVS controller on the new platform with a more modular and flexible CV system.

• Subjects / Keywords

  • UAV
  • ROS
  • IBVS

• Graduation date

  Spring 2018

• Type of Item

  Thesis

• Degree

  Master of Science

• DOI

  https://doi.org/10.7939/R3319SH94

• License

  Permission is hereby granted to the University of Alberta Libraries to reproduce single copies of this thesis and to lend or sell such copies for private, scholarly or scientific research purposes only. Where the thesis is converted to, or otherwise made available in digital form, the University of Alberta will advise potential users of the thesis of these terms. The author reserves all other publication and other rights in association with the copyright in the thesis and, except as herein before provided, neither the thesis nor any substantial portion thereof may be printed or otherwise reproduced in any material form whatsoever without the author's prior written permission.