Tracking control of a UAV with a parallel visual processor

This paper presents a vision-based control strategy for tracking a ground target using a novel vision sensor featuring a processor for each pixel element. This enables computer vision tasks to be carried out directly on the focal plane in a highly efficient manner rather than using a separate general purpose computer. The strategy enables a small, agile quadrotor Unmanned Air Vehicle (UAV) to track the target from close range using minimal computational effort and with low power consumption. To evaluate the system we target a vehicle driven by chaotic dual-pendulum trajectories. Target proximity and the large, unpredictable accelerations of the vehicle cause challenges for the UAV in keeping it within the downward facing camera's field of view (FoV). A state observer is used to smooth out predictions of the target's location and, importantly, estimate velocity. Experimental results also demonstrate that it is possible to continue to re-acquire and follow the target during short periods of loss in target visibility. The tracking algorithm exploits the parallel nature of the visual sensor, enabling high rate image processing ahead of any communication bottleneck with the UAV controller. With the vision chip carrying out the most intense visual information processing, it is computationally trivial to compute all of the controls for tracking onboard. This work is directed toward visual agile robots that are power efficient and that ferry only useful data around the information and control pathways.

Authors

• Colin Greatwood
• Laurie Bose
• Thomas Richardson 0002
• Walterio W. Mayol-Cuevas
• Jianing Chen 0005
• Stephen J. Carey
• Piotr Dudek

Keywords

• Target tracking
• Visualization
• Process control
• Hardware
• Unmanned Aerial Vehicles
• Tracking Control
• Image Processing
• Field Of View
• Computer Vision
• Target Location
• Focal Plane
• Control Information
• State Observer
• Control Pathways
• Visual Target
• Vision Sensors
• Close Range
• General-purpose Computer
• Parallelization
• Control Input
• Image Plane
• Bounding Box
• Constant Velocity
• Low Energy Consumption
• Dynamic Vision Sensor
• Inertial Measurement Unit Data
• Camera Field Of View
• Sophisticated Algorithms
• Inertial Measurement Unit
• Motion Tracking System
• Pitch Angle
• Number Of Boundaries