Perspective Correcting Visual Odometry for Agile MAVs using a Pixel Processor Array

This paper presents a visual odometry approach using a Pixel Processor Array (PPA) camera, specifically, the SCAMP-5 vision chip. In this device, each pixel is capable of storing data and performing computation, enabling a variety of computer vision tasks to be carried out directly upon the sensor itself. In this work the PPA performs HDR edge detection, perspective correction and image alignment based odometry, allowing the position and heading of a MAV to be tracked at several hundred frames per second. We evaluate our PPA based approach by direct comparison with a motion capture system for a variety of trajectories. These include rapid accelerations that would incur significant motion blur at low frame rates, and lighting conditions that would typically lead to under or over exposure of image detail. Such challenging conditions would often lead to unusable images when relying on traditional image sensors.

Authors

• Colin Greatwood
• Laurie Bose
• Thomas Richardson 0002
• Walterio W. Mayol-Cuevas
• Jianing Chen 0005
• Stephen J. Carey
• Piotr Dudek

Keywords

• Visual odometry
• Cameras
• Robot sensing systems
• Arrays
• Parallel processing
• Visualization
• Performance evaluation
• Micro Air Vehicles
• Frame Rate
• Image Sensor
• Motion Capture
• Edge Detection
• Motion Capture System
• Image Edge
• High Dynamic Range
• Image Alignment
• Lower Frame
• Data Visualization
• Rotation Axis
• Ground Plane
• Radians
• Planning Area
• Pitch Angle
• Roll Angle
• High Frame Rate
• Vehicle Motion
• Onboard Computer
• Images In Row
• Simultaneous Localization And Mapping
• Robot Operating System
• Angle Sensor
• Autopilot
• Yaw Rate
• Pixel Shift
• Air Vehicles
• Flight Data