Vision-based localization using an edge map extracted from 3D laser range data

Reliable real-time localization is a key component of autonomous industrial vehicle systems. We consider the problem of using on-board vision to determine a vehicle's pose in a known, but non-static, environment. While feasible technologies exist for vehicle localization, many are not suited for industrial settings where the vehicle must operate dependably both indoors and outdoors and in a range of lighting conditions. We extend the capabilities of an existing vision-based localization system, in a continued effort to improve the robustness, reliability and utility of an automated industrial vehicle system. The vehicle pose is estimated by comparing an edge-filtered version of a video stream to an available 3D edge map of the site. We enhance the previous system by additionally filtering the camera input for straight lines using a Hough transform, observing that the 3D environment map contains only linear features. In addition, we present an automated approach for generating 3D edge maps from laser point clouds, removing the need for manual map surveying and also reducing the time for map generation down from days to minutes. We present extensive localization results in multiple lighting conditions comparing the system with and without the proposed enhancements.

Authors

• Paulo V. K. Borges
• Robert Zlot
• Michael Bosse
• Stephen T. Nuske
• Ashley Tews

Keywords

• Data mining
• Remotely operated vehicles
• Real time systems
• Mobile robots
• Robustness
• Streaming media
• Nonlinear filters
• Filtering
• Cameras
• Clouds
• 3D Data
• Laser Ranging
• Vision-based Localization
• Light Conditions
• Local System
• Point Cloud
• Linear Features
• Hough Transform
• Vision-based System
• Time Of Day
• Environmental Characteristics
• Average Error
• Angle Difference
• Video Data
• 3D Point
• Particle Filter
• Industrial Environment
• Pose Estimation
• Adjacent Points
• 3D Point Cloud
• 3D Point Cloud Data
• Localizer
• Edge Extraction
• Point Cloud Data
• Intersection Of Planes
• Set Of Metrics
• Sufficient Number Of Points
• Survey Maps
• Industrial Sites