TSDF-based change detection for consistent long-term dense reconstruction and dynamic object discovery

Robots that are operating for extended periods of time need to be able to deal with changes in their environment and represent them adequately in their maps. In this paper, we present a novel 3D reconstruction algorithm based on an extended Truncated Signed Distance Function (TSDF) that enables to continuously refine the static map while simultaneously obtaining 3D reconstructions of dynamic objects in the scene. This is a challenging problem because map updates happen incrementally and are often incomplete. Previous work typically performs change detection on point clouds, surfels or maps, which are not able to distinguish between unexplored and empty space. In contrast, our TSDF-based representation naturally contains this information and thus allows us to more robustly solve the scene differencing problem. We demonstrate the algorithms performance as part of a system for unsupervised object discovery and class recognition. We evaluated our algorithm on challenging datasets that we recorded over several days with RGB-D enabled tablets. To stimulate further research in this area, all of our datasets are publicly available 3.

Authors

• Marius Fehr
• Fadri Furrer
• Ivan Dryanovski
• Jürgen Sturm
• Igor Gilitschenski
• Roland Siegwart
• Cesar Cadena 0001

Keywords

• Three-dimensional displays
• Heuristic algorithms
• Robots
• Computational modeling
• Geometry
• Image reconstruction
• Detection algorithms
• Change Detection
• Dynamic Objects
• Dense Reconstruction
• 3D Reconstruction
• Point Cloud
• Object Classification
• Challenging Dataset
• Objects In The Scene
• Static Function
• Signed Distance Function
• Additional Efforts
• Depth Map
• Object Segmentation
• Camera Position
• Markov Random Field
• Robotic Platform
• Complete Overlap
• Dynamic Clustering
• Camera Pose
• Object Instances
• Change Detection Algorithm
• Candidate Objects
• Digital Radio
• Object Database
• Center Of The Room
• Scene Changes
• Occupancy Grid
• Segmental Dynamics
• Static Surface
• Sparse Map