Robust self-supervised monocular visual odometry based on prediction-update pose estimation network

Visual odometry aims at estimating the camera pose from video sequence, which is an important part of visual Simultaneous Localization and Mapping (SLAM). In this paper, we propose a novel prediction-update pose estimation network, PU-PoseNet, for self-supervised monocular visual odometry. It allows the network to use the effective information of the previous frame in estimating the current pose. The long-time pose consistency constraint-based motion weighted photometric loss is designed to make the network to pay more attention to the pixels of stationary objects and enhance the time consistency of estimation results. The depth image-based occlusion detection, the depth smoothness loss and auto-Masking are used to construct the depth consistency constraint loss term to reduce the influences of interferences such as occlusion. To further improve the robustness and the accuracy of the proposed method, both the depth consistency constraint and the variational auto-encoder are used for network training. For frame missing cases, a novel frame missing training strategy is used to make our method adapt frame missing cases. Extensive experiments on the KITTI dataset have validated the effectiveness of our proposed method.

Authors

• Haixin Xiu
• Yiyou Liang
• Hui Zeng Southwest University of Science and Technology Guangan institute of technology
• Qing Li The Hong Kong Polytechnic University
• Hongmin Liu University of Science and Technology Beijing
• Bin Fan School of Intelligence Science and Technology, University of Science and Technology, Beijing
• Chen Li College of Computer Science and Technology, Zhejiang Normal University, Zhejiang, 311231, China Research Institute of Hangzhou Artificial Intelligence, Zhejiang Normal University, Hangzhou, Zhejiang, 311231, China

Keywords

• Monocular visual odometry
• Deep learning
• Pose estimation
• Depth estimation