Feature-based Visual Odometry for Bronchoscopy: A Dataset and Benchmark

Bronchoscopy is a medical procedure that involves the insertion of a flexible tube with a camera into the airways to survey, diagnose and treat lung diseases. Due to the complex branching anatomical structure of the bronchial tree and the similarity of the inner surfaces of the segmental airways, navigation systems are now being routinely used to guide the operator during procedures to access the lung periphery. Current navigation systems rely on sensor-integrated bronchoscopes to track the position of the bronchoscope in real-time. This approach has limitations, including increased cost and limited use in non-specialized settings. To address this issue, researchers have proposed visual odometry algorithms to track the bronchoscope camera without the need for external sensors. However, due to the lack of publicly available datasets, limited progress is made. To this end, we have developed a database of bronchoscopy videos in a phantom lung model and ex-vivo human lungs. The dataset contains 34 video sequences with over 23, 000 frames with odometry ground truth data collected using electromagnetic tracking sensors. With our dataset, we empower the robotics and machine learning community to advance the field. We share our insights on challenges in endoscopic visual odometry. Furthermore, we provide benchmark results for this dataset. State-of-the-art feature extraction algorithms including SIFT, ORB, Superpoint, Shi- Tomasi, and LoFTR are tested on this dataset. The benchmark results demonstrate that the LoFTR algorithm outperforms other approaches, but still has significant errors in the presence of rapid movements and occlusions.

Authors

• Jianning Deng
• Peize Li
• Kevin Dhaliwal
• Chris Xiaoxuan Lu
• Mohsen Khadem

Keywords

• Bronchoscopy
• Machine learning algorithms
• Navigation
• Lung
• Phantoms
• Benchmark testing
• Cameras
• Visual Odometry
• Feature-based Visual Odometry
• Endoscopic
• Magnetometer
• Navigation System
• Video Sequences
• Presence Of Errors
• Vision Algorithms
• Lung Model
• Electromagnetic Tracking
• Root Mean Square Error
• Magnetic Field
• Entire Sequence
• Singular Value Decomposition
• Colonoscopy
• Feature Detection
• Consecutive Frames
• Pose Estimation
• Illumination Changes
• Simultaneous Localization And Mapping
• Use Of Donors
• Medical Robots
• Ground Truth Trajectory
• Authorization For Use
• Keypoint Detection
• Bronchoscopic Procedures
• Self-supervised Manner
• Calibration Matrix
• Perception Of The Robot
• Feature-based Approaches