TriHelper: Zero-Shot Object Navigation with Dynamic Assistance

Navigating toward specific objects in unknown environments without additional training, known as Zero-Shot object navigation, poses a significant challenge in the field of robotics, which demands high levels of auxiliary information and strategic planning. Traditional works have focused on holistic solutions, overlooking the specific challenges agents encounter during navigation such as collision, low exploration efficiency, and misidentification of targets. To address these challenges, our work proposes TriHelper, a novel framework designed to assist agents dynamically through three primary navigation challenges: collision, exploration, and detection. Specifically, our framework consists of three innovative components: (i) Collision Helper, (ii) Exploration Helper, and (iii) Detection Helper. These components work collaboratively to solve these challenges throughout the navigation process. Experiments on the Habitat-Matterport 3D (HM3D) and Gibson datasets demonstrate that TriHelper significantly outperforms all existing baseline methods in Zero-Shot object navigation, showcasing superior success rates and exploration efficiency. Our ablation studies further underscore the effectiveness of each helper in addressing their respective challenges, notably enhancing the agent’s navigation capabilities. By proposing TriHelper, we offer a fresh perspective on advancing the object navigation task, paving the way for future research in the domain of Embodied AI and visual-based navigation.

Authors

• Lingfeng Zhang
• Qiang Zhang 0029
• Hao Wang
• Erjia Xiao
• Zixuan Jiang
• Honglei Chen
• Renjing Xu

Keywords

• Training
• Three-dimensional displays
• Accuracy
• Navigation
• Strategic planning
• Autonomous agents
• Collision avoidance
• Artificial intelligence
• Intelligent robots
• Floors
• Object Navigation
• Unknown Environment
• Navigation Task
• Time Step
• Frontier
• Current Position
• Shortest Path
• Point Cloud
• Local Policy
• Long-term Goals
• Semantic Segmentation
• Target Object
• Global Policy
• Shortest Path Length
• Machine Vision
• Semantic Map
• Imitation Learning
• End Of Episode
• RGB-D Images
• Destination Point
• False Targets
• Dynamic Policy
• Improve Success Rates
• RGB Images
• Scene Dataset
• Path Length
• Language Model
• Accuracy Of Target Detection