PIG-Nav: Key Insights for Pretrained Image Goal Navigation Models
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866911072592592896 |
|---|---|
| author | Wan, Jiansong Zhou, Chengming Liu, Jinkua Huang, Xiangge Chen, Xiaoyu Yi, Xiaohan Yang, Qisen Zhu, Baiting Cai, Xin-Qiang Liu, Lixing Yang, Rushuai Zhang, Chuheng Abdelfattah, Sherif Shin, Hayong Zhang, Pushi Zhao, Li Bian, Jiang |
| author_facet | Wan, Jiansong Zhou, Chengming Liu, Jinkua Huang, Xiangge Chen, Xiaoyu Yi, Xiaohan Yang, Qisen Zhu, Baiting Cai, Xin-Qiang Liu, Lixing Yang, Rushuai Zhang, Chuheng Abdelfattah, Sherif Shin, Hayong Zhang, Pushi Zhao, Li Bian, Jiang |
| contents | Recent studies have explored pretrained (foundation) models for vision-based robotic navigation, aiming to achieve generalizable navigation and positive transfer across diverse environments while enhancing zero-shot performance in unseen settings. In this work, we introduce PIG-Nav (Pretrained Image-Goal Navigation), a new approach that further investigates pretraining strategies for vision-based navigation models and contributes in two key areas. Model-wise, we identify two critical design choices that consistently improve the performance of pretrained navigation models: (1) integrating an early-fusion network structure to combine visual observations and goal images via appropriately pretrained Vision Transformer (ViT) image encoder, and (2) introducing suitable auxiliary tasks to enhance global navigation representation learning, thus further improving navigation performance. Dataset-wise, we propose a novel data preprocessing pipeline for efficiently labeling large-scale game video datasets for navigation model training. We demonstrate that augmenting existing open navigation datasets with diverse gameplay videos improves model performance. Our model achieves an average improvement of 22.6% in zero-shot settings and a 37.5% improvement in fine-tuning settings over existing visual navigation foundation models in two complex simulated environments and one real-world environment. These results advance the state-of-the-art in pretrained image-goal navigation models. Notably, our model maintains competitive performance while requiring significantly less fine-tuning data, highlighting its potential for real-world deployment with minimal labeled supervision. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_17220 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | PIG-Nav: Key Insights for Pretrained Image Goal Navigation Models Wan, Jiansong Zhou, Chengming Liu, Jinkua Huang, Xiangge Chen, Xiaoyu Yi, Xiaohan Yang, Qisen Zhu, Baiting Cai, Xin-Qiang Liu, Lixing Yang, Rushuai Zhang, Chuheng Abdelfattah, Sherif Shin, Hayong Zhang, Pushi Zhao, Li Bian, Jiang Computer Vision and Pattern Recognition Robotics Recent studies have explored pretrained (foundation) models for vision-based robotic navigation, aiming to achieve generalizable navigation and positive transfer across diverse environments while enhancing zero-shot performance in unseen settings. In this work, we introduce PIG-Nav (Pretrained Image-Goal Navigation), a new approach that further investigates pretraining strategies for vision-based navigation models and contributes in two key areas. Model-wise, we identify two critical design choices that consistently improve the performance of pretrained navigation models: (1) integrating an early-fusion network structure to combine visual observations and goal images via appropriately pretrained Vision Transformer (ViT) image encoder, and (2) introducing suitable auxiliary tasks to enhance global navigation representation learning, thus further improving navigation performance. Dataset-wise, we propose a novel data preprocessing pipeline for efficiently labeling large-scale game video datasets for navigation model training. We demonstrate that augmenting existing open navigation datasets with diverse gameplay videos improves model performance. Our model achieves an average improvement of 22.6% in zero-shot settings and a 37.5% improvement in fine-tuning settings over existing visual navigation foundation models in two complex simulated environments and one real-world environment. These results advance the state-of-the-art in pretrained image-goal navigation models. Notably, our model maintains competitive performance while requiring significantly less fine-tuning data, highlighting its potential for real-world deployment with minimal labeled supervision. |
| title | PIG-Nav: Key Insights for Pretrained Image Goal Navigation Models |
| topic | Computer Vision and Pattern Recognition Robotics |
| url | https://arxiv.org/abs/2507.17220 |