NoPe-NeRF++: Local-to-Global Optimization of NeRF with No Pose Prior
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866914166535618560 |
|---|---|
| author | Shi, Dongbo Cao, Shen Wu, Bojian Guo, Jinhui Fan, Lubin Chen, Renjie Liu, Ligang Ye, Jieping |
| author_facet | Shi, Dongbo Cao, Shen Wu, Bojian Guo, Jinhui Fan, Lubin Chen, Renjie Liu, Ligang Ye, Jieping |
| contents | In this paper, we introduce NoPe-NeRF++, a novel local-to-global optimization algorithm for training Neural Radiance Fields (NeRF) without requiring pose priors. Existing methods, particularly NoPe-NeRF, which focus solely on the local relationships within images, often struggle to recover accurate camera poses in complex scenarios. To overcome the challenges, our approach begins with a relative pose initialization with explicit feature matching, followed by a local joint optimization to enhance the pose estimation for training a more robust NeRF representation. This method significantly improves the quality of initial poses. Additionally, we introduce global optimization phase that incorporates geometric consistency constraints through bundle adjustment, which integrates feature trajectories to further refine poses and collectively boost the quality of NeRF. Notably, our method is the first work that seamlessly combines the local and global cues with NeRF, and outperforms state-of-the-art methods in both pose estimation accuracy and novel view synthesis. Extensive evaluations on benchmark datasets demonstrate our superior performance and robustness, even in challenging scenes, thus validating our design choices. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_17322 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | NoPe-NeRF++: Local-to-Global Optimization of NeRF with No Pose Prior Shi, Dongbo Cao, Shen Wu, Bojian Guo, Jinhui Fan, Lubin Chen, Renjie Liu, Ligang Ye, Jieping Computer Vision and Pattern Recognition In this paper, we introduce NoPe-NeRF++, a novel local-to-global optimization algorithm for training Neural Radiance Fields (NeRF) without requiring pose priors. Existing methods, particularly NoPe-NeRF, which focus solely on the local relationships within images, often struggle to recover accurate camera poses in complex scenarios. To overcome the challenges, our approach begins with a relative pose initialization with explicit feature matching, followed by a local joint optimization to enhance the pose estimation for training a more robust NeRF representation. This method significantly improves the quality of initial poses. Additionally, we introduce global optimization phase that incorporates geometric consistency constraints through bundle adjustment, which integrates feature trajectories to further refine poses and collectively boost the quality of NeRF. Notably, our method is the first work that seamlessly combines the local and global cues with NeRF, and outperforms state-of-the-art methods in both pose estimation accuracy and novel view synthesis. Extensive evaluations on benchmark datasets demonstrate our superior performance and robustness, even in challenging scenes, thus validating our design choices. |
| title | NoPe-NeRF++: Local-to-Global Optimization of NeRF with No Pose Prior |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2511.17322 |