Scene Coordinate Reconstruction: Posing of Image Collections via Incremental Learning of a Relocalizer
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866910542933786624 |
|---|---|
| author | Brachmann, Eric Wynn, Jamie Chen, Shuai Cavallari, Tommaso Monszpart, Áron Turmukhambetov, Daniyar Prisacariu, Victor Adrian |
| author_facet | Brachmann, Eric Wynn, Jamie Chen, Shuai Cavallari, Tommaso Monszpart, Áron Turmukhambetov, Daniyar Prisacariu, Victor Adrian |
| contents | We address the task of estimating camera parameters from a set of images depicting a scene. Popular feature-based structure-from-motion (SfM) tools solve this task by incremental reconstruction: they repeat triangulation of sparse 3D points and registration of more camera views to the sparse point cloud. We re-interpret incremental structure-from-motion as an iterated application and refinement of a visual relocalizer, that is, of a method that registers new views to the current state of the reconstruction. This perspective allows us to investigate alternative visual relocalizers that are not rooted in local feature matching. We show that scene coordinate regression, a learning-based relocalization approach, allows us to build implicit, neural scene representations from unposed images. Different from other learning-based reconstruction methods, we do not require pose priors nor sequential inputs, and we optimize efficiently over thousands of images. In many cases, our method, ACE0, estimates camera poses with an accuracy close to feature-based SfM, as demonstrated by novel view synthesis. Project page: https://nianticlabs.github.io/acezero/ |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_14351 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Scene Coordinate Reconstruction: Posing of Image Collections via Incremental Learning of a Relocalizer Brachmann, Eric Wynn, Jamie Chen, Shuai Cavallari, Tommaso Monszpart, Áron Turmukhambetov, Daniyar Prisacariu, Victor Adrian Computer Vision and Pattern Recognition We address the task of estimating camera parameters from a set of images depicting a scene. Popular feature-based structure-from-motion (SfM) tools solve this task by incremental reconstruction: they repeat triangulation of sparse 3D points and registration of more camera views to the sparse point cloud. We re-interpret incremental structure-from-motion as an iterated application and refinement of a visual relocalizer, that is, of a method that registers new views to the current state of the reconstruction. This perspective allows us to investigate alternative visual relocalizers that are not rooted in local feature matching. We show that scene coordinate regression, a learning-based relocalization approach, allows us to build implicit, neural scene representations from unposed images. Different from other learning-based reconstruction methods, we do not require pose priors nor sequential inputs, and we optimize efficiently over thousands of images. In many cases, our method, ACE0, estimates camera poses with an accuracy close to feature-based SfM, as demonstrated by novel view synthesis. Project page: https://nianticlabs.github.io/acezero/ |
| title | Scene Coordinate Reconstruction: Posing of Image Collections via Incremental Learning of a Relocalizer |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2404.14351 |