Exploiting Priors from 3D Diffusion Models for RGB-Based One-Shot View Planning
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866914949062721536 |
|---|---|
| author | Pan, Sicong Jin, Liren Huang, Xuying Stachniss, Cyrill Popović, Marija Bennewitz, Maren |
| author_facet | Pan, Sicong Jin, Liren Huang, Xuying Stachniss, Cyrill Popović, Marija Bennewitz, Maren |
| contents | Object reconstruction is relevant for many autonomous robotic tasks that require interaction with the environment. A key challenge in such scenarios is planning view configurations to collect informative measurements for reconstructing an initially unknown object. One-shot view planning enables efficient data collection by predicting view configurations and planning the globally shortest path connecting all views at once. However, prior knowledge about the object is required to conduct one-shot view planning. In this work, we propose a novel one-shot view planning approach that utilizes the powerful 3D generation capabilities of diffusion models as priors. By incorporating such geometric priors into our pipeline, we achieve effective one-shot view planning starting with only a single RGB image of the object to be reconstructed. Our planning experiments in simulation and real-world setups indicate that our approach balances well between object reconstruction quality and movement cost. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_16803 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Exploiting Priors from 3D Diffusion Models for RGB-Based One-Shot View Planning Pan, Sicong Jin, Liren Huang, Xuying Stachniss, Cyrill Popović, Marija Bennewitz, Maren Robotics Computer Vision and Pattern Recognition Object reconstruction is relevant for many autonomous robotic tasks that require interaction with the environment. A key challenge in such scenarios is planning view configurations to collect informative measurements for reconstructing an initially unknown object. One-shot view planning enables efficient data collection by predicting view configurations and planning the globally shortest path connecting all views at once. However, prior knowledge about the object is required to conduct one-shot view planning. In this work, we propose a novel one-shot view planning approach that utilizes the powerful 3D generation capabilities of diffusion models as priors. By incorporating such geometric priors into our pipeline, we achieve effective one-shot view planning starting with only a single RGB image of the object to be reconstructed. Our planning experiments in simulation and real-world setups indicate that our approach balances well between object reconstruction quality and movement cost. |
| title | Exploiting Priors from 3D Diffusion Models for RGB-Based One-Shot View Planning |
| topic | Robotics Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2403.16803 |