Oblique-MERF: Revisiting and Improving MERF for Oblique Photography
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866909169820368896 |
|---|---|
| author | Zeng, Xiaoyi Song, Kaiwen Yang, Leyuan Deng, Bailin Zhang, Juyong |
| author_facet | Zeng, Xiaoyi Song, Kaiwen Yang, Leyuan Deng, Bailin Zhang, Juyong |
| contents | Neural implicit fields have established a new paradigm for scene representation, with subsequent work achieving high-quality real-time rendering. However, reconstructing 3D scenes from oblique aerial photography presents unique challenges, such as varying spatial scale distributions and a constrained range of tilt angles, often resulting in high memory consumption and reduced rendering quality at extrapolated viewpoints. In this paper, we enhance MERF to accommodate these data characteristics by introducing an innovative adaptive occupancy plane optimized during the volume rendering process and a smoothness regularization term for view-dependent color to address these issues. Our approach, termed Oblique-MERF, surpasses state-of-the-art real-time methods by approximately 0.7 dB, reduces VRAM usage by about 40%, and achieves higher rendering frame rates with more realistic rendering outcomes across most viewpoints. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_09531 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Oblique-MERF: Revisiting and Improving MERF for Oblique Photography Zeng, Xiaoyi Song, Kaiwen Yang, Leyuan Deng, Bailin Zhang, Juyong Computer Vision and Pattern Recognition Graphics Neural implicit fields have established a new paradigm for scene representation, with subsequent work achieving high-quality real-time rendering. However, reconstructing 3D scenes from oblique aerial photography presents unique challenges, such as varying spatial scale distributions and a constrained range of tilt angles, often resulting in high memory consumption and reduced rendering quality at extrapolated viewpoints. In this paper, we enhance MERF to accommodate these data characteristics by introducing an innovative adaptive occupancy plane optimized during the volume rendering process and a smoothness regularization term for view-dependent color to address these issues. Our approach, termed Oblique-MERF, surpasses state-of-the-art real-time methods by approximately 0.7 dB, reduces VRAM usage by about 40%, and achieves higher rendering frame rates with more realistic rendering outcomes across most viewpoints. |
| title | Oblique-MERF: Revisiting and Improving MERF for Oblique Photography |
| topic | Computer Vision and Pattern Recognition Graphics |
| url | https://arxiv.org/abs/2404.09531 |