Horizon-GS: Unified 3D Gaussian Splatting for Large-Scale Aerial-to-Ground Scenes

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Jiang, Lihan, Ren, Kerui, Yu, Mulin, Xu, Linning, Dong, Junting, Lu, Tao, Zhao, Feng, Lin, Dahua, Dai, Bo
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929610712678400
author Jiang, Lihan
Ren, Kerui
Yu, Mulin
Xu, Linning
Dong, Junting
Lu, Tao
Zhao, Feng
Lin, Dahua
Dai, Bo
author_facet Jiang, Lihan
Ren, Kerui
Yu, Mulin
Xu, Linning
Dong, Junting
Lu, Tao
Zhao, Feng
Lin, Dahua
Dai, Bo
contents Seamless integration of both aerial and street view images remains a significant challenge in neural scene reconstruction and rendering. Existing methods predominantly focus on single domain, limiting their applications in immersive environments, which demand extensive free view exploration with large view changes both horizontally and vertically. We introduce Horizon-GS, a novel approach built upon Gaussian Splatting techniques, tackles the unified reconstruction and rendering for aerial and street views. Our method addresses the key challenges of combining these perspectives with a new training strategy, overcoming viewpoint discrepancies to generate high-fidelity scenes. We also curate a high-quality aerial-to-ground views dataset encompassing both synthetic and real-world scene to advance further research. Experiments across diverse urban scene datasets confirm the effectiveness of our method.
format Preprint
id arxiv_https___arxiv_org_abs_2412_01745
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Horizon-GS: Unified 3D Gaussian Splatting for Large-Scale Aerial-to-Ground Scenes
Jiang, Lihan
Ren, Kerui
Yu, Mulin
Xu, Linning
Dong, Junting
Lu, Tao
Zhao, Feng
Lin, Dahua
Dai, Bo
Computer Vision and Pattern Recognition
Seamless integration of both aerial and street view images remains a significant challenge in neural scene reconstruction and rendering. Existing methods predominantly focus on single domain, limiting their applications in immersive environments, which demand extensive free view exploration with large view changes both horizontally and vertically. We introduce Horizon-GS, a novel approach built upon Gaussian Splatting techniques, tackles the unified reconstruction and rendering for aerial and street views. Our method addresses the key challenges of combining these perspectives with a new training strategy, overcoming viewpoint discrepancies to generate high-fidelity scenes. We also curate a high-quality aerial-to-ground views dataset encompassing both synthetic and real-world scene to advance further research. Experiments across diverse urban scene datasets confirm the effectiveness of our method.
title Horizon-GS: Unified 3D Gaussian Splatting for Large-Scale Aerial-to-Ground Scenes
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2412.01745