Generating Synthetic Stereo Datasets using 3D Gaussian Splatting and Expert Knowledge Transfer
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909639336001536 |
|---|---|
| author | Slezak, Filip Gjerde, Magnus K. Haurum, Joakim B. Nikolov, Ivan Laursen, Morten S. Moeslund, Thomas B. |
| author_facet | Slezak, Filip Gjerde, Magnus K. Haurum, Joakim B. Nikolov, Ivan Laursen, Morten S. Moeslund, Thomas B. |
| contents | In this paper, we introduce a 3D Gaussian Splatting (3DGS)-based pipeline for stereo dataset generation, offering an efficient alternative to Neural Radiance Fields (NeRF)-based methods. To obtain useful geometry estimates, we explore utilizing the reconstructed geometry from the explicit 3D representations as well as depth estimates from the FoundationStereo model in an expert knowledge transfer setup. We find that when fine-tuning stereo models on 3DGS-generated datasets, we demonstrate competitive performance in zero-shot generalization benchmarks. When using the reconstructed geometry directly, we observe that it is often noisy and contains artifacts, which propagate noise to the trained model. In contrast, we find that the disparity estimates from FoundationStereo are cleaner and consequently result in a better performance on the zero-shot generalization benchmarks. Our method highlights the potential for low-cost, high-fidelity dataset creation and fast fine-tuning for deep stereo models. Moreover, we also reveal that while the latest Gaussian Splatting based methods have achieved superior performance on established benchmarks, their robustness falls short in challenging in-the-wild settings warranting further exploration. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_04908 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Generating Synthetic Stereo Datasets using 3D Gaussian Splatting and Expert Knowledge Transfer Slezak, Filip Gjerde, Magnus K. Haurum, Joakim B. Nikolov, Ivan Laursen, Morten S. Moeslund, Thomas B. Computer Vision and Pattern Recognition In this paper, we introduce a 3D Gaussian Splatting (3DGS)-based pipeline for stereo dataset generation, offering an efficient alternative to Neural Radiance Fields (NeRF)-based methods. To obtain useful geometry estimates, we explore utilizing the reconstructed geometry from the explicit 3D representations as well as depth estimates from the FoundationStereo model in an expert knowledge transfer setup. We find that when fine-tuning stereo models on 3DGS-generated datasets, we demonstrate competitive performance in zero-shot generalization benchmarks. When using the reconstructed geometry directly, we observe that it is often noisy and contains artifacts, which propagate noise to the trained model. In contrast, we find that the disparity estimates from FoundationStereo are cleaner and consequently result in a better performance on the zero-shot generalization benchmarks. Our method highlights the potential for low-cost, high-fidelity dataset creation and fast fine-tuning for deep stereo models. Moreover, we also reveal that while the latest Gaussian Splatting based methods have achieved superior performance on established benchmarks, their robustness falls short in challenging in-the-wild settings warranting further exploration. |
| title | Generating Synthetic Stereo Datasets using 3D Gaussian Splatting and Expert Knowledge Transfer |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2506.04908 |