Hybrid Foveated Path Tracing with Peripheral Gaussians for Immersive Anatomy
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866908798459838464 |
|---|---|
| author | Kleinbeck, Constantin Theelke, Luisa Schieber, Hannah Eck, Ulrich von Eisenhart-Rothe, Rüdiger Roth, Daniel |
| author_facet | Kleinbeck, Constantin Theelke, Luisa Schieber, Hannah Eck, Ulrich von Eisenhart-Rothe, Rüdiger Roth, Daniel |
| contents | Volumetric medical imaging offers great potential for understanding complex pathologies. Yet, traditional 2D slices provide little support for interpreting spatial relationships, forcing users to mentally reconstruct anatomy into three dimensions. Direct volumetric path tracing and VR rendering can improve perception but are computationally expensive, while precomputed representations, like Gaussian Splatting, require planning ahead. Both approaches limit interactive use.
We propose a hybrid rendering approach for high-quality, interactive, and immersive anatomical visualization. Our method combines streamed foveated path tracing with a lightweight Gaussian Splatting approximation of the periphery. The peripheral model generation is optimized with volume data and continuously refined using foveal renderings, enabling interactive updates. Depth-guided reprojection further improves robustness to latency and allows users to balance fidelity with refresh rate.
We compare our method against direct path tracing and Gaussian Splatting. Our results highlight how their combination can preserve strengths in visual quality while re-generating the peripheral model in under a second, eliminating extensive preprocessing and approximations. This opens new options for interactive medical visualization. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_22026 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Hybrid Foveated Path Tracing with Peripheral Gaussians for Immersive Anatomy Kleinbeck, Constantin Theelke, Luisa Schieber, Hannah Eck, Ulrich von Eisenhart-Rothe, Rüdiger Roth, Daniel Graphics Computer Vision and Pattern Recognition Volumetric medical imaging offers great potential for understanding complex pathologies. Yet, traditional 2D slices provide little support for interpreting spatial relationships, forcing users to mentally reconstruct anatomy into three dimensions. Direct volumetric path tracing and VR rendering can improve perception but are computationally expensive, while precomputed representations, like Gaussian Splatting, require planning ahead. Both approaches limit interactive use. We propose a hybrid rendering approach for high-quality, interactive, and immersive anatomical visualization. Our method combines streamed foveated path tracing with a lightweight Gaussian Splatting approximation of the periphery. The peripheral model generation is optimized with volume data and continuously refined using foveal renderings, enabling interactive updates. Depth-guided reprojection further improves robustness to latency and allows users to balance fidelity with refresh rate. We compare our method against direct path tracing and Gaussian Splatting. Our results highlight how their combination can preserve strengths in visual quality while re-generating the peripheral model in under a second, eliminating extensive preprocessing and approximations. This opens new options for interactive medical visualization. |
| title | Hybrid Foveated Path Tracing with Peripheral Gaussians for Immersive Anatomy |
| topic | Graphics Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2601.22026 |