Real-time 3D Visualization of Radiance Fields on Light Field Displays

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kim, Jonghyun, Sun, Cheng, Stengel, Michael, Chan, Matthew, Russell, Andrew, Jung, Jaehyun, Braithwaite, Wil, De Mello, Shalini, Luebke, David
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908503703027712
author Kim, Jonghyun
Sun, Cheng
Stengel, Michael
Chan, Matthew
Russell, Andrew
Jung, Jaehyun
Braithwaite, Wil
De Mello, Shalini
Luebke, David
author_facet Kim, Jonghyun
Sun, Cheng
Stengel, Michael
Chan, Matthew
Russell, Andrew
Jung, Jaehyun
Braithwaite, Wil
De Mello, Shalini
Luebke, David
contents Radiance fields have revolutionized photo-realistic 3D scene visualization by enabling high-fidelity reconstruction of complex environments, making them an ideal match for light field displays. However, integrating these technologies presents significant computational challenges, as light field displays require multiple high-resolution renderings from slightly shifted viewpoints, while radiance fields rely on computationally intensive volume rendering. In this paper, we propose a unified and efficient framework for real-time radiance field rendering on light field displays. Our method supports a wide range of radiance field representations, including NeRFs, 3D Gaussian Splatting, and Sparse Voxels, within a shared architecture based on a single-pass plane sweeping strategy and caching of shared, non-directional components. The framework generalizes across different scene formats without retraining, and avoids redundant computation across views. We further demonstrate a real-time interactive application on a Looking Glass display, achieving 200+ FPS at 512p across 45 views, enabling seamless, immersive 3D interaction. On standard benchmarks, our method achieves up to 22x speedup compared to independently rendering each view, while preserving image quality.
format Preprint
id arxiv_https___arxiv_org_abs_2508_18540
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Real-time 3D Visualization of Radiance Fields on Light Field Displays
Kim, Jonghyun
Sun, Cheng
Stengel, Michael
Chan, Matthew
Russell, Andrew
Jung, Jaehyun
Braithwaite, Wil
De Mello, Shalini
Luebke, David
Graphics
Image and Video Processing
Radiance fields have revolutionized photo-realistic 3D scene visualization by enabling high-fidelity reconstruction of complex environments, making them an ideal match for light field displays. However, integrating these technologies presents significant computational challenges, as light field displays require multiple high-resolution renderings from slightly shifted viewpoints, while radiance fields rely on computationally intensive volume rendering. In this paper, we propose a unified and efficient framework for real-time radiance field rendering on light field displays. Our method supports a wide range of radiance field representations, including NeRFs, 3D Gaussian Splatting, and Sparse Voxels, within a shared architecture based on a single-pass plane sweeping strategy and caching of shared, non-directional components. The framework generalizes across different scene formats without retraining, and avoids redundant computation across views. We further demonstrate a real-time interactive application on a Looking Glass display, achieving 200+ FPS at 512p across 45 views, enabling seamless, immersive 3D interaction. On standard benchmarks, our method achieves up to 22x speedup compared to independently rendering each view, while preserving image quality.
title Real-time 3D Visualization of Radiance Fields on Light Field Displays
topic Graphics
Image and Video Processing
url https://arxiv.org/abs/2508.18540