Real-time 3D Light-field Viewing with Eye-tracking on Conventional Displays

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Pham, Trung Hieu, Tran, Chanh Minh, Kamioka, Eiji, Phan, Xuan Tan
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914001048305664
author Pham, Trung Hieu
Tran, Chanh Minh
Kamioka, Eiji
Phan, Xuan Tan
author_facet Pham, Trung Hieu
Tran, Chanh Minh
Kamioka, Eiji
Phan, Xuan Tan
contents Creating immersive 3D visual experiences typically requires expensive and specialized hardware such as VR headsets, autostereoscopic displays, or active shutter glasses. These constraints limit the accessibility and everyday use of 3D visualization technologies in resource-constrained settings. To address this, we propose a low-cost system that enables real-time 3D light-field viewing using only a standard 2D monitor, a conventional RGB webcam, and red-cyan anaglyph glasses. The system integrates real-time eye-tracking to dynamically adapt the displayed light-field image to the user's head position with a lightweight rendering pipeline that selects and composites stereoscopic views from pre-captured light-field data. The resulting anaglyph image is updated in real-time, creating a more immersive and responsive 3D experience. The system operates entirely on CPU and maintains a stable frame rate of 30 FPS, confirming its feasibility on typical consumer-grade hardware. All of these highlight the potential of our approach as an accessible platform for interactive 3D applications in education, digital media, and beyond.
format Preprint
id arxiv_https___arxiv_org_abs_2508_16535
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Real-time 3D Light-field Viewing with Eye-tracking on Conventional Displays
Pham, Trung Hieu
Tran, Chanh Minh
Kamioka, Eiji
Phan, Xuan Tan
Graphics
Human-Computer Interaction
Multimedia
Creating immersive 3D visual experiences typically requires expensive and specialized hardware such as VR headsets, autostereoscopic displays, or active shutter glasses. These constraints limit the accessibility and everyday use of 3D visualization technologies in resource-constrained settings. To address this, we propose a low-cost system that enables real-time 3D light-field viewing using only a standard 2D monitor, a conventional RGB webcam, and red-cyan anaglyph glasses. The system integrates real-time eye-tracking to dynamically adapt the displayed light-field image to the user's head position with a lightweight rendering pipeline that selects and composites stereoscopic views from pre-captured light-field data. The resulting anaglyph image is updated in real-time, creating a more immersive and responsive 3D experience. The system operates entirely on CPU and maintains a stable frame rate of 30 FPS, confirming its feasibility on typical consumer-grade hardware. All of these highlight the potential of our approach as an accessible platform for interactive 3D applications in education, digital media, and beyond.
title Real-time 3D Light-field Viewing with Eye-tracking on Conventional Displays
topic Graphics
Human-Computer Interaction
Multimedia
url https://arxiv.org/abs/2508.16535