REFRAME: Reflective Surface Real-Time Rendering for Mobile Devices

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Ji, Chaojie, Li, Yufeng, Liao, Yiyi
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929459685228544
author Ji, Chaojie
Li, Yufeng
Liao, Yiyi
author_facet Ji, Chaojie
Li, Yufeng
Liao, Yiyi
contents This work tackles the challenging task of achieving real-time novel view synthesis for reflective surfaces across various scenes. Existing real-time rendering methods, especially those based on meshes, often have subpar performance in modeling surfaces with rich view-dependent appearances. Our key idea lies in leveraging meshes for rendering acceleration while incorporating a novel approach to parameterize view-dependent information. We decompose the color into diffuse and specular, and model the specular color in the reflected direction based on a neural environment map. Our experiments demonstrate that our method achieves comparable reconstruction quality for highly reflective surfaces compared to state-of-the-art offline methods, while also efficiently enabling real-time rendering on edge devices such as smartphones.
format Preprint
id arxiv_https___arxiv_org_abs_2403_16481
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle REFRAME: Reflective Surface Real-Time Rendering for Mobile Devices
Ji, Chaojie
Li, Yufeng
Liao, Yiyi
Computer Vision and Pattern Recognition
This work tackles the challenging task of achieving real-time novel view synthesis for reflective surfaces across various scenes. Existing real-time rendering methods, especially those based on meshes, often have subpar performance in modeling surfaces with rich view-dependent appearances. Our key idea lies in leveraging meshes for rendering acceleration while incorporating a novel approach to parameterize view-dependent information. We decompose the color into diffuse and specular, and model the specular color in the reflected direction based on a neural environment map. Our experiments demonstrate that our method achieves comparable reconstruction quality for highly reflective surfaces compared to state-of-the-art offline methods, while also efficiently enabling real-time rendering on edge devices such as smartphones.
title REFRAME: Reflective Surface Real-Time Rendering for Mobile Devices
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2403.16481