Parameter-Free Neural Lens Blur Rendering for High-Fidelity Composites

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Ruan, Lingyan, Chen, Bin, Rhee, Taehyun
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866915629858029568
author Ruan, Lingyan
Chen, Bin
Rhee, Taehyun
author_facet Ruan, Lingyan
Chen, Bin
Rhee, Taehyun
contents Consistent and natural camera lens blur is important for seamlessly blending 3D virtual objects into photographed real-scenes. Since lens blur typically varies with scene depth, the placement of virtual objects and their corresponding blur levels significantly affect the visual fidelity of mixed reality compositions. Existing pipelines often rely on camera parameters (e.g., focal length, focus distance, aperture size) and scene depth to compute the circle of confusion (CoC) for realistic lens blur rendering. However, such information is often unavailable to ordinary users, limiting the accessibility and generalizability of these methods. In this work, we propose a novel compositing approach that directly estimates the CoC map from RGB images, bypassing the need for scene depth or camera metadata. The CoC values for virtual objects are inferred through a linear relationship between its signed CoC map and depth, and realistic lens blur is rendered using a neural reblurring network. Our method provides flexible and practical solution for real-world applications. Experimental results demonstrate that our method achieves high-fidelity compositing with realistic defocus effects, outperforming state-of-the-art techniques in both qualitative and quantitative evaluations.
format Preprint
id arxiv_https___arxiv_org_abs_2511_17014
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Parameter-Free Neural Lens Blur Rendering for High-Fidelity Composites
Ruan, Lingyan
Chen, Bin
Rhee, Taehyun
Computer Vision and Pattern Recognition
Artificial Intelligence
Graphics
Image and Video Processing
Consistent and natural camera lens blur is important for seamlessly blending 3D virtual objects into photographed real-scenes. Since lens blur typically varies with scene depth, the placement of virtual objects and their corresponding blur levels significantly affect the visual fidelity of mixed reality compositions. Existing pipelines often rely on camera parameters (e.g., focal length, focus distance, aperture size) and scene depth to compute the circle of confusion (CoC) for realistic lens blur rendering. However, such information is often unavailable to ordinary users, limiting the accessibility and generalizability of these methods. In this work, we propose a novel compositing approach that directly estimates the CoC map from RGB images, bypassing the need for scene depth or camera metadata. The CoC values for virtual objects are inferred through a linear relationship between its signed CoC map and depth, and realistic lens blur is rendered using a neural reblurring network. Our method provides flexible and practical solution for real-world applications. Experimental results demonstrate that our method achieves high-fidelity compositing with realistic defocus effects, outperforming state-of-the-art techniques in both qualitative and quantitative evaluations.
title Parameter-Free Neural Lens Blur Rendering for High-Fidelity Composites
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Graphics
Image and Video Processing
url https://arxiv.org/abs/2511.17014