DoF-Gaussian: Controllable Depth-of-Field for 3D Gaussian Splatting

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Shen, Liao, Liu, Tianqi, Sun, Huiqiang, Li, Jiaqi, Cao, Zhiguo, Li, Wei, Loy, Chen Change
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929756894658560
author Shen, Liao
Liu, Tianqi
Sun, Huiqiang
Li, Jiaqi
Cao, Zhiguo
Li, Wei
Loy, Chen Change
author_facet Shen, Liao
Liu, Tianqi
Sun, Huiqiang
Li, Jiaqi
Cao, Zhiguo
Li, Wei
Loy, Chen Change
contents Recent advances in 3D Gaussian Splatting (3D-GS) have shown remarkable success in representing 3D scenes and generating high-quality, novel views in real-time. However, 3D-GS and its variants assume that input images are captured based on pinhole imaging and are fully in focus. This assumption limits their applicability, as real-world images often feature shallow depth-of-field (DoF). In this paper, we introduce DoF-Gaussian, a controllable depth-of-field method for 3D-GS. We develop a lens-based imaging model based on geometric optics principles to control DoF effects. To ensure accurate scene geometry, we incorporate depth priors adjusted per scene, and we apply defocus-to-focus adaptation to minimize the gap in the circle of confusion. We also introduce a synthetic dataset to assess refocusing capabilities and the model's ability to learn precise lens parameters. Our framework is customizable and supports various interactive applications. Extensive experiments confirm the effectiveness of our method. Our project is available at https://dof-gaussian.github.io.
format Preprint
id arxiv_https___arxiv_org_abs_2503_00746
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle DoF-Gaussian: Controllable Depth-of-Field for 3D Gaussian Splatting
Shen, Liao
Liu, Tianqi
Sun, Huiqiang
Li, Jiaqi
Cao, Zhiguo
Li, Wei
Loy, Chen Change
Computer Vision and Pattern Recognition
Recent advances in 3D Gaussian Splatting (3D-GS) have shown remarkable success in representing 3D scenes and generating high-quality, novel views in real-time. However, 3D-GS and its variants assume that input images are captured based on pinhole imaging and are fully in focus. This assumption limits their applicability, as real-world images often feature shallow depth-of-field (DoF). In this paper, we introduce DoF-Gaussian, a controllable depth-of-field method for 3D-GS. We develop a lens-based imaging model based on geometric optics principles to control DoF effects. To ensure accurate scene geometry, we incorporate depth priors adjusted per scene, and we apply defocus-to-focus adaptation to minimize the gap in the circle of confusion. We also introduce a synthetic dataset to assess refocusing capabilities and the model's ability to learn precise lens parameters. Our framework is customizable and supports various interactive applications. Extensive experiments confirm the effectiveness of our method. Our project is available at https://dof-gaussian.github.io.
title DoF-Gaussian: Controllable Depth-of-Field for 3D Gaussian Splatting
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.00746