DehazeGS: Seeing Through Fog with 3D Gaussian Splatting

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Yu, Jinze, Wang, Yiqun, Jiang, Aiheng, Lu, Zhengda, Guo, Jianwei, Li, Yong, Qin, Hongxing, Zhang, Xiaopeng
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866918226507595776
author Yu, Jinze
Wang, Yiqun
Jiang, Aiheng
Lu, Zhengda
Guo, Jianwei
Li, Yong
Qin, Hongxing
Zhang, Xiaopeng
author_facet Yu, Jinze
Wang, Yiqun
Jiang, Aiheng
Lu, Zhengda
Guo, Jianwei
Li, Yong
Qin, Hongxing
Zhang, Xiaopeng
contents Current novel view synthesis methods are typically designed for high-quality and clean input images. However, in foggy scenes, scattering and attenuation can significantly degrade the quality of rendering. Although NeRF-based dehazing approaches have been developed, their reliance on deep fully connected neural networks and per-ray sampling strategies leads to high computational costs. Furthermore, NeRF's implicit representation limits its ability to recover fine-grained details from hazy scenes. To overcome these limitations, we propose learning an explicit Gaussian representation to explain the formation mechanism of foggy images through a physically forward rendering process. Our method, DehazeGS, reconstructs and renders fog-free scenes using only multi-view foggy images as input. Specifically, based on the atmospheric scattering model, we simulate the formation of fog by establishing the transmission function directly onto Gaussian primitives via depth-to-transmission mapping. During training, we jointly learn the atmospheric light and scattering coefficients while optimizing the Gaussian representation of foggy scenes. At inference time, we remove the effects of scattering and attenuation in Gaussian distributions and directly render the scene to obtain dehazed views. Experiments on both real-world and synthetic foggy datasets demonstrate that DehazeGS achieves state-of-the-art performance. visualizations are available at https://dehazegs.github.io/
format Preprint
id arxiv_https___arxiv_org_abs_2501_03659
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle DehazeGS: Seeing Through Fog with 3D Gaussian Splatting
Yu, Jinze
Wang, Yiqun
Jiang, Aiheng
Lu, Zhengda
Guo, Jianwei
Li, Yong
Qin, Hongxing
Zhang, Xiaopeng
Computer Vision and Pattern Recognition
Current novel view synthesis methods are typically designed for high-quality and clean input images. However, in foggy scenes, scattering and attenuation can significantly degrade the quality of rendering. Although NeRF-based dehazing approaches have been developed, their reliance on deep fully connected neural networks and per-ray sampling strategies leads to high computational costs. Furthermore, NeRF's implicit representation limits its ability to recover fine-grained details from hazy scenes. To overcome these limitations, we propose learning an explicit Gaussian representation to explain the formation mechanism of foggy images through a physically forward rendering process. Our method, DehazeGS, reconstructs and renders fog-free scenes using only multi-view foggy images as input. Specifically, based on the atmospheric scattering model, we simulate the formation of fog by establishing the transmission function directly onto Gaussian primitives via depth-to-transmission mapping. During training, we jointly learn the atmospheric light and scattering coefficients while optimizing the Gaussian representation of foggy scenes. At inference time, we remove the effects of scattering and attenuation in Gaussian distributions and directly render the scene to obtain dehazed views. Experiments on both real-world and synthetic foggy datasets demonstrate that DehazeGS achieves state-of-the-art performance. visualizations are available at https://dehazegs.github.io/
title DehazeGS: Seeing Through Fog with 3D Gaussian Splatting
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2501.03659