EBAD-Gaussian: Event-driven Bundle Adjusted Deblur Gaussian Splatting

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Deng, Yufei, Wang, Yuanjian, Xiao, Rong, Tang, Chenwei, Zhou, Jizhe, Fan, Jiahao, Xiong, Deng, Lv, Jiancheng, Tang, Huajin
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913938243846144
author Deng, Yufei
Wang, Yuanjian
Xiao, Rong
Tang, Chenwei
Zhou, Jizhe
Fan, Jiahao
Xiong, Deng
Lv, Jiancheng
Tang, Huajin
author_facet Deng, Yufei
Wang, Yuanjian
Xiao, Rong
Tang, Chenwei
Zhou, Jizhe
Fan, Jiahao
Xiong, Deng
Lv, Jiancheng
Tang, Huajin
contents While 3D Gaussian Splatting (3D-GS) achieves photorealistic novel view synthesis, its performance degrades with motion blur. In scenarios with rapid motion or low-light conditions, existing RGB-based deblurring methods struggle to model camera pose and radiance changes during exposure, reducing reconstruction accuracy. Event cameras, capturing continuous brightness changes during exposure, can effectively assist in modeling motion blur and improving reconstruction quality. Therefore, we propose Event-driven Bundle Adjusted Deblur Gaussian Splatting (EBAD-Gaussian), which reconstructs sharp 3D Gaussians from event streams and severely blurred images. This method jointly learns the parameters of these Gaussians while recovering camera motion trajectories during exposure time. Specifically, we first construct a blur loss function by synthesizing multiple latent sharp images during the exposure time, minimizing the difference between real and synthesized blurred images. Then we use event stream to supervise the light intensity changes between latent sharp images at any time within the exposure period, supplementing the light intensity dynamic changes lost in RGB images. Furthermore, we optimize the latent sharp images at intermediate exposure times based on the event-based double integral (EDI) prior, applying consistency constraints to enhance the details and texture information of the reconstructed images. Extensive experiments on synthetic and real-world datasets show that EBAD-Gaussian can achieve high-quality 3D scene reconstruction under the condition of blurred images and event stream inputs.
format Preprint
id arxiv_https___arxiv_org_abs_2504_10012
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle EBAD-Gaussian: Event-driven Bundle Adjusted Deblur Gaussian Splatting
Deng, Yufei
Wang, Yuanjian
Xiao, Rong
Tang, Chenwei
Zhou, Jizhe
Fan, Jiahao
Xiong, Deng
Lv, Jiancheng
Tang, Huajin
Computer Vision and Pattern Recognition
While 3D Gaussian Splatting (3D-GS) achieves photorealistic novel view synthesis, its performance degrades with motion blur. In scenarios with rapid motion or low-light conditions, existing RGB-based deblurring methods struggle to model camera pose and radiance changes during exposure, reducing reconstruction accuracy. Event cameras, capturing continuous brightness changes during exposure, can effectively assist in modeling motion blur and improving reconstruction quality. Therefore, we propose Event-driven Bundle Adjusted Deblur Gaussian Splatting (EBAD-Gaussian), which reconstructs sharp 3D Gaussians from event streams and severely blurred images. This method jointly learns the parameters of these Gaussians while recovering camera motion trajectories during exposure time. Specifically, we first construct a blur loss function by synthesizing multiple latent sharp images during the exposure time, minimizing the difference between real and synthesized blurred images. Then we use event stream to supervise the light intensity changes between latent sharp images at any time within the exposure period, supplementing the light intensity dynamic changes lost in RGB images. Furthermore, we optimize the latent sharp images at intermediate exposure times based on the event-based double integral (EDI) prior, applying consistency constraints to enhance the details and texture information of the reconstructed images. Extensive experiments on synthetic and real-world datasets show that EBAD-Gaussian can achieve high-quality 3D scene reconstruction under the condition of blurred images and event stream inputs.
title EBAD-Gaussian: Event-driven Bundle Adjusted Deblur Gaussian Splatting
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2504.10012