SaENeRF: Suppressing Artifacts in Event-based Neural Radiance Fields

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Yuanjian, Deng, Yufei, Xiao, Rong, Fan, Jiahao, Tang, Chenwei, Xiong, Deng, Lv, Jiancheng
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915253977088000
author Wang, Yuanjian
Deng, Yufei
Xiao, Rong
Fan, Jiahao
Tang, Chenwei
Xiong, Deng
Lv, Jiancheng
author_facet Wang, Yuanjian
Deng, Yufei
Xiao, Rong
Fan, Jiahao
Tang, Chenwei
Xiong, Deng
Lv, Jiancheng
contents Event cameras are neuromorphic vision sensors that asynchronously capture changes in logarithmic brightness changes, offering significant advantages such as low latency, low power consumption, low bandwidth, and high dynamic range. While these characteristics make them ideal for high-speed scenarios, reconstructing geometrically consistent and photometrically accurate 3D representations from event data remains fundamentally challenging. Current event-based Neural Radiance Fields (NeRF) methods partially address these challenges but suffer from persistent artifacts caused by aggressive network learning in early stages and the inherent noise of event cameras. To overcome these limitations, we present SaENeRF, a novel self-supervised framework that effectively suppresses artifacts and enables 3D-consistent, dense, and photorealistic NeRF reconstruction of static scenes solely from event streams. Our approach normalizes predicted radiance variations based on accumulated event polarities, facilitating progressive and rapid learning for scene representation construction. Additionally, we introduce regularization losses specifically designed to suppress artifacts in regions where photometric changes fall below the event threshold and simultaneously enhance the light intensity difference of non-zero events, thereby improving the visual fidelity of the reconstructed scene. Extensive qualitative and quantitative experiments demonstrate that our method significantly reduces artifacts and achieves superior reconstruction quality compared to existing methods. The code is available at https://github.com/Mr-firework/SaENeRF.
format Preprint
id arxiv_https___arxiv_org_abs_2504_16389
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle SaENeRF: Suppressing Artifacts in Event-based Neural Radiance Fields
Wang, Yuanjian
Deng, Yufei
Xiao, Rong
Fan, Jiahao
Tang, Chenwei
Xiong, Deng
Lv, Jiancheng
Computer Vision and Pattern Recognition
Event cameras are neuromorphic vision sensors that asynchronously capture changes in logarithmic brightness changes, offering significant advantages such as low latency, low power consumption, low bandwidth, and high dynamic range. While these characteristics make them ideal for high-speed scenarios, reconstructing geometrically consistent and photometrically accurate 3D representations from event data remains fundamentally challenging. Current event-based Neural Radiance Fields (NeRF) methods partially address these challenges but suffer from persistent artifacts caused by aggressive network learning in early stages and the inherent noise of event cameras. To overcome these limitations, we present SaENeRF, a novel self-supervised framework that effectively suppresses artifacts and enables 3D-consistent, dense, and photorealistic NeRF reconstruction of static scenes solely from event streams. Our approach normalizes predicted radiance variations based on accumulated event polarities, facilitating progressive and rapid learning for scene representation construction. Additionally, we introduce regularization losses specifically designed to suppress artifacts in regions where photometric changes fall below the event threshold and simultaneously enhance the light intensity difference of non-zero events, thereby improving the visual fidelity of the reconstructed scene. Extensive qualitative and quantitative experiments demonstrate that our method significantly reduces artifacts and achieves superior reconstruction quality compared to existing methods. The code is available at https://github.com/Mr-firework/SaENeRF.
title SaENeRF: Suppressing Artifacts in Event-based Neural Radiance Fields
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2504.16389