Saved in:
Bibliographic Details
Main Authors: He, Changyong, Zeng, Jin, Zhang, Jiawei, Guo, Jiajie
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2503.19448
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912292968333312
author He, Changyong
Zeng, Jin
Zhang, Jiawei
Guo, Jiajie
author_facet He, Changyong
Zeng, Jin
Zhang, Jiawei
Guo, Jiajie
contents Time-of-Flight (ToF) sensors efficiently capture scene depth, but the nonlinear depth construction procedure often results in extremely large noise variance or even invalid areas. Recent methods based on deep neural networks (DNNs) achieve enhanced ToF denoising accuracy but tend to struggle when presented with severe noise corruption due to limited prior knowledge of ToF data distribution. In this paper, we propose DepthCAD, a novel ToF denoising approach that ensures global structural smoothness by leveraging the rich prior knowledge in Stable Diffusion and maintains local metric accuracy by steering the diffusion process with confidence guidance. To adopt the pretrained image diffusion model to ToF depth denoising, we apply the diffusion on raw ToF correlation measurements with dynamic range normalization before converting to depth maps. Experimental results validate the state-of-the-art performance of the proposed scheme, and the evaluation on real data further verifies its robustness against real-world ToF noise.
format Preprint
id arxiv_https___arxiv_org_abs_2503_19448
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Towards Robust Time-of-Flight Depth Denoising with Confidence-Aware Diffusion Model
He, Changyong
Zeng, Jin
Zhang, Jiawei
Guo, Jiajie
Computer Vision and Pattern Recognition
Image and Video Processing
Time-of-Flight (ToF) sensors efficiently capture scene depth, but the nonlinear depth construction procedure often results in extremely large noise variance or even invalid areas. Recent methods based on deep neural networks (DNNs) achieve enhanced ToF denoising accuracy but tend to struggle when presented with severe noise corruption due to limited prior knowledge of ToF data distribution. In this paper, we propose DepthCAD, a novel ToF denoising approach that ensures global structural smoothness by leveraging the rich prior knowledge in Stable Diffusion and maintains local metric accuracy by steering the diffusion process with confidence guidance. To adopt the pretrained image diffusion model to ToF depth denoising, we apply the diffusion on raw ToF correlation measurements with dynamic range normalization before converting to depth maps. Experimental results validate the state-of-the-art performance of the proposed scheme, and the evaluation on real data further verifies its robustness against real-world ToF noise.
title Towards Robust Time-of-Flight Depth Denoising with Confidence-Aware Diffusion Model
topic Computer Vision and Pattern Recognition
Image and Video Processing
url https://arxiv.org/abs/2503.19448