Classic Video Denoising in a Machine Learning World: Robust, Fast, and Controllable

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Jin, Xin, Niklaus, Simon, Zhang, Zhoutong, Xia, Zhihao, Guo, Chunle, Yang, Yuting, Chen, Jiawen, Li, Chongyi
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910903325163520
author Jin, Xin
Niklaus, Simon
Zhang, Zhoutong
Xia, Zhihao
Guo, Chunle
Yang, Yuting
Chen, Jiawen
Li, Chongyi
author_facet Jin, Xin
Niklaus, Simon
Zhang, Zhoutong
Xia, Zhihao
Guo, Chunle
Yang, Yuting
Chen, Jiawen
Li, Chongyi
contents Denoising is a crucial step in many video processing pipelines such as in interactive editing, where high quality, speed, and user control are essential. While recent approaches achieve significant improvements in denoising quality by leveraging deep learning, they are prone to unexpected failures due to discrepancies between training data distributions and the wide variety of noise patterns found in real-world videos. These methods also tend to be slow and lack user control. In contrast, traditional denoising methods perform reliably on in-the-wild videos and run relatively quickly on modern hardware. However, they require manually tuning parameters for each input video, which is not only tedious but also requires skill. We bridge the gap between these two paradigms by proposing a differentiable denoising pipeline based on traditional methods. A neural network is then trained to predict the optimal denoising parameters for each specific input, resulting in a robust and efficient approach that also supports user control.
format Preprint
id arxiv_https___arxiv_org_abs_2504_03136
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Classic Video Denoising in a Machine Learning World: Robust, Fast, and Controllable
Jin, Xin
Niklaus, Simon
Zhang, Zhoutong
Xia, Zhihao
Guo, Chunle
Yang, Yuting
Chen, Jiawen
Li, Chongyi
Computer Vision and Pattern Recognition
Denoising is a crucial step in many video processing pipelines such as in interactive editing, where high quality, speed, and user control are essential. While recent approaches achieve significant improvements in denoising quality by leveraging deep learning, they are prone to unexpected failures due to discrepancies between training data distributions and the wide variety of noise patterns found in real-world videos. These methods also tend to be slow and lack user control. In contrast, traditional denoising methods perform reliably on in-the-wild videos and run relatively quickly on modern hardware. However, they require manually tuning parameters for each input video, which is not only tedious but also requires skill. We bridge the gap between these two paradigms by proposing a differentiable denoising pipeline based on traditional methods. A neural network is then trained to predict the optimal denoising parameters for each specific input, resulting in a robust and efficient approach that also supports user control.
title Classic Video Denoising in a Machine Learning World: Robust, Fast, and Controllable
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2504.03136