Image Motion Blur Removal in the Temporal Dimension with Video Diffusion Models

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Pang, Wang, Zhan, Zhihao, Zhu, Xiang, Bai, Yechao
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913661018177536
author Pang, Wang
Zhan, Zhihao
Zhu, Xiang
Bai, Yechao
author_facet Pang, Wang
Zhan, Zhihao
Zhu, Xiang
Bai, Yechao
contents Most motion deblurring algorithms rely on spatial-domain convolution models, which struggle with the complex, non-linear blur arising from camera shake and object motion. In contrast, we propose a novel single-image deblurring approach that treats motion blur as a temporal averaging phenomenon. Our core innovation lies in leveraging a pre-trained video diffusion transformer model to capture diverse motion dynamics within a latent space. It sidesteps explicit kernel estimation and effectively accommodates diverse motion patterns. We implement the algorithm within a diffusion-based inverse problem framework. Empirical results on synthetic and real-world datasets demonstrate that our method outperforms existing techniques in deblurring complex motion blur scenarios. This work paves the way for utilizing powerful video diffusion models to address single-image deblurring challenges.
format Preprint
id arxiv_https___arxiv_org_abs_2501_12604
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Image Motion Blur Removal in the Temporal Dimension with Video Diffusion Models
Pang, Wang
Zhan, Zhihao
Zhu, Xiang
Bai, Yechao
Image and Video Processing
Computer Vision and Pattern Recognition
Machine Learning
Most motion deblurring algorithms rely on spatial-domain convolution models, which struggle with the complex, non-linear blur arising from camera shake and object motion. In contrast, we propose a novel single-image deblurring approach that treats motion blur as a temporal averaging phenomenon. Our core innovation lies in leveraging a pre-trained video diffusion transformer model to capture diverse motion dynamics within a latent space. It sidesteps explicit kernel estimation and effectively accommodates diverse motion patterns. We implement the algorithm within a diffusion-based inverse problem framework. Empirical results on synthetic and real-world datasets demonstrate that our method outperforms existing techniques in deblurring complex motion blur scenarios. This work paves the way for utilizing powerful video diffusion models to address single-image deblurring challenges.
title Image Motion Blur Removal in the Temporal Dimension with Video Diffusion Models
topic Image and Video Processing
Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2501.12604