Elucidating the Design Space of Arbitrary-Noise-Based Diffusion Models

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Qiu, Xingyu, Yang, Mengying, Ma, Xinghua, Liang, Dong, Li, Fanding, Luo, Gongning, Wang, Wei, Wang, Kuanquan, Li, Shuo
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915834579910656
author Qiu, Xingyu
Yang, Mengying
Ma, Xinghua
Liang, Dong
Li, Fanding
Luo, Gongning
Wang, Wei
Wang, Kuanquan
Li, Shuo
author_facet Qiu, Xingyu
Yang, Mengying
Ma, Xinghua
Liang, Dong
Li, Fanding
Luo, Gongning
Wang, Wei
Wang, Kuanquan
Li, Shuo
contents Although EDM aims to unify the design space of diffusion models, its reliance on fixed Gaussian noise prevents it from explaining emerging flow-based methods that diffuse arbitrary noise. Moreover, our study reveals that EDM's forcible injection of Gaussian noise has adverse effects on image restoration task, as it corrupts the degraded images, overextends the restoration distance, and increases the task's complexity. To interpret diverse methods for handling distinct noise patterns within a unified theoretical framework and to minimize the restoration distance, we propose EDA, which Elucidates the Design space of Arbitrary-noise diffusion models. Theoretically, EDA expands noise pattern flexibility while preserving EDM's modularity, with rigorous proof that increased noise complexity introduces no additional computational overhead during restoration. EDA is validated on three representative medical image denoising and natural image restoration tasks: MRI bias field correction (global smooth noise), CT metal artifact removal (global sharp noise) and natural image shadow removal (local boundary-aware noise). With only 5 sampling steps, competitive results against specialized methods across medical and natural tasks demonstrate EDA's strong generalization capability for image restoration. Code is available at: https://github.com/PerceptionComputingLab/EDA.
format Preprint
id arxiv_https___arxiv_org_abs_2507_18534
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Elucidating the Design Space of Arbitrary-Noise-Based Diffusion Models
Qiu, Xingyu
Yang, Mengying
Ma, Xinghua
Liang, Dong
Li, Fanding
Luo, Gongning
Wang, Wei
Wang, Kuanquan
Li, Shuo
Computer Vision and Pattern Recognition
Machine Learning
Although EDM aims to unify the design space of diffusion models, its reliance on fixed Gaussian noise prevents it from explaining emerging flow-based methods that diffuse arbitrary noise. Moreover, our study reveals that EDM's forcible injection of Gaussian noise has adverse effects on image restoration task, as it corrupts the degraded images, overextends the restoration distance, and increases the task's complexity. To interpret diverse methods for handling distinct noise patterns within a unified theoretical framework and to minimize the restoration distance, we propose EDA, which Elucidates the Design space of Arbitrary-noise diffusion models. Theoretically, EDA expands noise pattern flexibility while preserving EDM's modularity, with rigorous proof that increased noise complexity introduces no additional computational overhead during restoration. EDA is validated on three representative medical image denoising and natural image restoration tasks: MRI bias field correction (global smooth noise), CT metal artifact removal (global sharp noise) and natural image shadow removal (local boundary-aware noise). With only 5 sampling steps, competitive results against specialized methods across medical and natural tasks demonstrate EDA's strong generalization capability for image restoration. Code is available at: https://github.com/PerceptionComputingLab/EDA.
title Elucidating the Design Space of Arbitrary-Noise-Based Diffusion Models
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2507.18534