Training-Free Adaptive Diffusion with Bounded Difference Approximation Strategy
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866914971374321664 |
|---|---|
| author | Ye, Hancheng Yuan, Jiakang Xia, Renqiu Yan, Xiangchao Chen, Tao Yan, Junchi Shi, Botian Zhang, Bo |
| author_facet | Ye, Hancheng Yuan, Jiakang Xia, Renqiu Yan, Xiangchao Chen, Tao Yan, Junchi Shi, Botian Zhang, Bo |
| contents | Diffusion models have recently achieved great success in the synthesis of high-quality images and videos. However, the existing denoising techniques in diffusion models are commonly based on step-by-step noise predictions, which suffers from high computation cost, resulting in a prohibitive latency for interactive applications. In this paper, we propose AdaptiveDiffusion to relieve this bottleneck by adaptively reducing the noise prediction steps during the denoising process. Our method considers the potential of skipping as many noise prediction steps as possible while keeping the final denoised results identical to the original full-step ones. Specifically, the skipping strategy is guided by the third-order latent difference that indicates the stability between timesteps during the denoising process, which benefits the reusing of previous noise prediction results. Extensive experiments on image and video diffusion models demonstrate that our method can significantly speed up the denoising process while generating identical results to the original process, achieving up to an average 2~5x speedup without quality degradation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_09873 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Training-Free Adaptive Diffusion with Bounded Difference Approximation Strategy Ye, Hancheng Yuan, Jiakang Xia, Renqiu Yan, Xiangchao Chen, Tao Yan, Junchi Shi, Botian Zhang, Bo Computer Vision and Pattern Recognition Diffusion models have recently achieved great success in the synthesis of high-quality images and videos. However, the existing denoising techniques in diffusion models are commonly based on step-by-step noise predictions, which suffers from high computation cost, resulting in a prohibitive latency for interactive applications. In this paper, we propose AdaptiveDiffusion to relieve this bottleneck by adaptively reducing the noise prediction steps during the denoising process. Our method considers the potential of skipping as many noise prediction steps as possible while keeping the final denoised results identical to the original full-step ones. Specifically, the skipping strategy is guided by the third-order latent difference that indicates the stability between timesteps during the denoising process, which benefits the reusing of previous noise prediction results. Extensive experiments on image and video diffusion models demonstrate that our method can significantly speed up the denoising process while generating identical results to the original process, achieving up to an average 2~5x speedup without quality degradation. |
| title | Training-Free Adaptive Diffusion with Bounded Difference Approximation Strategy |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2410.09873 |