Schedule Your Edit: A Simple yet Effective Diffusion Noise Schedule for Image Editing
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866929562152075264 |
|---|---|
| author | Lin, Haonan Wang, Mengmeng Wang, Jiahao An, Wenbin Chen, Yan Liu, Yong Tian, Feng Dai, Guang Wang, Jingdong Wang, Qianying |
| author_facet | Lin, Haonan Wang, Mengmeng Wang, Jiahao An, Wenbin Chen, Yan Liu, Yong Tian, Feng Dai, Guang Wang, Jingdong Wang, Qianying |
| contents | Text-guided diffusion models have significantly advanced image editing, enabling high-quality and diverse modifications driven by text prompts. However, effective editing requires inverting the source image into a latent space, a process often hindered by prediction errors inherent in DDIM inversion. These errors accumulate during the diffusion process, resulting in inferior content preservation and edit fidelity, especially with conditional inputs. We address these challenges by investigating the primary contributors to error accumulation in DDIM inversion and identify the singularity problem in traditional noise schedules as a key issue. To resolve this, we introduce the Logistic Schedule, a novel noise schedule designed to eliminate singularities, improve inversion stability, and provide a better noise space for image editing. This schedule reduces noise prediction errors, enabling more faithful editing that preserves the original content of the source image. Our approach requires no additional retraining and is compatible with various existing editing methods. Experiments across eight editing tasks demonstrate the Logistic Schedule's superior performance in content preservation and edit fidelity compared to traditional noise schedules, highlighting its adaptability and effectiveness. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_18756 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Schedule Your Edit: A Simple yet Effective Diffusion Noise Schedule for Image Editing Lin, Haonan Wang, Mengmeng Wang, Jiahao An, Wenbin Chen, Yan Liu, Yong Tian, Feng Dai, Guang Wang, Jingdong Wang, Qianying Computer Vision and Pattern Recognition Text-guided diffusion models have significantly advanced image editing, enabling high-quality and diverse modifications driven by text prompts. However, effective editing requires inverting the source image into a latent space, a process often hindered by prediction errors inherent in DDIM inversion. These errors accumulate during the diffusion process, resulting in inferior content preservation and edit fidelity, especially with conditional inputs. We address these challenges by investigating the primary contributors to error accumulation in DDIM inversion and identify the singularity problem in traditional noise schedules as a key issue. To resolve this, we introduce the Logistic Schedule, a novel noise schedule designed to eliminate singularities, improve inversion stability, and provide a better noise space for image editing. This schedule reduces noise prediction errors, enabling more faithful editing that preserves the original content of the source image. Our approach requires no additional retraining and is compatible with various existing editing methods. Experiments across eight editing tasks demonstrate the Logistic Schedule's superior performance in content preservation and edit fidelity compared to traditional noise schedules, highlighting its adaptability and effectiveness. |
| title | Schedule Your Edit: A Simple yet Effective Diffusion Noise Schedule for Image Editing |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2410.18756 |