Tight Inversion: Image-Conditioned Inversion for Real Image Editing

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Kadosh, Edo, Goren, Nir, Patashnik, Or, Garibi, Daniel, Cohen-Or, Daniel
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916633905201152
author Kadosh, Edo
Goren, Nir
Patashnik, Or
Garibi, Daniel
Cohen-Or, Daniel
author_facet Kadosh, Edo
Goren, Nir
Patashnik, Or
Garibi, Daniel
Cohen-Or, Daniel
contents Text-to-image diffusion models offer powerful image editing capabilities. To edit real images, many methods rely on the inversion of the image into Gaussian noise. A common approach to invert an image is to gradually add noise to the image, where the noise is determined by reversing the sampling equation. This process has an inherent tradeoff between reconstruction and editability, limiting the editing of challenging images such as highly-detailed ones. Recognizing the reliance of text-to-image models inversion on a text condition, this work explores the importance of the condition choice. We show that a condition that precisely aligns with the input image significantly improves the inversion quality. Based on our findings, we introduce Tight Inversion, an inversion method that utilizes the most possible precise condition -- the input image itself. This tight condition narrows the distribution of the model's output and enhances both reconstruction and editability. We demonstrate the effectiveness of our approach when combined with existing inversion methods through extensive experiments, evaluating the reconstruction accuracy as well as the integration with various editing methods.
format Preprint
id arxiv_https___arxiv_org_abs_2502_20376
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Tight Inversion: Image-Conditioned Inversion for Real Image Editing
Kadosh, Edo
Goren, Nir
Patashnik, Or
Garibi, Daniel
Cohen-Or, Daniel
Graphics
Computer Vision and Pattern Recognition
Machine Learning
Text-to-image diffusion models offer powerful image editing capabilities. To edit real images, many methods rely on the inversion of the image into Gaussian noise. A common approach to invert an image is to gradually add noise to the image, where the noise is determined by reversing the sampling equation. This process has an inherent tradeoff between reconstruction and editability, limiting the editing of challenging images such as highly-detailed ones. Recognizing the reliance of text-to-image models inversion on a text condition, this work explores the importance of the condition choice. We show that a condition that precisely aligns with the input image significantly improves the inversion quality. Based on our findings, we introduce Tight Inversion, an inversion method that utilizes the most possible precise condition -- the input image itself. This tight condition narrows the distribution of the model's output and enhances both reconstruction and editability. We demonstrate the effectiveness of our approach when combined with existing inversion methods through extensive experiments, evaluating the reconstruction accuracy as well as the integration with various editing methods.
title Tight Inversion: Image-Conditioned Inversion for Real Image Editing
topic Graphics
Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2502.20376