ReFlex: Text-Guided Editing of Real Images in Rectified Flow via Mid-Step Feature Extraction and Attention Adaptation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Kim, Jimyeong, Park, Jungwon, Song, Yeji, Kwak, Nojun, Rhee, Wonjong
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908430147518464
author Kim, Jimyeong
Park, Jungwon
Song, Yeji
Kwak, Nojun
Rhee, Wonjong
author_facet Kim, Jimyeong
Park, Jungwon
Song, Yeji
Kwak, Nojun
Rhee, Wonjong
contents Rectified Flow text-to-image models surpass diffusion models in image quality and text alignment, but adapting ReFlow for real-image editing remains challenging. We propose a new real-image editing method for ReFlow by analyzing the intermediate representations of multimodal transformer blocks and identifying three key features. To extract these features from real images with sufficient structural preservation, we leverage mid-step latent, which is inverted only up to the mid-step. We then adapt attention during injection to improve editability and enhance alignment to the target text. Our method is training-free, requires no user-provided mask, and can be applied even without a source prompt. Extensive experiments on two benchmarks with nine baselines demonstrate its superior performance over prior methods, further validated by human evaluations confirming a strong user preference for our approach.
format Preprint
id arxiv_https___arxiv_org_abs_2507_01496
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle ReFlex: Text-Guided Editing of Real Images in Rectified Flow via Mid-Step Feature Extraction and Attention Adaptation
Kim, Jimyeong
Park, Jungwon
Song, Yeji
Kwak, Nojun
Rhee, Wonjong
Computer Vision and Pattern Recognition
Rectified Flow text-to-image models surpass diffusion models in image quality and text alignment, but adapting ReFlow for real-image editing remains challenging. We propose a new real-image editing method for ReFlow by analyzing the intermediate representations of multimodal transformer blocks and identifying three key features. To extract these features from real images with sufficient structural preservation, we leverage mid-step latent, which is inverted only up to the mid-step. We then adapt attention during injection to improve editability and enhance alignment to the target text. Our method is training-free, requires no user-provided mask, and can be applied even without a source prompt. Extensive experiments on two benchmarks with nine baselines demonstrate its superior performance over prior methods, further validated by human evaluations confirming a strong user preference for our approach.
title ReFlex: Text-Guided Editing of Real Images in Rectified Flow via Mid-Step Feature Extraction and Attention Adaptation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.01496