Training-Free Reward-Guided Image Editing via Trajectory Optimal Control

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Chang, Jinho, Kim, Jaemin, Ye, Jong Chul
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866915969134231552
author Chang, Jinho
Kim, Jaemin
Ye, Jong Chul
author_facet Chang, Jinho
Kim, Jaemin
Ye, Jong Chul
contents Recent advancements in diffusion and flow-matching models have demonstrated remarkable capabilities in high-fidelity image synthesis. A prominent line of research involves reward-guided guidance, which steers the generation process during inference to align with specific objectives. However, leveraging this reward-guided approach to the task of image editing, which requires preserving the semantic content of the source image while enhancing a target reward, is largely unexplored. In this work, we introduce a novel framework for training-free, reward-guided image editing. We formulate the editing process as a trajectory optimal control problem where the reverse process of a diffusion model is treated as a controllable trajectory originating from the source image, and the adjoint states are iteratively updated to steer the editing process. Through extensive experiments across distinct editing tasks, we demonstrate that our approach significantly outperforms existing inversion-based training-free guidance baselines, achieving a superior balance between reward maximization and fidelity to the source image without reward hacking.
format Preprint
id arxiv_https___arxiv_org_abs_2509_25845
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Training-Free Reward-Guided Image Editing via Trajectory Optimal Control
Chang, Jinho
Kim, Jaemin
Ye, Jong Chul
Computer Vision and Pattern Recognition
Artificial Intelligence
Recent advancements in diffusion and flow-matching models have demonstrated remarkable capabilities in high-fidelity image synthesis. A prominent line of research involves reward-guided guidance, which steers the generation process during inference to align with specific objectives. However, leveraging this reward-guided approach to the task of image editing, which requires preserving the semantic content of the source image while enhancing a target reward, is largely unexplored. In this work, we introduce a novel framework for training-free, reward-guided image editing. We formulate the editing process as a trajectory optimal control problem where the reverse process of a diffusion model is treated as a controllable trajectory originating from the source image, and the adjoint states are iteratively updated to steer the editing process. Through extensive experiments across distinct editing tasks, we demonstrate that our approach significantly outperforms existing inversion-based training-free guidance baselines, achieving a superior balance between reward maximization and fidelity to the source image without reward hacking.
title Training-Free Reward-Guided Image Editing via Trajectory Optimal Control
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2509.25845