Towards Robust Sequential Decomposition for Complex Image Editing

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zeng, Zilai, Cao, Mingdeng, Li, Zijie, Lian, Xiaochen, Shi, Yichun, Zhu, Peihao, Sun, Chen, Wang, Peng
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917477698502656
author Zeng, Zilai
Cao, Mingdeng
Li, Zijie
Lian, Xiaochen
Shi, Yichun
Zhu, Peihao
Sun, Chen
Wang, Peng
author_facet Zeng, Zilai
Cao, Mingdeng
Li, Zijie
Lian, Xiaochen
Shi, Yichun
Zhu, Peihao
Sun, Chen
Wang, Peng
contents Recent advances in visual generative models have enabled high-fidelity image editing guided by human instructions. However, these models often struggle with complex instructions involving combinatorial editing operations or inter-step dependencies. This difficulty stems from the limitations of two canonical paradigms: (1) single-turn editing, which attempts to apply all instructed edits in one pass, often fails to parse the complex instruction accurately and causes undesired edits; and (2) sequential editing can decompose the task into simpler steps but suffers from compounding errors introduced by the sequential execution, leading to low-fidelity results. To derive a robust solution for complex image editing, we examine editing behaviors of different paradigms under a unified in-context editing framework, and study how the benefits of sequential decomposition can be balanced against its error-accumulation drawbacks. We further develop a synthetic data pipeline that constructs editing tasks of varying instruction complexity, allowing us to curate a large-scale editing dataset with high-quality decomposed sequences. By finetuning on synthetic data, we discovered that with properly designed editing paradigms, sequential decomposition yields robust improvements even as task complexity increases. Furthermore, the decomposition skills learned from synthetic tasks can transfer to real images by co-training with real-world editing data, demonstrating the promise of sim-to-real generalization for tackling complex image editing across broader domains.
format Preprint
id arxiv_https___arxiv_org_abs_2605_09233
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Towards Robust Sequential Decomposition for Complex Image Editing
Zeng, Zilai
Cao, Mingdeng
Li, Zijie
Lian, Xiaochen
Shi, Yichun
Zhu, Peihao
Sun, Chen
Wang, Peng
Computer Vision and Pattern Recognition
Artificial Intelligence
Recent advances in visual generative models have enabled high-fidelity image editing guided by human instructions. However, these models often struggle with complex instructions involving combinatorial editing operations or inter-step dependencies. This difficulty stems from the limitations of two canonical paradigms: (1) single-turn editing, which attempts to apply all instructed edits in one pass, often fails to parse the complex instruction accurately and causes undesired edits; and (2) sequential editing can decompose the task into simpler steps but suffers from compounding errors introduced by the sequential execution, leading to low-fidelity results. To derive a robust solution for complex image editing, we examine editing behaviors of different paradigms under a unified in-context editing framework, and study how the benefits of sequential decomposition can be balanced against its error-accumulation drawbacks. We further develop a synthetic data pipeline that constructs editing tasks of varying instruction complexity, allowing us to curate a large-scale editing dataset with high-quality decomposed sequences. By finetuning on synthetic data, we discovered that with properly designed editing paradigms, sequential decomposition yields robust improvements even as task complexity increases. Furthermore, the decomposition skills learned from synthetic tasks can transfer to real images by co-training with real-world editing data, demonstrating the promise of sim-to-real generalization for tackling complex image editing across broader domains.
title Towards Robust Sequential Decomposition for Complex Image Editing
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2605.09233