Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2512.13276 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909963302993920 |
|---|---|
| author | Li, Yan Liu, Lin Zhang, Xiaopeng Xue, Wei Luo, Wenhan Guo, Yike Tian, Qi |
| author_facet | Li, Yan Liu, Lin Zhang, Xiaopeng Xue, Wei Luo, Wenhan Guo, Yike Tian, Qi |
| contents | Instruction-based image editing with diffusion models has achieved impressive results, yet existing methods struggle with fine-grained instructions specifying precise attributes such as colors, positions, and quantities. While recent approaches employ Group Relative Policy Optimization (GRPO) for alignment, they optimize only at individual sampling steps, providing sparse feedback that limits trajectory-level control. We propose a unified framework CogniEdit, combining multi-modal reasoning with dense reward optimization that propagates gradients across consecutive denoising steps, enabling trajectory-level gradient flow through the sampling process. Our method comprises three components: (1) Multi-modal Large Language Models for decomposing complex instructions into actionable directives, (2) Dynamic Token Focus Relocation that adaptively emphasizes fine-grained attributes, and (3) Dense GRPO-based optimization that propagates gradients across consecutive steps for trajectory-level supervision. Extensive experiments on benchmark datasets demonstrate that our CogniEdit achieves state-of-the-art performance in balancing fine-grained instruction following with visual quality and editability preservation |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_13276 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | CogniEdit: Dense Gradient Flow Optimization for Fine-Grained Image Editing Li, Yan Liu, Lin Zhang, Xiaopeng Xue, Wei Luo, Wenhan Guo, Yike Tian, Qi Computer Vision and Pattern Recognition Instruction-based image editing with diffusion models has achieved impressive results, yet existing methods struggle with fine-grained instructions specifying precise attributes such as colors, positions, and quantities. While recent approaches employ Group Relative Policy Optimization (GRPO) for alignment, they optimize only at individual sampling steps, providing sparse feedback that limits trajectory-level control. We propose a unified framework CogniEdit, combining multi-modal reasoning with dense reward optimization that propagates gradients across consecutive denoising steps, enabling trajectory-level gradient flow through the sampling process. Our method comprises three components: (1) Multi-modal Large Language Models for decomposing complex instructions into actionable directives, (2) Dynamic Token Focus Relocation that adaptively emphasizes fine-grained attributes, and (3) Dense GRPO-based optimization that propagates gradients across consecutive steps for trajectory-level supervision. Extensive experiments on benchmark datasets demonstrate that our CogniEdit achieves state-of-the-art performance in balancing fine-grained instruction following with visual quality and editability preservation |
| title | CogniEdit: Dense Gradient Flow Optimization for Fine-Grained Image Editing |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2512.13276 |