coDrawAgents: A Multi-Agent Dialogue Framework for Compositional Image Generation
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2026
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866917338388889600 |
|---|---|
| author | Li, Chunhan Wu, Qifeng Pan, Jia-Hui Hui, Ka-Hei Hu, Jingyu Jiang, Yuming Sheng, Bin Liu, Xihui Gong, Wenjuan Liu, Zhengzhe |
| author_facet | Li, Chunhan Wu, Qifeng Pan, Jia-Hui Hui, Ka-Hei Hu, Jingyu Jiang, Yuming Sheng, Bin Liu, Xihui Gong, Wenjuan Liu, Zhengzhe |
| contents | Text-to-image generation has advanced rapidly, but existing models still struggle with faithfully composing multiple objects and preserving their attributes in complex scenes. We propose coDrawAgents, an interactive multi-agent dialogue framework with four specialized agents: Interpreter, Planner, Checker, and Painter that collaborate to improve compositional generation. The Interpreter adaptively decides between a direct text-to-image pathway and a layout-aware multi-agent process. In the layout-aware mode, it parses the prompt into attribute-rich object descriptors, ranks them by semantic salience, and groups objects with the same semantic priority level for joint generation. Guided by the Interpreter, the Planner adopts a divide-and-conquer strategy, incrementally proposing layouts for objects with the same semantic priority level while grounding decisions in the evolving visual context of the canvas. The Checker introduces an explicit error-correction mechanism by validating spatial consistency and attribute alignment, and refining layouts before they are rendered. Finally, the Painter synthesizes the image step by step, incorporating newly planned objects into the canvas to provide richer context for subsequent iterations. Together, these agents address three key challenges: reducing layout complexity, grounding planning in visual context, and enabling explicit error correction. Extensive experiments on benchmarks GenEval and DPG-Bench demonstrate that coDrawAgents substantially improves text-image alignment, spatial accuracy, and attribute binding compared to existing methods. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_12829 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | coDrawAgents: A Multi-Agent Dialogue Framework for Compositional Image Generation Li, Chunhan Wu, Qifeng Pan, Jia-Hui Hui, Ka-Hei Hu, Jingyu Jiang, Yuming Sheng, Bin Liu, Xihui Gong, Wenjuan Liu, Zhengzhe Computer Vision and Pattern Recognition Text-to-image generation has advanced rapidly, but existing models still struggle with faithfully composing multiple objects and preserving their attributes in complex scenes. We propose coDrawAgents, an interactive multi-agent dialogue framework with four specialized agents: Interpreter, Planner, Checker, and Painter that collaborate to improve compositional generation. The Interpreter adaptively decides between a direct text-to-image pathway and a layout-aware multi-agent process. In the layout-aware mode, it parses the prompt into attribute-rich object descriptors, ranks them by semantic salience, and groups objects with the same semantic priority level for joint generation. Guided by the Interpreter, the Planner adopts a divide-and-conquer strategy, incrementally proposing layouts for objects with the same semantic priority level while grounding decisions in the evolving visual context of the canvas. The Checker introduces an explicit error-correction mechanism by validating spatial consistency and attribute alignment, and refining layouts before they are rendered. Finally, the Painter synthesizes the image step by step, incorporating newly planned objects into the canvas to provide richer context for subsequent iterations. Together, these agents address three key challenges: reducing layout complexity, grounding planning in visual context, and enabling explicit error correction. Extensive experiments on benchmarks GenEval and DPG-Bench demonstrate that coDrawAgents substantially improves text-image alignment, spatial accuracy, and attribute binding compared to existing methods. |
| title | coDrawAgents: A Multi-Agent Dialogue Framework for Compositional Image Generation |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2603.12829 |