MagicQuill: An Intelligent Interactive Image Editing System

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Liu, Zichen, Yu, Yue, Ouyang, Hao, Wang, Qiuyu, Cheng, Ka Leong, Wang, Wen, Liu, Zhiheng, Chen, Qifeng, Shen, Yujun
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912288383959040
author Liu, Zichen
Yu, Yue
Ouyang, Hao
Wang, Qiuyu
Cheng, Ka Leong
Wang, Wen
Liu, Zhiheng
Chen, Qifeng
Shen, Yujun
author_facet Liu, Zichen
Yu, Yue
Ouyang, Hao
Wang, Qiuyu
Cheng, Ka Leong
Wang, Wen
Liu, Zhiheng
Chen, Qifeng
Shen, Yujun
contents Image editing involves a variety of complex tasks and requires efficient and precise manipulation techniques. In this paper, we present MagicQuill, an integrated image editing system that enables swift actualization of creative ideas. Our system features a streamlined yet functionally robust interface, allowing for the articulation of editing operations (e.g., inserting elements, erasing objects, altering color) with minimal input. These interactions are monitored by a multimodal large language model (MLLM) to anticipate editing intentions in real time, bypassing the need for explicit prompt entry. Finally, we apply a powerful diffusion prior, enhanced by a carefully learned two-branch plug-in module, to process editing requests with precise control. Experimental results demonstrate the effectiveness of MagicQuill in achieving high-quality image edits. Please visit https://magic-quill.github.io to try out our system.
format Preprint
id arxiv_https___arxiv_org_abs_2411_09703
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle MagicQuill: An Intelligent Interactive Image Editing System
Liu, Zichen
Yu, Yue
Ouyang, Hao
Wang, Qiuyu
Cheng, Ka Leong
Wang, Wen
Liu, Zhiheng
Chen, Qifeng
Shen, Yujun
Computer Vision and Pattern Recognition
Image editing involves a variety of complex tasks and requires efficient and precise manipulation techniques. In this paper, we present MagicQuill, an integrated image editing system that enables swift actualization of creative ideas. Our system features a streamlined yet functionally robust interface, allowing for the articulation of editing operations (e.g., inserting elements, erasing objects, altering color) with minimal input. These interactions are monitored by a multimodal large language model (MLLM) to anticipate editing intentions in real time, bypassing the need for explicit prompt entry. Finally, we apply a powerful diffusion prior, enhanced by a carefully learned two-branch plug-in module, to process editing requests with precise control. Experimental results demonstrate the effectiveness of MagicQuill in achieving high-quality image edits. Please visit https://magic-quill.github.io to try out our system.
title MagicQuill: An Intelligent Interactive Image Editing System
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2411.09703