Interactive Drawing Guidance for Anime Illustrations with Diffusion Model

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Chen, Chuang, Xie, Xiaoxuan, Zhang, Yongming, Zhang, Tianyu, Xie, Haoran
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915385742196736
author Chen, Chuang
Xie, Xiaoxuan
Zhang, Yongming
Zhang, Tianyu
Xie, Haoran
author_facet Chen, Chuang
Xie, Xiaoxuan
Zhang, Yongming
Zhang, Tianyu
Xie, Haoran
contents Creating high-quality anime illustrations presents notable challenges, particularly for beginners, due to the intricate styles and fine details inherent in anime art. We present an interactive drawing guidance system specifically designed for anime illustrations to address this issue. It offers real-time guidance to help users refine their work and streamline the creative process. Our system is built upon the StreamDiffusion pipeline to deliver real-time drawing assistance. We fine-tune Stable Diffusion with LoRA to synthesize anime style RGB images from user-provided hand-drawn sketches and prompts. Leveraging the Informative Drawings model, we transform these RGB images into rough sketches, which are further refined into structured guidance sketches using a custom-designed optimizer. The proposed system offers precise, real-time guidance aligned with the creative intent of the user, significantly enhancing both the efficiency and accuracy of the drawing process. To assess the effectiveness of our approach, we conducted a user study, gathering empirical feedback on both system performance and interface usability.
format Preprint
id arxiv_https___arxiv_org_abs_2507_09140
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Interactive Drawing Guidance for Anime Illustrations with Diffusion Model
Chen, Chuang
Xie, Xiaoxuan
Zhang, Yongming
Zhang, Tianyu
Xie, Haoran
Graphics
Creating high-quality anime illustrations presents notable challenges, particularly for beginners, due to the intricate styles and fine details inherent in anime art. We present an interactive drawing guidance system specifically designed for anime illustrations to address this issue. It offers real-time guidance to help users refine their work and streamline the creative process. Our system is built upon the StreamDiffusion pipeline to deliver real-time drawing assistance. We fine-tune Stable Diffusion with LoRA to synthesize anime style RGB images from user-provided hand-drawn sketches and prompts. Leveraging the Informative Drawings model, we transform these RGB images into rough sketches, which are further refined into structured guidance sketches using a custom-designed optimizer. The proposed system offers precise, real-time guidance aligned with the creative intent of the user, significantly enhancing both the efficiency and accuracy of the drawing process. To assess the effectiveness of our approach, we conducted a user study, gathering empirical feedback on both system performance and interface usability.
title Interactive Drawing Guidance for Anime Illustrations with Diffusion Model
topic Graphics
url https://arxiv.org/abs/2507.09140