AnimatePainter: A Self-Supervised Rendering Framework for Reconstructing Painting Process

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Hu, Junjie, Gao, Shuyong, Guo, Qianyu, Wang, Yan, Wang, Qishan, Feng, Yuang, Zhang, Wenqiang
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866908276899184640
author Hu, Junjie
Gao, Shuyong
Guo, Qianyu
Wang, Yan
Wang, Qishan
Feng, Yuang
Zhang, Wenqiang
author_facet Hu, Junjie
Gao, Shuyong
Guo, Qianyu
Wang, Yan
Wang, Qishan
Feng, Yuang
Zhang, Wenqiang
contents Humans can intuitively decompose an image into a sequence of strokes to create a painting, yet existing methods for generating drawing processes are limited to specific data types and often rely on expensive human-annotated datasets. We propose a novel self-supervised framework for generating drawing processes from any type of image, treating the task as a video generation problem. Our approach reverses the drawing process by progressively removing strokes from a reference image, simulating a human-like creation sequence. Crucially, our method does not require costly datasets of real human drawing processes; instead, we leverage depth estimation and stroke rendering to construct a self-supervised dataset. We model human drawings as "refinement" and "layering" processes and introduce depth fusion layers to enable video generation models to learn and replicate human drawing behavior. Extensive experiments validate the effectiveness of our approach, demonstrating its ability to generate realistic drawings without the need for real drawing process data.
format Preprint
id arxiv_https___arxiv_org_abs_2503_17029
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle AnimatePainter: A Self-Supervised Rendering Framework for Reconstructing Painting Process
Hu, Junjie
Gao, Shuyong
Guo, Qianyu
Wang, Yan
Wang, Qishan
Feng, Yuang
Zhang, Wenqiang
Computer Vision and Pattern Recognition
Humans can intuitively decompose an image into a sequence of strokes to create a painting, yet existing methods for generating drawing processes are limited to specific data types and often rely on expensive human-annotated datasets. We propose a novel self-supervised framework for generating drawing processes from any type of image, treating the task as a video generation problem. Our approach reverses the drawing process by progressively removing strokes from a reference image, simulating a human-like creation sequence. Crucially, our method does not require costly datasets of real human drawing processes; instead, we leverage depth estimation and stroke rendering to construct a self-supervised dataset. We model human drawings as "refinement" and "layering" processes and introduce depth fusion layers to enable video generation models to learn and replicate human drawing behavior. Extensive experiments validate the effectiveness of our approach, demonstrating its ability to generate realistic drawings without the need for real drawing process data.
title AnimatePainter: A Self-Supervised Rendering Framework for Reconstructing Painting Process
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.17029