Multi-Object Sketch Animation with Grouping and Motion Trajectory Priors

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Liang, Guotao, Hu, Juncheng, Xing, Ximing, Zhang, Jing, Yu, Qian
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912547322462208
author Liang, Guotao
Hu, Juncheng
Xing, Ximing
Zhang, Jing
Yu, Qian
author_facet Liang, Guotao
Hu, Juncheng
Xing, Ximing
Zhang, Jing
Yu, Qian
contents We introduce GroupSketch, a novel method for vector sketch animation that effectively handles multi-object interactions and complex motions. Existing approaches struggle with these scenarios, either being limited to single-object cases or suffering from temporal inconsistency and poor generalization. To address these limitations, our method adopts a two-stage pipeline comprising Motion Initialization and Motion Refinement. In the first stage, the input sketch is interactively divided into semantic groups and key frames are defined, enabling the generation of a coarse animation via interpolation. In the second stage, we propose a Group-based Displacement Network (GDN), which refines the coarse animation by predicting group-specific displacement fields, leveraging priors from a text-to-video model. GDN further incorporates specialized modules, such as Context-conditioned Feature Enhancement (CCFE), to improve temporal consistency. Extensive experiments demonstrate that our approach significantly outperforms existing methods in generating high-quality, temporally consistent animations for complex, multi-object sketches, thus expanding the practical applications of sketch animation.
format Preprint
id arxiv_https___arxiv_org_abs_2508_15535
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Multi-Object Sketch Animation with Grouping and Motion Trajectory Priors
Liang, Guotao
Hu, Juncheng
Xing, Ximing
Zhang, Jing
Yu, Qian
Computer Vision and Pattern Recognition
We introduce GroupSketch, a novel method for vector sketch animation that effectively handles multi-object interactions and complex motions. Existing approaches struggle with these scenarios, either being limited to single-object cases or suffering from temporal inconsistency and poor generalization. To address these limitations, our method adopts a two-stage pipeline comprising Motion Initialization and Motion Refinement. In the first stage, the input sketch is interactively divided into semantic groups and key frames are defined, enabling the generation of a coarse animation via interpolation. In the second stage, we propose a Group-based Displacement Network (GDN), which refines the coarse animation by predicting group-specific displacement fields, leveraging priors from a text-to-video model. GDN further incorporates specialized modules, such as Context-conditioned Feature Enhancement (CCFE), to improve temporal consistency. Extensive experiments demonstrate that our approach significantly outperforms existing methods in generating high-quality, temporally consistent animations for complex, multi-object sketches, thus expanding the practical applications of sketch animation.
title Multi-Object Sketch Animation with Grouping and Motion Trajectory Priors
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2508.15535