AniDoc: Animation Creation Made Easier

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Meng, Yihao, Ouyang, Hao, Wang, Hanlin, Wang, Qiuyu, Wang, Wen, Cheng, Ka Leong, Liu, Zhiheng, Shen, Yujun, Qu, Huamin
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913670592724992
author Meng, Yihao
Ouyang, Hao
Wang, Hanlin
Wang, Qiuyu
Wang, Wen
Cheng, Ka Leong
Liu, Zhiheng
Shen, Yujun
Qu, Huamin
author_facet Meng, Yihao
Ouyang, Hao
Wang, Hanlin
Wang, Qiuyu
Wang, Wen
Cheng, Ka Leong
Liu, Zhiheng
Shen, Yujun
Qu, Huamin
contents The production of 2D animation follows an industry-standard workflow, encompassing four essential stages: character design, keyframe animation, in-betweening, and coloring. Our research focuses on reducing the labor costs in the above process by harnessing the potential of increasingly powerful generative AI. Using video diffusion models as the foundation, AniDoc emerges as a video line art colorization tool, which automatically converts sketch sequences into colored animations following the reference character specification. Our model exploits correspondence matching as an explicit guidance, yielding strong robustness to the variations (e.g., posture) between the reference character and each line art frame. In addition, our model could even automate the in-betweening process, such that users can easily create a temporally consistent animation by simply providing a character image as well as the start and end sketches. Our code is available at: https://yihao-meng.github.io/AniDoc_demo.
format Preprint
id arxiv_https___arxiv_org_abs_2412_14173
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle AniDoc: Animation Creation Made Easier
Meng, Yihao
Ouyang, Hao
Wang, Hanlin
Wang, Qiuyu
Wang, Wen
Cheng, Ka Leong
Liu, Zhiheng
Shen, Yujun
Qu, Huamin
Computer Vision and Pattern Recognition
The production of 2D animation follows an industry-standard workflow, encompassing four essential stages: character design, keyframe animation, in-betweening, and coloring. Our research focuses on reducing the labor costs in the above process by harnessing the potential of increasingly powerful generative AI. Using video diffusion models as the foundation, AniDoc emerges as a video line art colorization tool, which automatically converts sketch sequences into colored animations following the reference character specification. Our model exploits correspondence matching as an explicit guidance, yielding strong robustness to the variations (e.g., posture) between the reference character and each line art frame. In addition, our model could even automate the in-betweening process, such that users can easily create a temporally consistent animation by simply providing a character image as well as the start and end sketches. Our code is available at: https://yihao-meng.github.io/AniDoc_demo.
title AniDoc: Animation Creation Made Easier
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2412.14173