VidAnimator: User-Guided Stylized 3D Character Animation from Human Videos

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ye, Xinwu, Yao, Jun-Hsiang, Feng, Jielin, Mei, Shuhong, Lan, Xingyu, Chen, Siming
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913973306130432
author Ye, Xinwu
Yao, Jun-Hsiang
Feng, Jielin
Mei, Shuhong
Lan, Xingyu
Chen, Siming
author_facet Ye, Xinwu
Yao, Jun-Hsiang
Feng, Jielin
Mei, Shuhong
Lan, Xingyu
Chen, Siming
contents With captivating visual effects, stylized 3D character animation has gained widespread use in cinematic production, advertising, social media, and the potential development of virtual reality (VR) non-player characters (NPCs). However, animating stylized 3D characters often requires significant time and effort from animators. We propose a mixed-initiative framework and interactive system to enable stylized 3D characters to mimic motion in human videos. The framework takes a single-view human video and a stylized 3D character (the target character) as input, captures the motion of the video, and then transfers the motion to the target character. In addition, it involves two interaction modules for customizing the result. Accordingly, the system incorporates two authoring tools that empower users with intuitive modification. A questionnaire study offers tangible evidence of the framework's capability of generating natural stylized 3D character animations similar to the motion in the video. Additionally, three case studies demonstrate the utility of our approach in creating diverse results.
format Preprint
id arxiv_https___arxiv_org_abs_2508_01878
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle VidAnimator: User-Guided Stylized 3D Character Animation from Human Videos
Ye, Xinwu
Yao, Jun-Hsiang
Feng, Jielin
Mei, Shuhong
Lan, Xingyu
Chen, Siming
Human-Computer Interaction
With captivating visual effects, stylized 3D character animation has gained widespread use in cinematic production, advertising, social media, and the potential development of virtual reality (VR) non-player characters (NPCs). However, animating stylized 3D characters often requires significant time and effort from animators. We propose a mixed-initiative framework and interactive system to enable stylized 3D characters to mimic motion in human videos. The framework takes a single-view human video and a stylized 3D character (the target character) as input, captures the motion of the video, and then transfers the motion to the target character. In addition, it involves two interaction modules for customizing the result. Accordingly, the system incorporates two authoring tools that empower users with intuitive modification. A questionnaire study offers tangible evidence of the framework's capability of generating natural stylized 3D character animations similar to the motion in the video. Additionally, three case studies demonstrate the utility of our approach in creating diverse results.
title VidAnimator: User-Guided Stylized 3D Character Animation from Human Videos
topic Human-Computer Interaction
url https://arxiv.org/abs/2508.01878