UNIC: Neural Garment Deformation Field for Real-time Clothed Character Animation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Zhao, Chengfeng, Qi, Junbo, Liu, Yulou, Dou, Zhiyang, Li, Minchen, Komura, Taku, Liu, Ziwei, Wang, Wenping, Liu, Yuan
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914425350389760
author Zhao, Chengfeng
Qi, Junbo
Liu, Yulou
Dou, Zhiyang
Li, Minchen
Komura, Taku
Liu, Ziwei
Wang, Wenping
Liu, Yuan
author_facet Zhao, Chengfeng
Qi, Junbo
Liu, Yulou
Dou, Zhiyang
Li, Minchen
Komura, Taku
Liu, Ziwei
Wang, Wenping
Liu, Yuan
contents Simulating physically realistic garment deformations is an essential task for virtual immersive experience, which is often achieved by physics simulation methods. However, these methods are typically time-consuming, computationally demanding, and require costly hardware, which is not suitable for real-time applications. Recent learning-based methods tried to resolve this problem by training graph neural networks to learn the garment deformation on vertices, which, however, fail to capture the intricate deformation of complex garment meshes with complex topologies. In this paper, we introduce a novel neural deformation field-based method, named UNIC, to animate the garments of an avatar in real time, given the motion sequences. Our key idea is to learn the instance-specific neural deformation field to animate the garment meshes. Such an instance-specific learning scheme does not require UNIC to generalize to new garments but only to new motion sequences, which greatly reduces the difficulty in training and improves the deformation quality. Moreover, neural deformation fields map the 3D points to their deformation offsets, which not only avoids handling topologies of the complex garments but also injects a natural smoothness constraint in the deformation learning. Extensive experiments have been conducted on various kinds of garment meshes to demonstrate the effectiveness and efficiency of UNIC over baseline methods, making it potentially practical and useful in real-world interactive applications like video games.
format Preprint
id arxiv_https___arxiv_org_abs_2603_25580
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle UNIC: Neural Garment Deformation Field for Real-time Clothed Character Animation
Zhao, Chengfeng
Qi, Junbo
Liu, Yulou
Dou, Zhiyang
Li, Minchen
Komura, Taku
Liu, Ziwei
Wang, Wenping
Liu, Yuan
Computer Vision and Pattern Recognition
Simulating physically realistic garment deformations is an essential task for virtual immersive experience, which is often achieved by physics simulation methods. However, these methods are typically time-consuming, computationally demanding, and require costly hardware, which is not suitable for real-time applications. Recent learning-based methods tried to resolve this problem by training graph neural networks to learn the garment deformation on vertices, which, however, fail to capture the intricate deformation of complex garment meshes with complex topologies. In this paper, we introduce a novel neural deformation field-based method, named UNIC, to animate the garments of an avatar in real time, given the motion sequences. Our key idea is to learn the instance-specific neural deformation field to animate the garment meshes. Such an instance-specific learning scheme does not require UNIC to generalize to new garments but only to new motion sequences, which greatly reduces the difficulty in training and improves the deformation quality. Moreover, neural deformation fields map the 3D points to their deformation offsets, which not only avoids handling topologies of the complex garments but also injects a natural smoothness constraint in the deformation learning. Extensive experiments have been conducted on various kinds of garment meshes to demonstrate the effectiveness and efficiency of UNIC over baseline methods, making it potentially practical and useful in real-world interactive applications like video games.
title UNIC: Neural Garment Deformation Field for Real-time Clothed Character Animation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.25580