DiffAvatar: Simulation-Ready Garment Optimization with Differentiable Simulation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Li, Yifei, Chen, Hsiao-yu, Larionov, Egor, Sarafianos, Nikolaos, Matusik, Wojciech, Stuyck, Tuur
Format: Preprint
Veröffentlicht: 2023
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913291590172672
author Li, Yifei
Chen, Hsiao-yu
Larionov, Egor
Sarafianos, Nikolaos
Matusik, Wojciech
Stuyck, Tuur
author_facet Li, Yifei
Chen, Hsiao-yu
Larionov, Egor
Sarafianos, Nikolaos
Matusik, Wojciech
Stuyck, Tuur
contents The realism of digital avatars is crucial in enabling telepresence applications with self-expression and customization. While physical simulations can produce realistic motions for clothed humans, they require high-quality garment assets with associated physical parameters for cloth simulations. However, manually creating these assets and calibrating their parameters is labor-intensive and requires specialized expertise. Current methods focus on reconstructing geometry, but don't generate complete assets for physics-based applications. To address this gap, we propose \papername,~a novel approach that performs body and garment co-optimization using differentiable simulation. By integrating physical simulation into the optimization loop and accounting for the complex nonlinear behavior of cloth and its intricate interaction with the body, our framework recovers body and garment geometry and extracts important material parameters in a physically plausible way. Our experiments demonstrate that our approach generates realistic clothing and body shape suitable for downstream applications. We provide additional insights and results on our webpage: https://people.csail.mit.edu/liyifei/publication/diffavatar/
format Preprint
id arxiv_https___arxiv_org_abs_2311_12194
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle DiffAvatar: Simulation-Ready Garment Optimization with Differentiable Simulation
Li, Yifei
Chen, Hsiao-yu
Larionov, Egor
Sarafianos, Nikolaos
Matusik, Wojciech
Stuyck, Tuur
Computer Vision and Pattern Recognition
The realism of digital avatars is crucial in enabling telepresence applications with self-expression and customization. While physical simulations can produce realistic motions for clothed humans, they require high-quality garment assets with associated physical parameters for cloth simulations. However, manually creating these assets and calibrating their parameters is labor-intensive and requires specialized expertise. Current methods focus on reconstructing geometry, but don't generate complete assets for physics-based applications. To address this gap, we propose \papername,~a novel approach that performs body and garment co-optimization using differentiable simulation. By integrating physical simulation into the optimization loop and accounting for the complex nonlinear behavior of cloth and its intricate interaction with the body, our framework recovers body and garment geometry and extracts important material parameters in a physically plausible way. Our experiments demonstrate that our approach generates realistic clothing and body shape suitable for downstream applications. We provide additional insights and results on our webpage: https://people.csail.mit.edu/liyifei/publication/diffavatar/
title DiffAvatar: Simulation-Ready Garment Optimization with Differentiable Simulation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2311.12194