Saved in:
Bibliographic Details
Main Authors: Li, Xuan, Yu, Chang, Du, Wenxin, Jiang, Ying, Xie, Tianyi, Chen, Yunuo, Yang, Yin, Jiang, Chenfanfu
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2502.03449
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • Recent advances in large models have significantly advanced image-to-3D reconstruction. However, the generated models are often fused into a single piece, limiting their applicability in downstream tasks. This paper focuses on 3D garment generation, a key area for applications like virtual try-on with dynamic garment animations, which require garments to be separable and simulation-ready. We introduce Dress-1-to-3, a novel pipeline that reconstructs physics-plausible, simulation-ready separated garments with sewing patterns and humans from an in-the-wild image. Starting with the image, our approach combines a pre-trained image-to-sewing pattern generation model for creating coarse sewing patterns with a pre-trained multi-view diffusion model to produce multi-view images. The sewing pattern is further refined using a differentiable garment simulator based on the generated multi-view images. Versatile experiments demonstrate that our optimization approach substantially enhances the geometric alignment of the reconstructed 3D garments and humans with the input image. Furthermore, by integrating a texture generation module and a human motion generation module, we produce customized physics-plausible and realistic dynamic garment demonstrations. Project page: https://dress-1-to-3.github.io/