MuGa-VTON: Multi-Garment Virtual Try-On via Diffusion Transformers with Prompt Customization
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866909733601935360 |
|---|---|
| author | Deria, Ankan Mahapatra, Dwarikanath Bozorgtabar, Behzad Chakraborty, Mohna Chakraborty, Snehashis Roy, Sudipta |
| author_facet | Deria, Ankan Mahapatra, Dwarikanath Bozorgtabar, Behzad Chakraborty, Mohna Chakraborty, Snehashis Roy, Sudipta |
| contents | Virtual try-on seeks to generate photorealistic images of individuals in desired garments, a task that must simultaneously preserve personal identity and garment fidelity for practical use in fashion retail and personalization. However, existing methods typically handle upper and lower garments separately, rely on heavy preprocessing, and often fail to preserve person-specific cues such as tattoos, accessories, and body shape-resulting in limited realism and flexibility. To this end, we introduce MuGa-VTON, a unified multi-garment diffusion framework that jointly models upper and lower garments together with person identity in a shared latent space. Specifically, we proposed three key modules: the Garment Representation Module (GRM) for capturing both garment semantics, the Person Representation Module (PRM) for encoding identity and pose cues, and the A-DiT fusion module, which integrates garment, person, and text-prompt features through a diffusion transformer. This architecture supports prompt-based customization, allowing fine-grained garment modifications with minimal user input. Extensive experiments on the VITON-HD and DressCode benchmarks demonstrate that MuGa-VTON outperforms existing methods in both qualitative and quantitative evaluations, producing high-fidelity, identity-preserving results suitable for real-world virtual try-on applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_08488 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | MuGa-VTON: Multi-Garment Virtual Try-On via Diffusion Transformers with Prompt Customization Deria, Ankan Mahapatra, Dwarikanath Bozorgtabar, Behzad Chakraborty, Mohna Chakraborty, Snehashis Roy, Sudipta Computer Vision and Pattern Recognition Virtual try-on seeks to generate photorealistic images of individuals in desired garments, a task that must simultaneously preserve personal identity and garment fidelity for practical use in fashion retail and personalization. However, existing methods typically handle upper and lower garments separately, rely on heavy preprocessing, and often fail to preserve person-specific cues such as tattoos, accessories, and body shape-resulting in limited realism and flexibility. To this end, we introduce MuGa-VTON, a unified multi-garment diffusion framework that jointly models upper and lower garments together with person identity in a shared latent space. Specifically, we proposed three key modules: the Garment Representation Module (GRM) for capturing both garment semantics, the Person Representation Module (PRM) for encoding identity and pose cues, and the A-DiT fusion module, which integrates garment, person, and text-prompt features through a diffusion transformer. This architecture supports prompt-based customization, allowing fine-grained garment modifications with minimal user input. Extensive experiments on the VITON-HD and DressCode benchmarks demonstrate that MuGa-VTON outperforms existing methods in both qualitative and quantitative evaluations, producing high-fidelity, identity-preserving results suitable for real-world virtual try-on applications. |
| title | MuGa-VTON: Multi-Garment Virtual Try-On via Diffusion Transformers with Prompt Customization |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2508.08488 |