From Air to Wear: Personalized 3D Digital Fashion with AR/VR Immersive 3D Sketching

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Zang, Ying, Hu, Yuanqi, Chen, Xinyu, Xu, Yuxia, Wang, Suhui, Yu, Chunan, Zhu, Lanyun, Ji, Deyi, Xu, Xin, Chen, Tianrun
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912376620580864
author Zang, Ying
Hu, Yuanqi
Chen, Xinyu
Xu, Yuxia
Wang, Suhui
Yu, Chunan
Zhu, Lanyun
Ji, Deyi
Xu, Xin
Chen, Tianrun
author_facet Zang, Ying
Hu, Yuanqi
Chen, Xinyu
Xu, Yuxia
Wang, Suhui
Yu, Chunan
Zhu, Lanyun
Ji, Deyi
Xu, Xin
Chen, Tianrun
contents In the era of immersive consumer electronics, such as AR/VR headsets and smart devices, people increasingly seek ways to express their identity through virtual fashion. However, existing 3D garment design tools remain inaccessible to everyday users due to steep technical barriers and limited data. In this work, we introduce a 3D sketch-driven 3D garment generation framework that empowers ordinary users - even those without design experience - to create high-quality digital clothing through simple 3D sketches in AR/VR environments. By combining a conditional diffusion model, a sketch encoder trained in a shared latent space, and an adaptive curriculum learning strategy, our system interprets imprecise, free-hand input and produces realistic, personalized garments. To address the scarcity of training data, we also introduce KO3DClothes, a new dataset of paired 3D garments and user-created sketches. Extensive experiments and user studies confirm that our method significantly outperforms existing baselines in both fidelity and usability, demonstrating its promise for democratized fashion design on next-generation consumer platforms.
format Preprint
id arxiv_https___arxiv_org_abs_2505_09998
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle From Air to Wear: Personalized 3D Digital Fashion with AR/VR Immersive 3D Sketching
Zang, Ying
Hu, Yuanqi
Chen, Xinyu
Xu, Yuxia
Wang, Suhui
Yu, Chunan
Zhu, Lanyun
Ji, Deyi
Xu, Xin
Chen, Tianrun
Computer Vision and Pattern Recognition
In the era of immersive consumer electronics, such as AR/VR headsets and smart devices, people increasingly seek ways to express their identity through virtual fashion. However, existing 3D garment design tools remain inaccessible to everyday users due to steep technical barriers and limited data. In this work, we introduce a 3D sketch-driven 3D garment generation framework that empowers ordinary users - even those without design experience - to create high-quality digital clothing through simple 3D sketches in AR/VR environments. By combining a conditional diffusion model, a sketch encoder trained in a shared latent space, and an adaptive curriculum learning strategy, our system interprets imprecise, free-hand input and produces realistic, personalized garments. To address the scarcity of training data, we also introduce KO3DClothes, a new dataset of paired 3D garments and user-created sketches. Extensive experiments and user studies confirm that our method significantly outperforms existing baselines in both fidelity and usability, demonstrating its promise for democratized fashion design on next-generation consumer platforms.
title From Air to Wear: Personalized 3D Digital Fashion with AR/VR Immersive 3D Sketching
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2505.09998