DeClotH: Decomposable 3D Cloth and Human Body Reconstruction from a Single Image

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Nam, Hyeongjin, Kim, Donghwan, Oh, Jeongtaek, Lee, Kyoung Mu
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916661981872128
author Nam, Hyeongjin
Kim, Donghwan
Oh, Jeongtaek
Lee, Kyoung Mu
author_facet Nam, Hyeongjin
Kim, Donghwan
Oh, Jeongtaek
Lee, Kyoung Mu
contents Most existing methods of 3D clothed human reconstruction from a single image treat the clothed human as a single object without distinguishing between cloth and human body. In this regard, we present DeClotH, which separately reconstructs 3D cloth and human body from a single image. This task remains largely unexplored due to the extreme occlusion between cloth and the human body, making it challenging to infer accurate geometries and textures. Moreover, while recent 3D human reconstruction methods have achieved impressive results using text-to-image diffusion models, directly applying such an approach to this problem often leads to incorrect guidance, particularly in reconstructing 3D cloth. To address these challenges, we propose two core designs in our framework. First, to alleviate the occlusion issue, we leverage 3D template models of cloth and human body as regularizations, which provide strong geometric priors to prevent erroneous reconstruction by the occlusion. Second, we introduce a cloth diffusion model specifically designed to provide contextual information about cloth appearance, thereby enhancing the reconstruction of 3D cloth. Qualitative and quantitative experiments demonstrate that our proposed approach is highly effective in reconstructing both 3D cloth and the human body. More qualitative results are provided at https://hygenie1228.github.io/DeClotH/.
format Preprint
id arxiv_https___arxiv_org_abs_2503_19373
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle DeClotH: Decomposable 3D Cloth and Human Body Reconstruction from a Single Image
Nam, Hyeongjin
Kim, Donghwan
Oh, Jeongtaek
Lee, Kyoung Mu
Computer Vision and Pattern Recognition
Artificial Intelligence
Most existing methods of 3D clothed human reconstruction from a single image treat the clothed human as a single object without distinguishing between cloth and human body. In this regard, we present DeClotH, which separately reconstructs 3D cloth and human body from a single image. This task remains largely unexplored due to the extreme occlusion between cloth and the human body, making it challenging to infer accurate geometries and textures. Moreover, while recent 3D human reconstruction methods have achieved impressive results using text-to-image diffusion models, directly applying such an approach to this problem often leads to incorrect guidance, particularly in reconstructing 3D cloth. To address these challenges, we propose two core designs in our framework. First, to alleviate the occlusion issue, we leverage 3D template models of cloth and human body as regularizations, which provide strong geometric priors to prevent erroneous reconstruction by the occlusion. Second, we introduce a cloth diffusion model specifically designed to provide contextual information about cloth appearance, thereby enhancing the reconstruction of 3D cloth. Qualitative and quantitative experiments demonstrate that our proposed approach is highly effective in reconstructing both 3D cloth and the human body. More qualitative results are provided at https://hygenie1228.github.io/DeClotH/.
title DeClotH: Decomposable 3D Cloth and Human Body Reconstruction from a Single Image
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2503.19373