ToMiE: Towards Explicit Exoskeleton for the Reconstruction of Complicated 3D Human Avatars
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866916811335794688 |
|---|---|
| author | Zhan, Yifan Zhu, Qingtian Niu, Muyao Ma, Mingze Zhao, Jiancheng Zhong, Zhihang Sun, Xiao Qiao, Yu Zheng, Yinqiang |
| author_facet | Zhan, Yifan Zhu, Qingtian Niu, Muyao Ma, Mingze Zhao, Jiancheng Zhong, Zhihang Sun, Xiao Qiao, Yu Zheng, Yinqiang |
| contents | In this paper, we highlight a critical yet often overlooked factor in most 3D human tasks, namely modeling complicated 3D human with with hand-held objects or loose-fitting clothing. It is known that the parameterized formulation of SMPL is able to fit human skin; while hand-held objects and loose-fitting clothing, are difficult to get modeled within the unified framework, since their movements are usually decoupled with the human body. To enhance the capability of SMPL skeleton in response to this situation, we propose a growth strategy that enables the joint tree of the skeleton to expand adaptively. Specifically, our method, called ToMiE, consists of parent joints localization and external joints optimization. For parent joints localization, we employ a gradient-based approach guided by both LBS blending weights and motion kernels. Once the external joints are obtained, we proceed to optimize their transformations in SE(3) across different frames, enabling rendering and explicit animation. ToMiE manages to outperform other methods across various cases with hand-held objects and loose-fitting clothing, not only in rendering quality but also by offering free animation of grown joints, thereby enhancing the expressive ability of SMPL skeleton for a broader range of applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_08082 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | ToMiE: Towards Explicit Exoskeleton for the Reconstruction of Complicated 3D Human Avatars Zhan, Yifan Zhu, Qingtian Niu, Muyao Ma, Mingze Zhao, Jiancheng Zhong, Zhihang Sun, Xiao Qiao, Yu Zheng, Yinqiang Computer Vision and Pattern Recognition In this paper, we highlight a critical yet often overlooked factor in most 3D human tasks, namely modeling complicated 3D human with with hand-held objects or loose-fitting clothing. It is known that the parameterized formulation of SMPL is able to fit human skin; while hand-held objects and loose-fitting clothing, are difficult to get modeled within the unified framework, since their movements are usually decoupled with the human body. To enhance the capability of SMPL skeleton in response to this situation, we propose a growth strategy that enables the joint tree of the skeleton to expand adaptively. Specifically, our method, called ToMiE, consists of parent joints localization and external joints optimization. For parent joints localization, we employ a gradient-based approach guided by both LBS blending weights and motion kernels. Once the external joints are obtained, we proceed to optimize their transformations in SE(3) across different frames, enabling rendering and explicit animation. ToMiE manages to outperform other methods across various cases with hand-held objects and loose-fitting clothing, not only in rendering quality but also by offering free animation of grown joints, thereby enhancing the expressive ability of SMPL skeleton for a broader range of applications. |
| title | ToMiE: Towards Explicit Exoskeleton for the Reconstruction of Complicated 3D Human Avatars |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2410.08082 |