Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2401.17212 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916112977887232 |
|---|---|
| author | Gu, Dongjun Shim, Jaehyeok Jang, Jaehoon Kang, Changwoo Joo, Kyungdon |
| author_facet | Gu, Dongjun Shim, Jaehyeok Jang, Jaehoon Kang, Changwoo Joo, Kyungdon |
| contents | Among various interactions between humans, such as eye contact and gestures, physical interactions by contact can act as an essential moment in understanding human behaviors. Inspired by this fact, given a 3D partner human with the desired interaction label, we introduce a new task of 3D human generation in terms of physical contact. Unlike previous works of interacting with static objects or scenes, a given partner human can have diverse poses and different contact regions according to the type of interaction. To handle this challenge, we propose a novel method of generating interactive 3D humans for a given partner human based on a guided diffusion framework. Specifically, we newly present a contact prediction module that adaptively estimates potential contact regions between two input humans according to the interaction label. Using the estimated potential contact regions as complementary guidances, we dynamically enforce ContactGen to generate interactive 3D humans for a given partner human within a guided diffusion model. We demonstrate ContactGen on the CHI3D dataset, where our method generates physically plausible and diverse poses compared to comparison methods. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_17212 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | ContactGen: Contact-Guided Interactive 3D Human Generation for Partners Gu, Dongjun Shim, Jaehyeok Jang, Jaehoon Kang, Changwoo Joo, Kyungdon Computer Vision and Pattern Recognition Among various interactions between humans, such as eye contact and gestures, physical interactions by contact can act as an essential moment in understanding human behaviors. Inspired by this fact, given a 3D partner human with the desired interaction label, we introduce a new task of 3D human generation in terms of physical contact. Unlike previous works of interacting with static objects or scenes, a given partner human can have diverse poses and different contact regions according to the type of interaction. To handle this challenge, we propose a novel method of generating interactive 3D humans for a given partner human based on a guided diffusion framework. Specifically, we newly present a contact prediction module that adaptively estimates potential contact regions between two input humans according to the interaction label. Using the estimated potential contact regions as complementary guidances, we dynamically enforce ContactGen to generate interactive 3D humans for a given partner human within a guided diffusion model. We demonstrate ContactGen on the CHI3D dataset, where our method generates physically plausible and diverse poses compared to comparison methods. |
| title | ContactGen: Contact-Guided Interactive 3D Human Generation for Partners |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2401.17212 |