Diffusion-based Pose Refinement and Muti-hypothesis Generation for 3D Human Pose Estimaiton
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909067540168704 |
|---|---|
| author | Kang, Hongbo Wang, Yong Liu, Mengyuan Wu, Doudou Liu, Peng Yuan, Xinlin Yang, Wenming |
| author_facet | Kang, Hongbo Wang, Yong Liu, Mengyuan Wu, Doudou Liu, Peng Yuan, Xinlin Yang, Wenming |
| contents | Previous probabilistic models for 3D Human Pose Estimation (3DHPE) aimed to enhance pose accuracy by generating multiple hypotheses. However, most of the hypotheses generated deviate substantially from the true pose. Compared to deterministic models, the excessive uncertainty in probabilistic models leads to weaker performance in single-hypothesis prediction. To address these two challenges, we propose a diffusion-based refinement framework called DRPose, which refines the output of deterministic models by reverse diffusion and achieves more suitable multi-hypothesis prediction for the current pose benchmark by multi-step refinement with multiple noises. To this end, we propose a Scalable Graph Convolution Transformer (SGCT) and a Pose Refinement Module (PRM) for denoising and refining. Extensive experiments on Human3.6M and MPI-INF-3DHP datasets demonstrate that our method achieves state-of-the-art performance on both single and multi-hypothesis 3DHPE. Code is available at https://github.com/KHB1698/DRPose. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_04921 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Diffusion-based Pose Refinement and Muti-hypothesis Generation for 3D Human Pose Estimaiton Kang, Hongbo Wang, Yong Liu, Mengyuan Wu, Doudou Liu, Peng Yuan, Xinlin Yang, Wenming Computer Vision and Pattern Recognition Previous probabilistic models for 3D Human Pose Estimation (3DHPE) aimed to enhance pose accuracy by generating multiple hypotheses. However, most of the hypotheses generated deviate substantially from the true pose. Compared to deterministic models, the excessive uncertainty in probabilistic models leads to weaker performance in single-hypothesis prediction. To address these two challenges, we propose a diffusion-based refinement framework called DRPose, which refines the output of deterministic models by reverse diffusion and achieves more suitable multi-hypothesis prediction for the current pose benchmark by multi-step refinement with multiple noises. To this end, we propose a Scalable Graph Convolution Transformer (SGCT) and a Pose Refinement Module (PRM) for denoising and refining. Extensive experiments on Human3.6M and MPI-INF-3DHP datasets demonstrate that our method achieves state-of-the-art performance on both single and multi-hypothesis 3DHPE. Code is available at https://github.com/KHB1698/DRPose. |
| title | Diffusion-based Pose Refinement and Muti-hypothesis Generation for 3D Human Pose Estimaiton |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2401.04921 |