Leveraging 2D Masked Reconstruction for Domain Adaptation of 3D Pose Estimation
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909510280413184 |
|---|---|
| author | Park, Hansoo Kim, Chanwoo Kim, Jihyeon Cho, Hoseong Truong, Nhat Nguyen Bao Kim, Taehwan Baek, Seungryul |
| author_facet | Park, Hansoo Kim, Chanwoo Kim, Jihyeon Cho, Hoseong Truong, Nhat Nguyen Bao Kim, Taehwan Baek, Seungryul |
| contents | RGB-based 3D pose estimation methods have been successful with the development of deep learning and the emergence of high-quality 3D pose datasets. However, most existing methods do not operate well for testing images whose distribution is far from that of training data. However, most existing methods do not operate well for testing images whose distribution is far from that of training data. This problem might be alleviated by involving diverse data during training, however it is non-trivial to collect such diverse data with corresponding labels (i.e. 3D pose). In this paper, we introduced an unsupervised domain adaptation framework for 3D pose estimation that utilizes the unlabeled data in addition to labeled data via masked image modeling (MIM) framework. Foreground-centric reconstruction and attention regularization are further proposed to increase the effectiveness of unlabeled data usage. Experiments are conducted on the various datasets in human and hand pose estimation tasks, especially using the cross-domain scenario. We demonstrated the effectiveness of ours by achieving the state-of-the-art accuracy on all datasets. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_08408 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Leveraging 2D Masked Reconstruction for Domain Adaptation of 3D Pose Estimation Park, Hansoo Kim, Chanwoo Kim, Jihyeon Cho, Hoseong Truong, Nhat Nguyen Bao Kim, Taehwan Baek, Seungryul Computer Vision and Pattern Recognition Machine Learning 68T07 RGB-based 3D pose estimation methods have been successful with the development of deep learning and the emergence of high-quality 3D pose datasets. However, most existing methods do not operate well for testing images whose distribution is far from that of training data. However, most existing methods do not operate well for testing images whose distribution is far from that of training data. This problem might be alleviated by involving diverse data during training, however it is non-trivial to collect such diverse data with corresponding labels (i.e. 3D pose). In this paper, we introduced an unsupervised domain adaptation framework for 3D pose estimation that utilizes the unlabeled data in addition to labeled data via masked image modeling (MIM) framework. Foreground-centric reconstruction and attention regularization are further proposed to increase the effectiveness of unlabeled data usage. Experiments are conducted on the various datasets in human and hand pose estimation tasks, especially using the cross-domain scenario. We demonstrated the effectiveness of ours by achieving the state-of-the-art accuracy on all datasets. |
| title | Leveraging 2D Masked Reconstruction for Domain Adaptation of 3D Pose Estimation |
| topic | Computer Vision and Pattern Recognition Machine Learning 68T07 |
| url | https://arxiv.org/abs/2501.08408 |