Saved in:
Bibliographic Details
Main Authors: Hsu, Chih-Hsiang, Jang, Jyh-Shing Roger
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2410.20731
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909370343751680
author Hsu, Chih-Hsiang
Jang, Jyh-Shing Roger
author_facet Hsu, Chih-Hsiang
Jang, Jyh-Shing Roger
contents Current approaches in 3D human pose estimation primarily focus on regressing 3D joint locations, often neglecting critical physical constraints such as bone length consistency and body symmetry. This work introduces a recurrent neural network architecture designed to capture holistic information across entire video sequences, enabling accurate prediction of bone lengths. To enhance training effectiveness, we propose a novel augmentation strategy using synthetic bone lengths that adhere to physical constraints. Moreover, we present a bone length adjustment method that preserves bone orientations while substituting bone lengths with predicted values. Our results demonstrate that existing 3D human pose estimation models can be significantly enhanced through this adjustment process. Furthermore, we fine-tune human pose estimation models using inferred bone lengths, observing notable improvements. Our bone length prediction model surpasses the previous best results, and our adjustment and fine-tuning method enhance performance across several metrics on the Human3.6M dataset.
format Preprint
id arxiv_https___arxiv_org_abs_2410_20731
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle BLAPose: Enhancing 3D Human Pose Estimation with Bone Length Adjustment
Hsu, Chih-Hsiang
Jang, Jyh-Shing Roger
Computer Vision and Pattern Recognition
Current approaches in 3D human pose estimation primarily focus on regressing 3D joint locations, often neglecting critical physical constraints such as bone length consistency and body symmetry. This work introduces a recurrent neural network architecture designed to capture holistic information across entire video sequences, enabling accurate prediction of bone lengths. To enhance training effectiveness, we propose a novel augmentation strategy using synthetic bone lengths that adhere to physical constraints. Moreover, we present a bone length adjustment method that preserves bone orientations while substituting bone lengths with predicted values. Our results demonstrate that existing 3D human pose estimation models can be significantly enhanced through this adjustment process. Furthermore, we fine-tune human pose estimation models using inferred bone lengths, observing notable improvements. Our bone length prediction model surpasses the previous best results, and our adjustment and fine-tuning method enhance performance across several metrics on the Human3.6M dataset.
title BLAPose: Enhancing 3D Human Pose Estimation with Bone Length Adjustment
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2410.20731