Measuring Physical Plausibility of 3D Human Poses Using Physics Simulation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Louis, Nathan, Khoshlessan, Mahzad, Corso, Jason J.
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909482287628288
author Louis, Nathan
Khoshlessan, Mahzad
Corso, Jason J.
author_facet Louis, Nathan
Khoshlessan, Mahzad
Corso, Jason J.
contents Modeling humans in physical scenes is vital for understanding human-environment interactions for applications involving augmented reality or assessment of human actions from video (e.g. sports or physical rehabilitation). State-of-the-art literature begins with a 3D human pose, from monocular or multiple views, and uses this representation to ground the person within a 3D world space. While standard metrics for accuracy capture joint position errors, they do not consider physical plausibility of the 3D pose. This limitation has motivated researchers to propose other metrics evaluating jitter, floor penetration, and unbalanced postures. Yet, these approaches measure independent instances of errors and are not representative of balance or stability during motion. In this work, we propose measuring physical plausibility from within physics simulation. We introduce two metrics to capture the physical plausibility and stability of predicted 3D poses from any 3D Human Pose Estimation model. Using physics simulation, we discover correlations with existing plausibility metrics and measuring stability during motion. We evaluate and compare the performances of two state-of-the-art methods, a multi-view triangulated baseline, and ground truth 3D markers from the Human3.6m dataset.
format Preprint
id arxiv_https___arxiv_org_abs_2502_04483
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Measuring Physical Plausibility of 3D Human Poses Using Physics Simulation
Louis, Nathan
Khoshlessan, Mahzad
Corso, Jason J.
Computer Vision and Pattern Recognition
Modeling humans in physical scenes is vital for understanding human-environment interactions for applications involving augmented reality or assessment of human actions from video (e.g. sports or physical rehabilitation). State-of-the-art literature begins with a 3D human pose, from monocular or multiple views, and uses this representation to ground the person within a 3D world space. While standard metrics for accuracy capture joint position errors, they do not consider physical plausibility of the 3D pose. This limitation has motivated researchers to propose other metrics evaluating jitter, floor penetration, and unbalanced postures. Yet, these approaches measure independent instances of errors and are not representative of balance or stability during motion. In this work, we propose measuring physical plausibility from within physics simulation. We introduce two metrics to capture the physical plausibility and stability of predicted 3D poses from any 3D Human Pose Estimation model. Using physics simulation, we discover correlations with existing plausibility metrics and measuring stability during motion. We evaluate and compare the performances of two state-of-the-art methods, a multi-view triangulated baseline, and ground truth 3D markers from the Human3.6m dataset.
title Measuring Physical Plausibility of 3D Human Poses Using Physics Simulation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2502.04483