Human Motion Capture from Loose and Sparse Inertial Sensors with Garment-aware Diffusion Models
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866916894991187968 |
|---|---|
| author | Ilic, Andela Jiang, Jiaxi Streli, Paul Liu, Xintong Holz, Christian |
| author_facet | Ilic, Andela Jiang, Jiaxi Streli, Paul Liu, Xintong Holz, Christian |
| contents | Motion capture using sparse inertial sensors has shown great promise due to its portability and lack of occlusion issues compared to camera-based tracking. Existing approaches typically assume that IMU sensors are tightly attached to the human body. However, this assumption often does not hold in real-world scenarios. In this paper, we present Garment Inertial Poser (GaIP), a method for estimating full-body poses from sparse and loosely attached IMU sensors. We first simulate IMU recordings using an existing garment-aware human motion dataset. Our transformer-based diffusion models synthesize loose IMU data and estimate human poses from this challenging loose IMU data. We also demonstrate that incorporating garment-related parameters during training on loose IMU data effectively maintains expressiveness and enhances the ability to capture variations introduced by looser or tighter garments. Our experiments show that our diffusion methods trained on simulated and synthetic data outperform state-of-the-art inertial full-body pose estimators, both quantitatively and qualitatively, opening up a promising direction for future research on motion capture from such realistic sensor placements. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_15290 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Human Motion Capture from Loose and Sparse Inertial Sensors with Garment-aware Diffusion Models Ilic, Andela Jiang, Jiaxi Streli, Paul Liu, Xintong Holz, Christian Graphics Artificial Intelligence Computer Vision and Pattern Recognition Human-Computer Interaction 68T07, 68T45, 68U01 I.2; I.3; I.4; I.5 Motion capture using sparse inertial sensors has shown great promise due to its portability and lack of occlusion issues compared to camera-based tracking. Existing approaches typically assume that IMU sensors are tightly attached to the human body. However, this assumption often does not hold in real-world scenarios. In this paper, we present Garment Inertial Poser (GaIP), a method for estimating full-body poses from sparse and loosely attached IMU sensors. We first simulate IMU recordings using an existing garment-aware human motion dataset. Our transformer-based diffusion models synthesize loose IMU data and estimate human poses from this challenging loose IMU data. We also demonstrate that incorporating garment-related parameters during training on loose IMU data effectively maintains expressiveness and enhances the ability to capture variations introduced by looser or tighter garments. Our experiments show that our diffusion methods trained on simulated and synthetic data outperform state-of-the-art inertial full-body pose estimators, both quantitatively and qualitatively, opening up a promising direction for future research on motion capture from such realistic sensor placements. |
| title | Human Motion Capture from Loose and Sparse Inertial Sensors with Garment-aware Diffusion Models |
| topic | Graphics Artificial Intelligence Computer Vision and Pattern Recognition Human-Computer Interaction 68T07, 68T45, 68U01 I.2; I.3; I.4; I.5 |
| url | https://arxiv.org/abs/2506.15290 |