End-to-End Human Pose Reconstruction from Wearable Sensors for 6G Extended Reality Systems

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Hieu, Nguyen Quang, Hoang, Dinh Thai, Nguyen, Diep N., Alsheikh, Mohammad Abu, Kuhn, Carlos C. N., Alem, Yibeltal F., Radwan, Ibrahim
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916645685952512
author Hieu, Nguyen Quang
Hoang, Dinh Thai
Nguyen, Diep N.
Alsheikh, Mohammad Abu
Kuhn, Carlos C. N.
Alem, Yibeltal F.
Radwan, Ibrahim
author_facet Hieu, Nguyen Quang
Hoang, Dinh Thai
Nguyen, Diep N.
Alsheikh, Mohammad Abu
Kuhn, Carlos C. N.
Alem, Yibeltal F.
Radwan, Ibrahim
contents Full 3D human pose reconstruction is a critical enabler for extended reality (XR) applications in future sixth generation (6G) networks, supporting immersive interactions in gaming, virtual meetings, and remote collaboration. However, achieving accurate pose reconstruction over wireless networks remains challenging due to channel impairments, bit errors, and quantization effects. Existing approaches often assume error-free transmission in indoor settings, limiting their applicability to real-world scenarios. To address these challenges, we propose a novel deep learning-based framework for human pose reconstruction over orthogonal frequency-division multiplexing (OFDM) systems. The framework introduces a two-stage deep learning receiver: the first stage jointly estimates the wireless channel and decodes OFDM symbols, and the second stage maps the received sensor signals to full 3D body poses. Simulation results demonstrate that the proposed neural receiver reduces bit error rate (BER), thus gaining a 5 dB gap at $10^{-4}$ BER, compared to the baseline method that employs separate signal detection steps, i.e., least squares channel estimation and linear minimum mean square error equalization. Additionally, our empirical findings show that 8-bit quantization is sufficient for accurate pose reconstruction, achieving a mean squared error of $5\times10^{-4}$ for reconstructed sensor signals, and reducing joint angular error by 37\% for the reconstructed human poses compared to the baseline.
format Preprint
id arxiv_https___arxiv_org_abs_2503_04860
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle End-to-End Human Pose Reconstruction from Wearable Sensors for 6G Extended Reality Systems
Hieu, Nguyen Quang
Hoang, Dinh Thai
Nguyen, Diep N.
Alsheikh, Mohammad Abu
Kuhn, Carlos C. N.
Alem, Yibeltal F.
Radwan, Ibrahim
Computer Vision and Pattern Recognition
Signal Processing
Full 3D human pose reconstruction is a critical enabler for extended reality (XR) applications in future sixth generation (6G) networks, supporting immersive interactions in gaming, virtual meetings, and remote collaboration. However, achieving accurate pose reconstruction over wireless networks remains challenging due to channel impairments, bit errors, and quantization effects. Existing approaches often assume error-free transmission in indoor settings, limiting their applicability to real-world scenarios. To address these challenges, we propose a novel deep learning-based framework for human pose reconstruction over orthogonal frequency-division multiplexing (OFDM) systems. The framework introduces a two-stage deep learning receiver: the first stage jointly estimates the wireless channel and decodes OFDM symbols, and the second stage maps the received sensor signals to full 3D body poses. Simulation results demonstrate that the proposed neural receiver reduces bit error rate (BER), thus gaining a 5 dB gap at $10^{-4}$ BER, compared to the baseline method that employs separate signal detection steps, i.e., least squares channel estimation and linear minimum mean square error equalization. Additionally, our empirical findings show that 8-bit quantization is sufficient for accurate pose reconstruction, achieving a mean squared error of $5\times10^{-4}$ for reconstructed sensor signals, and reducing joint angular error by 37\% for the reconstructed human poses compared to the baseline.
title End-to-End Human Pose Reconstruction from Wearable Sensors for 6G Extended Reality Systems
topic Computer Vision and Pattern Recognition
Signal Processing
url https://arxiv.org/abs/2503.04860