SuDA: Support-based Domain Adaptation for Sim2Real Motion Capture with Flexible Sensors

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Fang, Jiawei, Song, Haishan, Zuo, Chengxu, Gao, Xiaoxia, Chen, Xiaowei, Guo, Shihui, Qin, Yipeng
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910459197652992
author Fang, Jiawei
Song, Haishan
Zuo, Chengxu
Gao, Xiaoxia
Chen, Xiaowei
Guo, Shihui
Qin, Yipeng
author_facet Fang, Jiawei
Song, Haishan
Zuo, Chengxu
Gao, Xiaoxia
Chen, Xiaowei
Guo, Shihui
Qin, Yipeng
contents Flexible sensors hold promise for human motion capture (MoCap), offering advantages such as wearability, privacy preservation, and minimal constraints on natural movement. However, existing flexible sensor-based MoCap methods rely on deep learning and necessitate large and diverse labeled datasets for training. These data typically need to be collected in MoCap studios with specialized equipment and substantial manual labor, making them difficult and expensive to obtain at scale. Thanks to the high-linearity of flexible sensors, we address this challenge by proposing a novel Sim2Real Mocap solution based on domain adaptation, eliminating the need for labeled data yet achieving comparable accuracy to supervised learning. Our solution relies on a novel Support-based Domain Adaptation method, namely SuDA, which aligns the supports of the predictive functions rather than the instance-dependent distributions between the source and target domains. Extensive experimental results demonstrate the effectiveness of our method andits superiority over state-of-the-art distribution-based domain adaptation methods in our task.
format Preprint
id arxiv_https___arxiv_org_abs_2405_16152
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle SuDA: Support-based Domain Adaptation for Sim2Real Motion Capture with Flexible Sensors
Fang, Jiawei
Song, Haishan
Zuo, Chengxu
Gao, Xiaoxia
Chen, Xiaowei
Guo, Shihui
Qin, Yipeng
Computer Vision and Pattern Recognition
Human-Computer Interaction
Flexible sensors hold promise for human motion capture (MoCap), offering advantages such as wearability, privacy preservation, and minimal constraints on natural movement. However, existing flexible sensor-based MoCap methods rely on deep learning and necessitate large and diverse labeled datasets for training. These data typically need to be collected in MoCap studios with specialized equipment and substantial manual labor, making them difficult and expensive to obtain at scale. Thanks to the high-linearity of flexible sensors, we address this challenge by proposing a novel Sim2Real Mocap solution based on domain adaptation, eliminating the need for labeled data yet achieving comparable accuracy to supervised learning. Our solution relies on a novel Support-based Domain Adaptation method, namely SuDA, which aligns the supports of the predictive functions rather than the instance-dependent distributions between the source and target domains. Extensive experimental results demonstrate the effectiveness of our method andits superiority over state-of-the-art distribution-based domain adaptation methods in our task.
title SuDA: Support-based Domain Adaptation for Sim2Real Motion Capture with Flexible Sensors
topic Computer Vision and Pattern Recognition
Human-Computer Interaction
url https://arxiv.org/abs/2405.16152