FLOW: Fusing and Shuffling Global and Local Views for Cross-User Human Activity Recognition with IMUs

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Qiu, Qi, Zhu, Tao, Duan, Furong, Wang, Kevin I-Kai, Chen, Liming, Nie, Mingxing
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910503702364160
author Qiu, Qi
Zhu, Tao
Duan, Furong
Wang, Kevin I-Kai
Chen, Liming
Nie, Mingxing
Nie, Mingxing
author_facet Qiu, Qi
Zhu, Tao
Duan, Furong
Wang, Kevin I-Kai
Chen, Liming
Nie, Mingxing
Nie, Mingxing
contents Inertial Measurement Unit (IMU) sensors are widely employed for Human Activity Recognition (HAR) due to their portability, energy efficiency, and growing research interest. However, a significant challenge for IMU-HAR models is achieving robust generalization performance across diverse users. This limitation stems from substantial variations in data distribution among individual users. One primary reason for this distribution disparity lies in the representation of IMU sensor data in the local coordinate system, which is susceptible to subtle user variations during IMU wearing. To address this issue, we propose a novel approach that extracts a global view representation based on the characteristics of IMU data, effectively alleviating the data distribution discrepancies induced by wearing styles. To validate the efficacy of the global view representation, we fed both global and local view data into model for experiments. The results demonstrate that global view data significantly outperforms local view data in cross-user experiments. Furthermore, we propose a Multi-view Supervised Network (MVFNet) based on Shuffling to effectively fuse local view and global view data. It supervises the feature extraction of each view through view division and view shuffling, so as to avoid the model ignoring important features as much as possible. Extensive experiments conducted on OPPORTUNITY and PAMAP2 datasets demonstrate that the proposed algorithm outperforms the current state-of-the-art methods in cross-user HAR.
format Preprint
id arxiv_https___arxiv_org_abs_2406_18569
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle FLOW: Fusing and Shuffling Global and Local Views for Cross-User Human Activity Recognition with IMUs
Qiu, Qi
Zhu, Tao
Duan, Furong
Wang, Kevin I-Kai
Chen, Liming
Nie, Mingxing
Nie, Mingxing
Computer Vision and Pattern Recognition
Artificial Intelligence
Inertial Measurement Unit (IMU) sensors are widely employed for Human Activity Recognition (HAR) due to their portability, energy efficiency, and growing research interest. However, a significant challenge for IMU-HAR models is achieving robust generalization performance across diverse users. This limitation stems from substantial variations in data distribution among individual users. One primary reason for this distribution disparity lies in the representation of IMU sensor data in the local coordinate system, which is susceptible to subtle user variations during IMU wearing. To address this issue, we propose a novel approach that extracts a global view representation based on the characteristics of IMU data, effectively alleviating the data distribution discrepancies induced by wearing styles. To validate the efficacy of the global view representation, we fed both global and local view data into model for experiments. The results demonstrate that global view data significantly outperforms local view data in cross-user experiments. Furthermore, we propose a Multi-view Supervised Network (MVFNet) based on Shuffling to effectively fuse local view and global view data. It supervises the feature extraction of each view through view division and view shuffling, so as to avoid the model ignoring important features as much as possible. Extensive experiments conducted on OPPORTUNITY and PAMAP2 datasets demonstrate that the proposed algorithm outperforms the current state-of-the-art methods in cross-user HAR.
title FLOW: Fusing and Shuffling Global and Local Views for Cross-User Human Activity Recognition with IMUs
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2406.18569