iMove: Exploring Bio-impedance Sensing for Fitness Activity Recognition

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Liu, Mengxi, Rey, Vitor Fortes, Zhang, Yu, Ray, Lala Shakti Swarup, Zhou, Bo, Lukowicz, Paul
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929370824704000
author Liu, Mengxi
Rey, Vitor Fortes
Zhang, Yu
Ray, Lala Shakti Swarup
Zhou, Bo
Lukowicz, Paul
author_facet Liu, Mengxi
Rey, Vitor Fortes
Zhang, Yu
Ray, Lala Shakti Swarup
Zhou, Bo
Lukowicz, Paul
contents Automatic and precise fitness activity recognition can be beneficial in aspects from promoting a healthy lifestyle to personalized preventative healthcare. While IMUs are currently the prominent fitness tracking modality, through iMove, we show bio-impedence can help improve IMU-based fitness tracking through sensor fusion and contrastive learning.To evaluate our methods, we conducted an experiment including six upper body fitness activities performed by ten subjects over five days to collect synchronized data from bio-impedance across two wrists and IMU on the left wrist.The contrastive learning framework uses the two modalities to train a better IMU-only classification model, where bio-impedance is only required at the training phase, by which the average Macro F1 score with the input of a single IMU was improved by 3.22 \% reaching 84.71 \% compared to the 81.49 \% of the IMU baseline model. We have also shown how bio-impedance can improve human activity recognition (HAR) directly through sensor fusion, reaching an average Macro F1 score of 89.57 \% (two modalities required for both training and inference) even if Bio-impedance alone has an average macro F1 score of 75.36 \%, which is outperformed by IMU alone. In addition, similar results were obtained in an extended study on lower body fitness activity classification, demonstrating the generalisability of our approach.Our findings underscore the potential of sensor fusion and contrastive learning as valuable tools for advancing fitness activity recognition, with bio-impedance playing a pivotal role in augmenting the capabilities of IMU-based systems.
format Preprint
id arxiv_https___arxiv_org_abs_2402_09445
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle iMove: Exploring Bio-impedance Sensing for Fitness Activity Recognition
Liu, Mengxi
Rey, Vitor Fortes
Zhang, Yu
Ray, Lala Shakti Swarup
Zhou, Bo
Lukowicz, Paul
Signal Processing
Artificial Intelligence
Machine Learning
Robotics
Automatic and precise fitness activity recognition can be beneficial in aspects from promoting a healthy lifestyle to personalized preventative healthcare. While IMUs are currently the prominent fitness tracking modality, through iMove, we show bio-impedence can help improve IMU-based fitness tracking through sensor fusion and contrastive learning.To evaluate our methods, we conducted an experiment including six upper body fitness activities performed by ten subjects over five days to collect synchronized data from bio-impedance across two wrists and IMU on the left wrist.The contrastive learning framework uses the two modalities to train a better IMU-only classification model, where bio-impedance is only required at the training phase, by which the average Macro F1 score with the input of a single IMU was improved by 3.22 \% reaching 84.71 \% compared to the 81.49 \% of the IMU baseline model. We have also shown how bio-impedance can improve human activity recognition (HAR) directly through sensor fusion, reaching an average Macro F1 score of 89.57 \% (two modalities required for both training and inference) even if Bio-impedance alone has an average macro F1 score of 75.36 \%, which is outperformed by IMU alone. In addition, similar results were obtained in an extended study on lower body fitness activity classification, demonstrating the generalisability of our approach.Our findings underscore the potential of sensor fusion and contrastive learning as valuable tools for advancing fitness activity recognition, with bio-impedance playing a pivotal role in augmenting the capabilities of IMU-based systems.
title iMove: Exploring Bio-impedance Sensing for Fitness Activity Recognition
topic Signal Processing
Artificial Intelligence
Machine Learning
Robotics
url https://arxiv.org/abs/2402.09445