Advancing Location-Invariant and Device-Agnostic Motion Activity Recognition on Wearable Devices

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Adaimi, Rebecca, Bedri, Abdelkareem, Gong, Jun, Kang, Richard, Arreaza-Taylor, Joanna, Pascual, Gerri-Michelle, Ralph, Michael, Laput, Gierad
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929235068715008
author Adaimi, Rebecca
Bedri, Abdelkareem
Gong, Jun
Kang, Richard
Arreaza-Taylor, Joanna
Pascual, Gerri-Michelle
Ralph, Michael
Laput, Gierad
author_facet Adaimi, Rebecca
Bedri, Abdelkareem
Gong, Jun
Kang, Richard
Arreaza-Taylor, Joanna
Pascual, Gerri-Michelle
Ralph, Michael
Laput, Gierad
contents Wearable sensors have permeated into people's lives, ushering impactful applications in interactive systems and activity recognition. However, practitioners face significant obstacles when dealing with sensing heterogeneities, requiring custom models for different platforms. In this paper, we conduct a comprehensive evaluation of the generalizability of motion models across sensor locations. Our analysis highlights this challenge and identifies key on-body locations for building location-invariant models that can be integrated on any device. For this, we introduce the largest multi-location activity dataset (N=50, 200 cumulative hours), which we make publicly available. We also present deployable on-device motion models reaching 91.41% frame-level F1-score from a single model irrespective of sensor placements. Lastly, we investigate cross-location data synthesis, aiming to alleviate the laborious data collection tasks by synthesizing data in one location given data from another. These contributions advance our vision of low-barrier, location-invariant activity recognition systems, catalyzing research in HCI and ubiquitous computing.
format Preprint
id arxiv_https___arxiv_org_abs_2402_03714
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Advancing Location-Invariant and Device-Agnostic Motion Activity Recognition on Wearable Devices
Adaimi, Rebecca
Bedri, Abdelkareem
Gong, Jun
Kang, Richard
Arreaza-Taylor, Joanna
Pascual, Gerri-Michelle
Ralph, Michael
Laput, Gierad
Human-Computer Interaction
Machine Learning
Wearable sensors have permeated into people's lives, ushering impactful applications in interactive systems and activity recognition. However, practitioners face significant obstacles when dealing with sensing heterogeneities, requiring custom models for different platforms. In this paper, we conduct a comprehensive evaluation of the generalizability of motion models across sensor locations. Our analysis highlights this challenge and identifies key on-body locations for building location-invariant models that can be integrated on any device. For this, we introduce the largest multi-location activity dataset (N=50, 200 cumulative hours), which we make publicly available. We also present deployable on-device motion models reaching 91.41% frame-level F1-score from a single model irrespective of sensor placements. Lastly, we investigate cross-location data synthesis, aiming to alleviate the laborious data collection tasks by synthesizing data in one location given data from another. These contributions advance our vision of low-barrier, location-invariant activity recognition systems, catalyzing research in HCI and ubiquitous computing.
title Advancing Location-Invariant and Device-Agnostic Motion Activity Recognition on Wearable Devices
topic Human-Computer Interaction
Machine Learning
url https://arxiv.org/abs/2402.03714