Bridging Generalization and Personalization in Human Activity Recognition via On-Device Few-Shot Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kang, Pixi, Moosmann, Julian, Liu, Mengxi, Zhou, Bo, Magno, Michele, Lukowicz, Paul, Bian, Sizhen
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911142331285504
author Kang, Pixi
Moosmann, Julian
Liu, Mengxi
Zhou, Bo
Magno, Michele
Lukowicz, Paul
Bian, Sizhen
author_facet Kang, Pixi
Moosmann, Julian
Liu, Mengxi
Zhou, Bo
Magno, Michele
Lukowicz, Paul
Bian, Sizhen
contents Human Activity Recognition (HAR) with different sensing modalities requires both strong generalization across diverse users and efficient personalization for individuals. However, conventional HAR models often fail to generalize when faced with user-specific variations, leading to degraded performance. To address this challenge, we propose a novel on-device few-shot learning framework that bridges generalization and personalization in HAR. Our method first trains a generalizable representation across users and then rapidly adapts to new users with only a few labeled samples, updating lightweight classifier layers directly on resource-constrained devices. This approach achieves robust on-device learning with minimal computation and memory cost, making it practical for real-world deployment. We implement our framework on the energy-efficient RISC-V GAP9 microcontroller and evaluate it on three benchmark datasets (RecGym, QVAR-Gesture, Ultrasound-Gesture). Across these scenarios, post-deployment adaptation improves accuracy by 3.73\%, 17.38\%, and 3.70\%, respectively. These results demonstrate that few-shot on-device learning enables scalable, user-aware, and energy-efficient wearable human activity recognition by seamlessly uniting generalization and personalization. The related framework is open sourced for further research\footnote{https://github.com/kangpx/onlineTiny2023}.
format Preprint
id arxiv_https___arxiv_org_abs_2508_15413
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Bridging Generalization and Personalization in Human Activity Recognition via On-Device Few-Shot Learning
Kang, Pixi
Moosmann, Julian
Liu, Mengxi
Zhou, Bo
Magno, Michele
Lukowicz, Paul
Bian, Sizhen
Machine Learning
Artificial Intelligence
Human Activity Recognition (HAR) with different sensing modalities requires both strong generalization across diverse users and efficient personalization for individuals. However, conventional HAR models often fail to generalize when faced with user-specific variations, leading to degraded performance. To address this challenge, we propose a novel on-device few-shot learning framework that bridges generalization and personalization in HAR. Our method first trains a generalizable representation across users and then rapidly adapts to new users with only a few labeled samples, updating lightweight classifier layers directly on resource-constrained devices. This approach achieves robust on-device learning with minimal computation and memory cost, making it practical for real-world deployment. We implement our framework on the energy-efficient RISC-V GAP9 microcontroller and evaluate it on three benchmark datasets (RecGym, QVAR-Gesture, Ultrasound-Gesture). Across these scenarios, post-deployment adaptation improves accuracy by 3.73\%, 17.38\%, and 3.70\%, respectively. These results demonstrate that few-shot on-device learning enables scalable, user-aware, and energy-efficient wearable human activity recognition by seamlessly uniting generalization and personalization. The related framework is open sourced for further research\footnote{https://github.com/kangpx/onlineTiny2023}.
title Bridging Generalization and Personalization in Human Activity Recognition via On-Device Few-Shot Learning
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2508.15413