SPECTRA: An Efficient Spectral-Informed Neural Network for Sensor-Based Activity Recognition

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Gurung, Deepika, Ray, Lala Shakti Swarup, Liu, Mengxi, Zhou, Bo, Lukowicz, Paul
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915895302946816
author Gurung, Deepika
Ray, Lala Shakti Swarup
Liu, Mengxi
Zhou, Bo
Lukowicz, Paul
author_facet Gurung, Deepika
Ray, Lala Shakti Swarup
Liu, Mengxi
Zhou, Bo
Lukowicz, Paul
contents Real time sensor based applications in pervasive computing require edge deployable models to ensure low latency privacy and efficient interaction. A prime example is sensor based human activity recognition where models must balance accuracy with stringent resource constraints. Yet many deep learning approaches treat temporal sensor signals as black box sequences overlooking spectral temporal structure while demanding excessive computation. We present SPECTRA a deployment first co designed spectral temporal architecture that integrates short time Fourier transform STFT feature extraction depthwise separable convolutions and channel wise self attention to capture spectral temporal dependencies under real edge runtime and memory constraints. A compact bidirectional GRU with attention pooling summarizes within window dynamics at low cost reducing downstream model burden while preserving accuracy. Across five public HAR datasets SPECTRA matches or approaches larger CNN LSTM and Transformer baselines while substantially reducing parameters latency and energy. Deployments on a Google Pixel 9 smartphone and an STM32L4 microcontroller further demonstrate end to end deployable realtime private and efficient HAR.
format Preprint
id arxiv_https___arxiv_org_abs_2603_26482
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle SPECTRA: An Efficient Spectral-Informed Neural Network for Sensor-Based Activity Recognition
Gurung, Deepika
Ray, Lala Shakti Swarup
Liu, Mengxi
Zhou, Bo
Lukowicz, Paul
Machine Learning
Real time sensor based applications in pervasive computing require edge deployable models to ensure low latency privacy and efficient interaction. A prime example is sensor based human activity recognition where models must balance accuracy with stringent resource constraints. Yet many deep learning approaches treat temporal sensor signals as black box sequences overlooking spectral temporal structure while demanding excessive computation. We present SPECTRA a deployment first co designed spectral temporal architecture that integrates short time Fourier transform STFT feature extraction depthwise separable convolutions and channel wise self attention to capture spectral temporal dependencies under real edge runtime and memory constraints. A compact bidirectional GRU with attention pooling summarizes within window dynamics at low cost reducing downstream model burden while preserving accuracy. Across five public HAR datasets SPECTRA matches or approaches larger CNN LSTM and Transformer baselines while substantially reducing parameters latency and energy. Deployments on a Google Pixel 9 smartphone and an STM32L4 microcontroller further demonstrate end to end deployable realtime private and efficient HAR.
title SPECTRA: An Efficient Spectral-Informed Neural Network for Sensor-Based Activity Recognition
topic Machine Learning
url https://arxiv.org/abs/2603.26482