Human Activity Recognition from Wearable Sensor Data Using Self-Attention

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Mahmud, Saif, Tonmoy, M Tanjid Hasan, Bhaumik, Kishor Kumar, Rahman, A K M Mahbubur, Amin, M Ashraful, Shoyaib, Mohammad, Khan, Muhammad Asif Hossain, Ali, Amin Ahsan
Format: Preprint
Publié: 2020
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913322641653760
author Mahmud, Saif
Tonmoy, M Tanjid Hasan
Bhaumik, Kishor Kumar
Rahman, A K M Mahbubur
Amin, M Ashraful
Shoyaib, Mohammad
Khan, Muhammad Asif Hossain
Ali, Amin Ahsan
author_facet Mahmud, Saif
Tonmoy, M Tanjid Hasan
Bhaumik, Kishor Kumar
Rahman, A K M Mahbubur
Amin, M Ashraful
Shoyaib, Mohammad
Khan, Muhammad Asif Hossain
Ali, Amin Ahsan
contents Human Activity Recognition from body-worn sensor data poses an inherent challenge in capturing spatial and temporal dependencies of time-series signals. In this regard, the existing recurrent or convolutional or their hybrid models for activity recognition struggle to capture spatio-temporal context from the feature space of sensor reading sequence. To address this complex problem, we propose a self-attention based neural network model that foregoes recurrent architectures and utilizes different types of attention mechanisms to generate higher dimensional feature representation used for classification. We performed extensive experiments on four popular publicly available HAR datasets: PAMAP2, Opportunity, Skoda and USC-HAD. Our model achieve significant performance improvement over recent state-of-the-art models in both benchmark test subjects and Leave-one-subject-out evaluation. We also observe that the sensor attention maps produced by our model is able capture the importance of the modality and placement of the sensors in predicting the different activity classes.
format Preprint
id arxiv_https___arxiv_org_abs_2003_09018
institution arXiv
publishDate 2020
record_format arxiv
spellingShingle Human Activity Recognition from Wearable Sensor Data Using Self-Attention
Mahmud, Saif
Tonmoy, M Tanjid Hasan
Bhaumik, Kishor Kumar
Rahman, A K M Mahbubur
Amin, M Ashraful
Shoyaib, Mohammad
Khan, Muhammad Asif Hossain
Ali, Amin Ahsan
Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Human Activity Recognition from body-worn sensor data poses an inherent challenge in capturing spatial and temporal dependencies of time-series signals. In this regard, the existing recurrent or convolutional or their hybrid models for activity recognition struggle to capture spatio-temporal context from the feature space of sensor reading sequence. To address this complex problem, we propose a self-attention based neural network model that foregoes recurrent architectures and utilizes different types of attention mechanisms to generate higher dimensional feature representation used for classification. We performed extensive experiments on four popular publicly available HAR datasets: PAMAP2, Opportunity, Skoda and USC-HAD. Our model achieve significant performance improvement over recent state-of-the-art models in both benchmark test subjects and Leave-one-subject-out evaluation. We also observe that the sensor attention maps produced by our model is able capture the importance of the modality and placement of the sensors in predicting the different activity classes.
title Human Activity Recognition from Wearable Sensor Data Using Self-Attention
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2003.09018