Temporally Multi-Scale Sparse Self-Attention for Physical Activity Data Imputation
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916303646752768 |
|---|---|
| author | Wei, Hui Xu, Maxwell A. Samplawski, Colin Rehg, James M. Kumar, Santosh Marlin, Benjamin M. |
| author_facet | Wei, Hui Xu, Maxwell A. Samplawski, Colin Rehg, James M. Kumar, Santosh Marlin, Benjamin M. |
| contents | Wearable sensors enable health researchers to continuously collect data pertaining to the physiological state of individuals in real-world settings. However, such data can be subject to extensive missingness due to a complex combination of factors. In this work, we study the problem of imputation of missing step count data, one of the most ubiquitous forms of wearable sensor data. We construct a novel and large scale data set consisting of a training set with over 3 million hourly step count observations and a test set with over 2.5 million hourly step count observations. We propose a domain knowledge-informed sparse self-attention model for this task that captures the temporal multi-scale nature of step-count data. We assess the performance of the model relative to baselines and conduct ablation studies to verify our specific model designs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_18848 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Temporally Multi-Scale Sparse Self-Attention for Physical Activity Data Imputation Wei, Hui Xu, Maxwell A. Samplawski, Colin Rehg, James M. Kumar, Santosh Marlin, Benjamin M. Machine Learning Wearable sensors enable health researchers to continuously collect data pertaining to the physiological state of individuals in real-world settings. However, such data can be subject to extensive missingness due to a complex combination of factors. In this work, we study the problem of imputation of missing step count data, one of the most ubiquitous forms of wearable sensor data. We construct a novel and large scale data set consisting of a training set with over 3 million hourly step count observations and a test set with over 2.5 million hourly step count observations. We propose a domain knowledge-informed sparse self-attention model for this task that captures the temporal multi-scale nature of step-count data. We assess the performance of the model relative to baselines and conduct ablation studies to verify our specific model designs. |
| title | Temporally Multi-Scale Sparse Self-Attention for Physical Activity Data Imputation |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2406.18848 |