Self-attention-based Diffusion Model for Time-series Imputation in Partial Blackout Scenarios
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909522668290048 |
|---|---|
| author | Islam, Mohammad Rafid Ul Tadepalli, Prasad Fern, Alan |
| author_facet | Islam, Mohammad Rafid Ul Tadepalli, Prasad Fern, Alan |
| contents | Missing values in multivariate time series data can harm machine learning performance and introduce bias. These gaps arise from sensor malfunctions, blackouts, and human error and are typically addressed by data imputation. Previous work has tackled the imputation of missing data in random, complete blackouts and forecasting scenarios. The current paper addresses a more general missing pattern, which we call "partial blackout," where a subset of features is missing for consecutive time steps. We introduce a two-stage imputation process using self-attention and diffusion processes to model feature and temporal correlations. Notably, our model effectively handles missing data during training, enhancing adaptability and ensuring reliable imputation and performance, even with incomplete datasets. Our experiments on benchmark and two real-world time series datasets demonstrate that our model outperforms the state-of-the-art in partial blackout scenarios and shows better scalability. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_01737 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Self-attention-based Diffusion Model for Time-series Imputation in Partial Blackout Scenarios Islam, Mohammad Rafid Ul Tadepalli, Prasad Fern, Alan Machine Learning Missing values in multivariate time series data can harm machine learning performance and introduce bias. These gaps arise from sensor malfunctions, blackouts, and human error and are typically addressed by data imputation. Previous work has tackled the imputation of missing data in random, complete blackouts and forecasting scenarios. The current paper addresses a more general missing pattern, which we call "partial blackout," where a subset of features is missing for consecutive time steps. We introduce a two-stage imputation process using self-attention and diffusion processes to model feature and temporal correlations. Notably, our model effectively handles missing data during training, enhancing adaptability and ensuring reliable imputation and performance, even with incomplete datasets. Our experiments on benchmark and two real-world time series datasets demonstrate that our model outperforms the state-of-the-art in partial blackout scenarios and shows better scalability. |
| title | Self-attention-based Diffusion Model for Time-series Imputation in Partial Blackout Scenarios |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2503.01737 |