Privacy Amplification by Structured Subsampling for Deep Differentially Private Time Series Forecasting
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915424500711424 |
|---|---|
| author | Schuchardt, Jan Dalirrooyfard, Mina Guzelkabaagac, Jed Schneider, Anderson Nevmyvaka, Yuriy Günnemann, Stephan |
| author_facet | Schuchardt, Jan Dalirrooyfard, Mina Guzelkabaagac, Jed Schneider, Anderson Nevmyvaka, Yuriy Günnemann, Stephan |
| contents | Many forms of sensitive data, such as web traffic, mobility data, or hospital occupancy, are inherently sequential. The standard method for training machine learning models while ensuring privacy for units of sensitive information, such as individual hospital visits, is differentially private stochastic gradient descent (DP-SGD). However, we observe in this work that the formal guarantees of DP-SGD are incompatible with time series specific tasks like forecasting, since they rely on the privacy amplification attained by training on small, unstructured batches sampled from an unstructured dataset. In contrast, batches for forecasting are generated by (1) sampling sequentially structured time series from a dataset, (2) sampling contiguous subsequences from these series, and (3) partitioning them into context and ground-truth forecast windows. We theoretically analyze the privacy amplification attained by this structured subsampling to enable the training of forecasting models with sound and tight event- and user-level privacy guarantees. Towards more private models, we additionally prove how data augmentation amplifies privacy in self-supervised training of sequence models. Our empirical evaluation demonstrates that amplification by structured subsampling enables the training of forecasting models with strong formal privacy guarantees. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_02410 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Privacy Amplification by Structured Subsampling for Deep Differentially Private Time Series Forecasting Schuchardt, Jan Dalirrooyfard, Mina Guzelkabaagac, Jed Schneider, Anderson Nevmyvaka, Yuriy Günnemann, Stephan Machine Learning Cryptography and Security Many forms of sensitive data, such as web traffic, mobility data, or hospital occupancy, are inherently sequential. The standard method for training machine learning models while ensuring privacy for units of sensitive information, such as individual hospital visits, is differentially private stochastic gradient descent (DP-SGD). However, we observe in this work that the formal guarantees of DP-SGD are incompatible with time series specific tasks like forecasting, since they rely on the privacy amplification attained by training on small, unstructured batches sampled from an unstructured dataset. In contrast, batches for forecasting are generated by (1) sampling sequentially structured time series from a dataset, (2) sampling contiguous subsequences from these series, and (3) partitioning them into context and ground-truth forecast windows. We theoretically analyze the privacy amplification attained by this structured subsampling to enable the training of forecasting models with sound and tight event- and user-level privacy guarantees. Towards more private models, we additionally prove how data augmentation amplifies privacy in self-supervised training of sequence models. Our empirical evaluation demonstrates that amplification by structured subsampling enables the training of forecasting models with strong formal privacy guarantees. |
| title | Privacy Amplification by Structured Subsampling for Deep Differentially Private Time Series Forecasting |
| topic | Machine Learning Cryptography and Security |
| url | https://arxiv.org/abs/2502.02410 |