Private Adaptive Covariance Estimation via Gaussian Graphical Models
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914594509815808 |
|---|---|
| author | Ferrando, Cecilia Fuentes, Miguel Mullins, Brett Musco, Cameron Sheldon, Daniel |
| author_facet | Ferrando, Cecilia Fuentes, Miguel Mullins, Brett Musco, Cameron Sheldon, Daniel |
| contents | We propose PACE-GGM, a data-adaptive differentially private method for covariance estimation that concentrates its privacy budget on the most informative entries of the empirical covariance matrix, rather than perturbing all entries. This applies in the natural setting where the modeler supplies separate bounds for each variable, so that individual entries can be measured with less noise than the full matrix. In each round, our method selects a poorly approximated entry, measures it using the Gaussian mechanism, and then reconstructs a full covariance matrix using a maximum-entropy reconstruction objective, leading to a Gaussian graphical model structure. Experiments on diverse real-world datasets demonstrate consistent improvements in estimation error with respect to the Gaussian mechanism and other baselines, particularly in high-dimensional and low-to-moderate privacy regimes. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2605_24295 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Private Adaptive Covariance Estimation via Gaussian Graphical Models Ferrando, Cecilia Fuentes, Miguel Mullins, Brett Musco, Cameron Sheldon, Daniel Machine Learning We propose PACE-GGM, a data-adaptive differentially private method for covariance estimation that concentrates its privacy budget on the most informative entries of the empirical covariance matrix, rather than perturbing all entries. This applies in the natural setting where the modeler supplies separate bounds for each variable, so that individual entries can be measured with less noise than the full matrix. In each round, our method selects a poorly approximated entry, measures it using the Gaussian mechanism, and then reconstructs a full covariance matrix using a maximum-entropy reconstruction objective, leading to a Gaussian graphical model structure. Experiments on diverse real-world datasets demonstrate consistent improvements in estimation error with respect to the Gaussian mechanism and other baselines, particularly in high-dimensional and low-to-moderate privacy regimes. |
| title | Private Adaptive Covariance Estimation via Gaussian Graphical Models |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2605.24295 |