Optimal Survey Design for Private Mean Estimation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Chen, Yu-Wei, Pasupathy, Raghu, Awan, Jordan A.
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929692322299904
author Chen, Yu-Wei
Pasupathy, Raghu
Awan, Jordan A.
author_facet Chen, Yu-Wei
Pasupathy, Raghu
Awan, Jordan A.
contents This work identifies the first privacy-aware stratified sampling scheme that minimizes the variance for general private mean estimation under the Laplace, Discrete Laplace (DLap) and Truncated-Uniform-Laplace (TuLap) mechanisms within the framework of differential privacy (DP). We view stratified sampling as a subsampling operation, which amplifies the privacy guarantee; however, to have the same final privacy guarantee for each group, different nominal privacy budgets need to be used depending on the subsampling rate. Ignoring the effect of DP, traditional stratified sampling strategies risk significant variance inflation. We phrase our optimal survey design as an optimization problem, where we determine the optimal subsampling sizes for each group with the goal of minimizing the variance of the resulting estimator. We establish strong convexity of the variance objective, propose an efficient algorithm to identify the integer-optimal design, and offer insights on the structure of the optimal design.
format Preprint
id arxiv_https___arxiv_org_abs_2501_18121
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Optimal Survey Design for Private Mean Estimation
Chen, Yu-Wei
Pasupathy, Raghu
Awan, Jordan A.
Machine Learning
Cryptography and Security
Statistics Theory
This work identifies the first privacy-aware stratified sampling scheme that minimizes the variance for general private mean estimation under the Laplace, Discrete Laplace (DLap) and Truncated-Uniform-Laplace (TuLap) mechanisms within the framework of differential privacy (DP). We view stratified sampling as a subsampling operation, which amplifies the privacy guarantee; however, to have the same final privacy guarantee for each group, different nominal privacy budgets need to be used depending on the subsampling rate. Ignoring the effect of DP, traditional stratified sampling strategies risk significant variance inflation. We phrase our optimal survey design as an optimization problem, where we determine the optimal subsampling sizes for each group with the goal of minimizing the variance of the resulting estimator. We establish strong convexity of the variance objective, propose an efficient algorithm to identify the integer-optimal design, and offer insights on the structure of the optimal design.
title Optimal Survey Design for Private Mean Estimation
topic Machine Learning
Cryptography and Security
Statistics Theory
url https://arxiv.org/abs/2501.18121