How Well Can Differential Privacy Be Audited in One Run?

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Keinan, Amit, Shenfeld, Moshe, Ligett, Katrina
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866908841719889920
author Keinan, Amit
Shenfeld, Moshe
Ligett, Katrina
author_facet Keinan, Amit
Shenfeld, Moshe
Ligett, Katrina
contents Recent methods for auditing the privacy of machine learning algorithms have improved computational efficiency by simultaneously intervening on multiple training examples in a single training run. Steinke et al. (2024) prove that one-run auditing indeed lower bounds the true privacy parameter of the audited algorithm, and give impressive empirical results. Their work leaves open the question of how precisely one-run auditing can uncover the true privacy parameter of an algorithm, and how that precision depends on the audited algorithm. In this work, we characterize the maximum achievable efficacy of one-run auditing and show that the key barrier to its efficacy is interference between the observable effects of different data elements. We present new conceptual approaches to minimize this barrier, towards improving the performance of one-run auditing of real machine learning algorithms.
format Preprint
id arxiv_https___arxiv_org_abs_2503_07199
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle How Well Can Differential Privacy Be Audited in One Run?
Keinan, Amit
Shenfeld, Moshe
Ligett, Katrina
Machine Learning
Cryptography and Security
Recent methods for auditing the privacy of machine learning algorithms have improved computational efficiency by simultaneously intervening on multiple training examples in a single training run. Steinke et al. (2024) prove that one-run auditing indeed lower bounds the true privacy parameter of the audited algorithm, and give impressive empirical results. Their work leaves open the question of how precisely one-run auditing can uncover the true privacy parameter of an algorithm, and how that precision depends on the audited algorithm. In this work, we characterize the maximum achievable efficacy of one-run auditing and show that the key barrier to its efficacy is interference between the observable effects of different data elements. We present new conceptual approaches to minimize this barrier, towards improving the performance of one-run auditing of real machine learning algorithms.
title How Well Can Differential Privacy Be Audited in One Run?
topic Machine Learning
Cryptography and Security
url https://arxiv.org/abs/2503.07199