Cover Image

Optimal Rates for $O(1)$-Smooth DP-SCO with a Single Epoch and Large Batches

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Choquette-Choo, Christopher A., Ganesh, Arun, Thakurta, Abhradeep
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Cryptography and Security
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Privacy Amplification for Matrix Mechanisms
by: Choquette-Choo, Christopher A., et al.
Published: (2023)

Correlated Noise Provably Beats Independent Noise for Differentially Private Learning
by: Choquette-Choo, Christopher A., et al.
Published: (2023)

On Design Principles for Private Adaptive Optimizers
by: Ganesh, Arun, et al.
Published: (2025)

Near Exact Privacy Amplification for Matrix Mechanisms
by: Choquette-Choo, Christopher A., et al.
Published: (2024)

The Last Iterate Advantage: Empirical Auditing and Principled Heuristic Analysis of Differentially Private SGD
by: Steinke, Thomas, et al.
Published: (2024)

Tight Group-Level DP Guarantees for DP-SGD with Sampling via Mixture of Gaussians Mechanisms
by: Ganesh, Arun
Published: (2024)

Correlated Noise Mechanisms for Differentially Private Learning
by: Pillutla, Krishna, et al.
Published: (2025)

Recycling Scraps: Improving Private Learning by Leveraging Intermediate Checkpoints
by: Shejwalkar, Virat, et al.
Published: (2022)

Training Large ASR Encoders with Differential Privacy
by: Chauhan, Geeticka, et al.
Published: (2024)

InvisibleInk: High-Utility and Low-Cost Text Generation with Differential Privacy
by: Vinod, Vishnu, et al.
Published: (2025)

Private Gradient Descent for Linear Regression: Tighter Error Bounds and Instance-Specific Uncertainty Estimation
by: Brown, Gavin, et al.
Published: (2024)

Hush! Protecting Secrets During Model Training: An Indistinguishability Approach
by: Ganesh, Arun, et al.
Published: (2025)

Linear-Time User-Level DP-SCO via Robust Statistics
by: Ghazi, Badih, et al.
Published: (2025)

Preserving Expert-Level Privacy in Offline Reinforcement Learning
by: Sharma, Navodita, et al.
Published: (2024)

Privacy Auditing of Large Language Models
by: Panda, Ashwinee, et al.
Published: (2025)

Differentially Private Parameter-Efficient Fine-tuning for Large ASR Models
by: Liu, Hongbin, et al.
Published: (2024)

Efficient and Near-Optimal Noise Generation for Streaming Differential Privacy
by: Dvijotham, Krishnamurthy, et al.
Published: (2024)

User Inference Attacks on Large Language Models
by: Kandpal, Nikhil, et al.
Published: (2023)

Privacy Side Channels in Machine Learning Systems
by: Debenedetti, Edoardo, et al.
Published: (2023)

FlashDP: Private Training Large Language Models with Efficient DP-SGD
by: Wang, Liangyu, et al.
Published: (2025)

Poisoning Web-Scale Training Datasets is Practical
by: Carlini, Nicholas, et al.
Published: (2023)

Teach LLMs to Phish: Stealing Private Information from Language Models
by: Panda, Ashwinee, et al.
Published: (2024)

Less Random, More Private: What is the Optimal Subsampling Scheme for DP-SGD?
by: Dong, Andy, et al.
Published: (2026)

Back to Square Roots: An Optimal Bound on the Matrix Factorization Error for Multi-Epoch Differentially Private SGD
by: Kalinin, Nikita P., et al.
Published: (2025)

The Attacker Moves Second: Stronger Adaptive Attacks Bypass Defenses Against Llm Jailbreaks and Prompt Injections
by: Nasr, Milad, et al.
Published: (2025)

DP-SGD with weight clipping
by: Barczewski, Antoine, et al.
Published: (2023)

Scaling Laws for Differentially Private Language Models
by: McKenna, Ryan, et al.
Published: (2025)

DP-SelFT: Differentially Private Selective Fine-Tuning for Large Language Models
by: Sha, Haichao, et al.
Published: (2026)

Lap2: Revisiting Laplace DP-SGD for High Dimensions via Majorization Theory
by: Mohammady, Meisam, et al.
Published: (2026)

Exploring and Mitigating Adversarial Manipulation of Voting-Based Leaderboards
by: Huang, Yangsibo, et al.
Published: (2025)

To Shuffle or not to Shuffle: Auditing DP-SGD with Shuffling
by: Annamalai, Meenatchi Sundaram Muthu Selva, et al.
Published: (2024)

Phantom: General Backdoor Attacks on Retrieval Augmented Language Generation
by: Chaudhari, Harsh, et al.
Published: (2024)

Lessons from Defending Gemini Against Indirect Prompt Injections
by: Shi, Chongyang, et al.
Published: (2025)

DP-KAN: Differentially Private Kolmogorov-Arnold Networks
by: Kalinin, Nikita P., et al.
Published: (2024)

R+R:Understanding Hyperparameter Effects in DP-SGD
by: Morsbach, Felix, et al.
Published: (2024)

DP-LDMs: Differentially Private Latent Diffusion Models
by: Liu, Michael F., et al.
Published: (2023)

Subsampling is not Magic: Why Large Batch Sizes Work for Differentially Private Stochastic Optimisation
by: Räisä, Ossi, et al.
Published: (2024)

SafeSynthDP: Leveraging Large Language Models for Privacy-Preserving Synthetic Data Generation Using Differential Privacy
by: Nahid, Md Mahadi Hasan, et al.
Published: (2024)

Language Models May Verbatim Complete Text They Were Not Explicitly Trained On
by: Liu, Ken Ziyu, et al.
Published: (2025)

Local Differential Privacy with Correlated Noise Achieves Central-DP Optimal Cost
by: Pathegama, Madhura, et al.
Published: (2026)