Cover Image

PCDP-SGD: Improving the Convergence of Differentially Private SGD via Projection in Advance

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Sha, Haichao, Liu, Ruixuan, Liu, Yixuan, Chen, Hong
Format:	Preprint
Published:	2023
Subjects:	Cryptography and Security Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

An Improved Privacy and Utility Analysis of Differentially Private SGD with Bounded Domain and Smooth Losses
by: Liang, Hao, et al.
Published: (2025)

Differentially Private SGD Without Clipping Bias: An Error-Feedback Approach
by: Zhang, Xinwei, et al.
Published: (2023)

DC-SGD: Differentially Private SGD with Dynamic Clipping through Gradient Norm Distribution Estimation
by: Wei, Chengkun, et al.
Published: (2025)

RQP-SGD: Differential Private Machine Learning through Noisy SGD and Randomized Quantization
by: Feng, Ce, et al.
Published: (2024)

DPIS: An Enhanced Mechanism for Differentially Private SGD with Importance Sampling
by: Wei, Jianxin, et al.
Published: (2022)

DPDR: Gradient Decomposition and Reconstruction for Differentially Private Deep Learning
by: Liu, Yixuan, et al.
Published: (2024)

GeoClip: Geometry-Aware Clipping for Differentially Private SGD
by: Gilani, Atefeh, et al.
Published: (2025)

The Last Iterate Advantage: Empirical Auditing and Principled Heuristic Analysis of Differentially Private SGD
by: Steinke, Thomas, et al.
Published: (2024)

DP-SelFT: Differentially Private Selective Fine-Tuning for Large Language Models
by: Sha, Haichao, et al.
Published: (2026)

On the Convergence of DP-SGD with Adaptive Clipping
by: Shulgin, Egor, et al.
Published: (2024)

Clip Body and Tail Separately: High Probability Guarantees for DPSGD with Heavy Tails
by: Sha, Haichao, et al.
Published: (2024)

Convergent Privacy Loss of Noisy-SGD without Convexity and Smoothness
by: Chien, Eli, et al.
Published: (2024)

Back to Square Roots: An Optimal Bound on the Matrix Factorization Error for Multi-Epoch Differentially Private SGD
by: Kalinin, Nikita P., et al.
Published: (2025)

How Private are DP-SGD Implementations?
by: Chua, Lynn, et al.
Published: (2024)

FlashDP: Private Training Large Language Models with Efficient DP-SGD
by: Wang, Liangyu, et al.
Published: (2025)

Less Random, More Private: What is the Optimal Subsampling Scheme for DP-SGD?
by: Dong, Andy, et al.
Published: (2026)

DP-SGD with weight clipping
by: Barczewski, Antoine, et al.
Published: (2023)

Lap2: Revisiting Laplace DP-SGD for High Dimensions via Majorization Theory
by: Mohammady, Meisam, et al.
Published: (2026)

To Shuffle or not to Shuffle: Auditing DP-SGD with Shuffling
by: Annamalai, Meenatchi Sundaram Muthu Selva, et al.
Published: (2024)

R+R:Understanding Hyperparameter Effects in DP-SGD
by: Morsbach, Felix, et al.
Published: (2024)

DP-SGD Without Clipping: The Lipschitz Neural Network Way
by: Bethune, Louis, et al.
Published: (2023)

Fundamental Limitations of Favorable Privacy-Utility Guarantees for DP-SGD
by: Ertan, Murat Bilgehan, et al.
Published: (2026)

Tighter Privacy Auditing of DP-SGD in the Hidden State Threat Model
by: Cebere, Tudor, et al.
Published: (2024)

Closed-Form Bounds for DP-SGD against Record-level Inference
by: Cherubin, Giovanni, et al.
Published: (2024)

Tight Group-Level DP Guarantees for DP-SGD with Sampling via Mixture of Gaussians Mechanisms
by: Ganesh, Arun
Published: (2024)

Balls-and-Bins Sampling for DP-SGD
by: Chua, Lynn, et al.
Published: (2024)

Differentially Private Sampling from Distributions via Wasserstein Projection
by: Takakura, Shokichi, et al.
Published: (2026)

It's Our Loss: No Privacy Amplification for Hidden State DP-SGD With Non-Convex Loss
by: Annamalai, Meenatchi Sundaram Muthu Selva
Published: (2024)

Have it your way: Individualized Privacy Assignment for DP-SGD
by: Boenisch, Franziska, et al.
Published: (2023)

Gradients Look Alike: Sensitivity is Often Overestimated in DP-SGD
by: Thudi, Anvith, et al.
Published: (2023)

Trade-off Functions for DP-SGD with Subsampling based on Random Shuffling: Tight Upper and Lower Bounds
by: van Dijk, Marten, et al.
Published: (2026)

Improved Algorithms for Differentially Private Language Model Alignment
by: Chen, Keyu, et al.
Published: (2025)

PLRV-O: Advancing Differentially Private Deep Learning via Privacy Loss Random Variable Optimization
by: Yang, Qin, et al.
Published: (2025)

Scalable DP-SGD: Shuffling vs. Poisson Subsampling
by: Chua, Lynn, et al.
Published: (2024)

Rethinking the Security of DP-SGD: A Corrected Analysis of Differentially Private Machine Learning
by: Wang, Wenhao, et al.
Published: (2026)

Clipped SGD Algorithms for Performative Prediction: Tight Bounds for Clipping Bias and Remedies
by: Li, Qiang, et al.
Published: (2024)

Improving the Utility of Differentially Private Clustering through Dynamical Processing
by: Byun, Junyoung, et al.
Published: (2023)

PrivORL: Differentially Private Synthetic Dataset for Offline Reinforcement Learning
by: Gong, Chen, et al.
Published: (2025)

SignSGD with Federated Defense: Harnessing Adversarial Attacks through Gradient Sign Decoding
by: Park, Chanho, et al.
Published: (2024)

Privacy of SGD under Gaussian or Heavy-Tailed Noise: Guarantees without Gradient Clipping
by: Şimşekli, Umut, et al.
Published: (2024)