Cover Image

Differentially Private SGD Without Clipping Bias: An Error-Feedback Approach

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Xinwei, Bu, Zhiqi, Wu, Zhiwei Steven, Hong, Mingyi
Format:	Preprint
Published:	2023
Subjects:	Machine Learning Cryptography and Security
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

DOPPLER: Differentially Private Optimizers with Low-pass Filter for Privacy Noise Reduction
by: Zhang, Xinwei, et al.
Published: (2024)

Pre-training Differentially Private Models with Limited Public Data
by: Bu, Zhiqi, et al.
Published: (2024)

DiSK: Differentially Private Optimizer with Simplified Kalman Filter for Noise Reduction
by: Zhang, Xinwei, et al.
Published: (2024)

GeoClip: Geometry-Aware Clipping for Differentially Private SGD
by: Gilani, Atefeh, et al.
Published: (2025)

DC-SGD: Differentially Private SGD with Dynamic Clipping through Gradient Norm Distribution Estimation
by: Wei, Chengkun, et al.
Published: (2025)

DP-SGD Without Clipping: The Lipschitz Neural Network Way
by: Bethune, Louis, et al.
Published: (2023)

PCDP-SGD: Improving the Convergence of Differentially Private SGD via Projection in Advance
by: Sha, Haichao, et al.
Published: (2023)

Clipped SGD Algorithms for Performative Prediction: Tight Bounds for Clipping Bias and Remedies
by: Li, Qiang, et al.
Published: (2024)

An Improved Privacy and Utility Analysis of Differentially Private SGD with Bounded Domain and Smooth Losses
by: Liang, Hao, et al.
Published: (2025)

Back to Square Roots: An Optimal Bound on the Matrix Factorization Error for Multi-Epoch Differentially Private SGD
by: Kalinin, Nikita P., et al.
Published: (2025)

Differentially Private Bias-Term Fine-tuning of Foundation Models
by: Bu, Zhiqi, et al.
Published: (2022)

DPIS: An Enhanced Mechanism for Differentially Private SGD with Importance Sampling
by: Wei, Jianxin, et al.
Published: (2022)

On the Convergence of DP-SGD with Adaptive Clipping
by: Shulgin, Egor, et al.
Published: (2024)

RQP-SGD: Differential Private Machine Learning through Noisy SGD and Randomized Quantization
by: Feng, Ce, et al.
Published: (2024)

The Last Iterate Advantage: Empirical Auditing and Principled Heuristic Analysis of Differentially Private SGD
by: Steinke, Thomas, et al.
Published: (2024)

Enabling Differentially Private Federated Learning for Speech Recognition: Benchmarks, Adaptive Optimizers and Gradient Clipping
by: Pelikan, Martin, et al.
Published: (2023)

On the Benefits of Public Representations for Private Transfer Learning under Distribution Shift
by: Thaker, Pratiksha, et al.
Published: (2023)

Oracle-Efficient Differentially Private Learning with Public Data
by: Block, Adam, et al.
Published: (2024)

FlashDP: Private Training Large Language Models with Efficient DP-SGD
by: Wang, Liangyu, et al.
Published: (2025)

Less Random, More Private: What is the Optimal Subsampling Scheme for DP-SGD?
by: Dong, Andy, et al.
Published: (2026)

How Private are DP-SGD Implementations?
by: Chua, Lynn, et al.
Published: (2024)

Privacy of SGD under Gaussian or Heavy-Tailed Noise: Guarantees without Gradient Clipping
by: Şimşekli, Umut, et al.
Published: (2024)

Delving into Differentially Private Transformer
by: Ding, Youlong, et al.
Published: (2024)

Differentially Private Linear Bandits with Partial Distributed Feedback
by: Li, Fengjiao, et al.
Published: (2022)

DP-SelFT: Differentially Private Selective Fine-Tuning for Large Language Models
by: Sha, Haichao, et al.
Published: (2026)

Private and Communication-Efficient Federated Learning based on Differentially Private Sketches
by: Zhang, Meifan, et al.
Published: (2024)

Clip Body and Tail Separately: High Probability Guarantees for DPSGD with Heavy Tails
by: Sha, Haichao, et al.
Published: (2024)

DPDR: Gradient Decomposition and Reconstruction for Differentially Private Deep Learning
by: Liu, Yixuan, et al.
Published: (2024)

Differentially Private Federated Learning: A Systematic Review
by: Fu, Jie, et al.
Published: (2024)

Accuracy Improvement in Differentially Private Logistic Regression: A Pre-training Approach
by: Hoseinpour, Mohammad, et al.
Published: (2023)

Differentially Private Attention Computation
by: Gao, Yeqi, et al.
Published: (2023)

Differentially Private Diffusion Models
by: Dockhorn, Tim, et al.
Published: (2022)

Privately Learning Decision Lists and a Differentially Private Winnow
by: Bun, Mark, et al.
Published: (2026)

Scaling Laws for Differentially Private Language Models
by: McKenna, Ryan, et al.
Published: (2025)

Differentially Private Conditional Independence Testing
by: Kalemaj, Iden, et al.
Published: (2023)

Differentially Private Random Feature Model
by: Liao, Chunyang, et al.
Published: (2024)

Differentially Private Manifold Denoising
by: Wu, Jiaqi, et al.
Published: (2026)

DP-SGD with weight clipping
by: Barczewski, Antoine, et al.
Published: (2023)

Differentially Private Subspace Fine-Tuning for Large Language Models
by: Zheng, Lele, et al.
Published: (2026)

Differentially Private Domain Adaptation with Theoretical Guarantees
by: Bassily, Raef, et al.
Published: (2023)