Cover Image

On the Convergence of DP-SGD with Adaptive Clipping

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Shulgin, Egor, Richtárik, Peter
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Cryptography and Security Optimization and Control
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Smoothed Normalization for Efficient Distributed Private Optimization
by: Shulgin, Egor, et al.
Published: (2025)

Clipped SGD Algorithms for Performative Prediction: Tight Bounds for Clipping Bias and Remedies
by: Li, Qiang, et al.
Published: (2024)

Differentially Private Random Block Coordinate Descent
by: Maranjyan, Artavazd, et al.
Published: (2024)

Towards a Better Theoretical Understanding of Independent Subnetwork Training
by: Shulgin, Egor, et al.
Published: (2023)

Byzantine-Robust and Differentially Private Federated Optimization under Weaker Assumptions
by: Islamov, Rustem, et al.
Published: (2026)

Clip-and-Verify: Linear Constraint-Driven Domain Clipping for Accelerating Neural Network Verification
by: Zhou, Duo, et al.
Published: (2025)

First Provable Guarantees for Practical Private FL: Beyond Restrictive Assumptions
by: Shulgin, Egor, et al.
Published: (2025)

Gluon: Making Muon & Scion Great Again! (Bridging Theory and Practice of LMO-based Optimizers for LLMs)
by: Riabinin, Artem, et al.
Published: (2025)

DP-SGD Without Clipping: The Lipschitz Neural Network Way
by: Bethune, Louis, et al.
Published: (2023)

Beyond the Ideal: Analyzing the Inexact Muon Update
by: Shulgin, Egor, et al.
Published: (2025)

Kernel Learning with Adversarial Features: Numerical Efficiency and Adaptive Regularization
by: Ribeiro, Antônio H., et al.
Published: (2025)

SPAM: Stochastic Proximal Point Method with Momentum Variance Reduction for Non-convex Cross-Device Federated Learning
by: Karagulyan, Avetik, et al.
Published: (2024)

Differentially Private Clipped-SGD: High-Probability Convergence with Arbitrary Clipping Level
by: Khah, Saleh Vatan, et al.
Published: (2025)

DP-SGD with weight clipping
by: Barczewski, Antoine, et al.
Published: (2023)

Mirror Descent Algorithms with Nearly Dimension-Independent Rates for Differentially-Private Stochastic Saddle-Point Problems
by: González, Tomás, et al.
Published: (2024)

Scalable Neural Network Verification with Branch-and-bound Inferred Cutting Planes
by: Zhou, Duo, et al.
Published: (2024)

Differentially Private Bilevel Optimization
by: Kornowski, Guy
Published: (2024)

Improved Sample Complexity for Private Nonsmooth Nonconvex Optimization
by: Kornowski, Guy, et al.
Published: (2024)

How to Make the Gradients Small Privately: Improved Rates for Differentially Private Non-Convex Optimization
by: Lowy, Andrew, et al.
Published: (2024)

Private Algorithms for Stochastic Saddle Points and Variational Inequalities: Beyond Euclidean Geometry
by: Bassily, Raef, et al.
Published: (2024)

Public-data Assisted Private Stochastic Optimization: Power and Limitations
by: Ullah, Enayat, et al.
Published: (2024)

The Utility and Complexity of in- and out-of-Distribution Machine Unlearning
by: Allouah, Youssef, et al.
Published: (2024)

Efficient Optimization Algorithms for Linear Adversarial Training
by: RIbeiro, Antônio H., et al.
Published: (2024)

Private Heterogeneous Federated Learning Without a Trusted Server Revisited: Error-Optimal and Communication-Efficient Algorithms for Convex Losses
by: Gao, Changyu, et al.
Published: (2024)

Private Zeroth-Order Nonsmooth Nonconvex Optimization
by: Zhang, Qinzi, et al.
Published: (2024)

Faster Algorithms for User-Level Private Stochastic Convex Optimization
by: Lowy, Andrew, et al.
Published: (2024)

The Power of Sampling: Dimension-free Risk Bounds in Private ERM
by: Lee, Yin Tat, et al.
Published: (2021)

Attention-Enhanced Graph Filtering for False Data Injection Attack Detection and Localization
by: Abdulin, Ruslan, et al.
Published: (2026)

The Relative Gaussian Mechanism and its Application to Private Gradient Descent
by: Hendrikx, Hadrien, et al.
Published: (2023)

Differentially Private Non-Convex Optimization under the KL Condition with Optimal Rates
by: Menart, Michael, et al.
Published: (2023)

Differential Privacy via Distributionally Robust Optimization
by: Selvi, Aras, et al.
Published: (2023)

Private Federated Learning Without a Trusted Server: Optimal Algorithms for Convex Losses
by: Lowy, Andrew, et al.
Published: (2021)

Distributed Online Private Learning of Convex Nondecomposable Objectives
by: Cheng, Huqiang, et al.
Published: (2022)

Differentially Private Bilevel Optimization: Efficient Algorithms with Near-Optimal Rates
by: Lowy, Andrew, et al.
Published: (2025)

DPZero: Private Fine-Tuning of Language Models without Backpropagation
by: Zhang, Liang, et al.
Published: (2023)

On the Gradient Complexity of Private Optimization with Private Oracles
by: Menart, Michael, et al.
Published: (2025)

Private Stochastic Optimization With Large Worst-Case Lipschitz Parameter
by: Lowy, Andrew, et al.
Published: (2022)

Optimal Differentially Private Model Training with Public Data
by: Lowy, Andrew, et al.
Published: (2023)

MAST: Model-Agnostic Sparsified Training
by: Demidovich, Yury, et al.
Published: (2023)

Differentially Private High Dimensional Bandits
by: Shukla, Apurv
Published: (2024)