Cover Image

LMO-DP: Optimizing the Randomization Mechanism for Differentially Private Fine-Tuning (Large) Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yang, Qin, Mohammad, Meisam, Wang, Han, Payani, Ali, Kundu, Ashish, Shu, Kai, Yan, Yan, Hong, Yuan
Format:	Preprint
Published:	2024
Subjects:	Cryptography and Security Computation and Language Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

PLRV-O: Advancing Differentially Private Deep Learning via Privacy Loss Random Variable Optimization
by: Yang, Qin, et al.
Published: (2025)

Towards Strong Certified Defense with Universal Asymmetric Randomization
by: Hong, Hanbin, et al.
Published: (2025)

Universally Harmonizing Differential Privacy Mechanisms for Federated Learning: Boosting Accuracy and Convergence
by: Feng, Shuya, et al.
Published: (2024)

DP-SelFT: Differentially Private Selective Fine-Tuning for Large Language Models
by: Sha, Haichao, et al.
Published: (2026)

Output Perturbation for Differentially Private Convex Optimization: Faster and More General
by: Lowy, Andrew, et al.
Published: (2021)

DOPPLER: Differentially Private Optimizers with Low-pass Filter for Privacy Noise Reduction
by: Zhang, Xinwei, et al.
Published: (2024)

DP-GENG : Differentially Private Dataset Distillation Guided by DP-Generated Data
by: Shi, Shuo, et al.
Published: (2025)

DPI: Ensuring Strict Differential Privacy for Infinite Data Streaming
by: Feng, Shuya, et al.
Published: (2023)

Lap2: Revisiting Laplace DP-SGD for High Dimensions via Majorization Theory
by: Mohammady, Meisam, et al.
Published: (2026)

DiSK: Differentially Private Optimizer with Simplified Kalman Filter for Noise Reduction
by: Zhang, Xinwei, et al.
Published: (2024)

DP-SAPF: Saliency-Aware Parameter Fine-tuning of Public Models for Differentially Private Image Synthesis
by: Gong, Chen, et al.
Published: (2026)

Differentially Private Subspace Fine-Tuning for Large Language Models
by: Zheng, Lele, et al.
Published: (2026)

Rethinking the Security of DP-SGD: A Corrected Analysis of Differentially Private Machine Learning
by: Wang, Wenhao, et al.
Published: (2026)

Private Stochastic Optimization With Large Worst-Case Lipschitz Parameter
by: Lowy, Andrew, et al.
Published: (2022)

Differentially Private Next-Token Prediction of Large Language Models
by: Flemings, James, et al.
Published: (2024)

DP-BREM: Differentially-Private and Byzantine-Robust Federated Learning with Client Momentum
by: Gu, Xiaolan, et al.
Published: (2023)

Efficient Differentially Private Fine-Tuning of Diffusion Models
by: Liu, Jing, et al.
Published: (2024)

DP-LDMs: Differentially Private Latent Diffusion Models
by: Liu, Michael F., et al.
Published: (2023)

DP-KAN: Differentially Private Kolmogorov-Arnold Networks
by: Kalinin, Nikita P., et al.
Published: (2024)

DP-RuL: Differentially-Private Rule Learning for Clinical Decision Support Systems
by: Lamp, Josephine, et al.
Published: (2024)

FlashDP: Private Training Large Language Models with Efficient DP-SGD
by: Wang, Liangyu, et al.
Published: (2025)

Adaptively Private Next-Token Prediction of Large Language Models
by: Flemings, James, et al.
Published: (2024)

DP-TLDM: Differentially Private Tabular Latent Diffusion Model
by: Zhu, Chaoyi, et al.
Published: (2024)

Differentially Private Parameter-Efficient Fine-tuning for Large ASR Models
by: Liu, Hongbin, et al.
Published: (2024)

Differentially Private Quasi-Concave Optimization: Bypassing the Lower Bound and Application to Geometric Problems
by: Nissim, Kobbi, et al.
Published: (2025)

When FinTech Meets Privacy: Securing Financial LLMs with Differential Private Fine-Tuning
by: Zhu, Sichen, et al.
Published: (2025)

Dual-Priv Pruning : Efficient Differential Private Fine-Tuning in Multimodal Large Language Models
by: Wei, Qianshan, et al.
Published: (2025)

DP-DocLDM: Differentially Private Document Image Generation using Latent Diffusion Models
by: Saifullah, Saifullah, et al.
Published: (2025)

DP-BART for Privatized Text Rewriting under Local Differential Privacy
by: Igamberdiev, Timour, et al.
Published: (2023)

DP-RDM: Adapting Diffusion Models to Private Domains Without Fine-Tuning
by: Lebensold, Jonathan, et al.
Published: (2024)

Optimal Differentially Private Model Training with Public Data
by: Lowy, Andrew, et al.
Published: (2023)

Training Set Reconstruction from Differentially Private Forests: How Effective is DP?
by: Gorgé, Alice, et al.
Published: (2025)

Less Random, More Private: What is the Optimal Subsampling Scheme for DP-SGD?
by: Dong, Andy, et al.
Published: (2026)

DP-FedLoRA: Privacy-Enhanced Federated Fine-Tuning for On-Device Large Language Models
by: Xu, Honghui, et al.
Published: (2025)

DP-SPRT: Differentially Private Sequential Probability Ratio Tests
by: Michel, Thomas, et al.
Published: (2025)

Differentially Private Fine-Tuning of Diffusion Models
by: Tsai, Yu-Lin, et al.
Published: (2024)

The Quantum-Cryptographic Co-evolution
by: Kundu, Ashish, et al.
Published: (2026)

Advancing Honeywords for Real-World Authentication Security
by: Das, Sudiksha, et al.
Published: (2025)

SMA-DP: Spectral Memory-Aware Differential Privacy for Deep Learning
by: Partohaghighi, Mohammad, et al.
Published: (2026)

Preserving Target Distributions With Differentially Private Count Mechanisms
by: Kohli, Nitin, et al.
Published: (2026)