Cover Image

Differentially Private Subspace Fine-Tuning for Large Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zheng, Lele, Wang, Xiang, Zhang, Tao, Cao, Yang, Cheng, Ke, Shen, Yulong
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Cryptography and Security
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Extracting Spatiotemporal Data from Gradients with Large Language Models
by: Zheng, Lele, et al.
Published: (2024)

DP-SelFT: Differentially Private Selective Fine-Tuning for Large Language Models
by: Sha, Haichao, et al.
Published: (2026)

Efficient Differentially Private Fine-Tuning of Diffusion Models
by: Liu, Jing, et al.
Published: (2024)

LMO-DP: Optimizing the Randomization Mechanism for Differentially Private Fine-Tuning (Large) Language Models
by: Yang, Qin, et al.
Published: (2024)

Revisiting Differentially Private Hyper-parameter Tuning
by: Xiang, Zihang, et al.
Published: (2024)

DPZero: Private Fine-Tuning of Language Models without Backpropagation
by: Zhang, Liang, et al.
Published: (2023)

Differentially Private Diffusion Models
by: Dockhorn, Tim, et al.
Published: (2022)

Differentially Private Sparse Linear Regression with Heavy-tailed Responses
by: Tian, Xizhi, et al.
Published: (2025)

Differentially Private Low-Rank Adaptation of Large Language Model Using Federated Learning
by: Liu, Xiao-Yang, et al.
Published: (2023)

Practical Differentially Private Hyperparameter Tuning with Subsampling
by: Koskela, Antti, et al.
Published: (2023)

Scaling Laws for Differentially Private Language Models
by: McKenna, Ryan, et al.
Published: (2025)

FlashDP: Private Training Large Language Models with Efficient DP-SGD
by: Wang, Liangyu, et al.
Published: (2025)

Can Differentially Private Fine-tuning LLMs Protect Against Privacy Attacks?
by: Du, Hao, et al.
Published: (2025)

Clients Collaborate: Flexible Differentially Private Federated Learning with Guaranteed Improvement of Utility-Privacy Trade-off
by: Li, Yuecheng, et al.
Published: (2024)

Differentially Private Preference Data Synthesis for Large Language Model Alignment
by: Gao, Fengyu, et al.
Published: (2026)

PACZero: PAC-Private Fine-Tuning of Language Models via Sign Quantization
by: Ertan, Murat Bilgehan, et al.
Published: (2026)

LanFL: Differentially Private Federated Learning with Large Language Models using Synthetic Samples
by: Wu, Huiyu, et al.
Published: (2024)

Differentially Private Federated Learning: A Systematic Review
by: Fu, Jie, et al.
Published: (2024)

Reconstruction of Differentially Private Text Sanitization via Large Language Models
by: Pang, Shuchao, et al.
Published: (2024)

Improving the Privacy and Practicality of Objective Perturbation for Differentially Private Linear Learners
by: Redberg, Rachel, et al.
Published: (2023)

Differentially Private Next-Token Prediction of Large Language Models
by: Flemings, James, et al.
Published: (2024)

Differentially Private Attention Computation
by: Gao, Yeqi, et al.
Published: (2023)

Private Fine-tuning of Large Language Models with Zeroth-order Optimization
by: Tang, Xinyu, et al.
Published: (2024)

Differentially Private Random Feature Model
by: Liao, Chunyang, et al.
Published: (2024)

On Differentially Private Subspace Estimation in a Distribution-Free Setting
by: Tsfadia, Eliad
Published: (2024)

Differentially Private Tabular Data Synthesis using Large Language Models
by: Tran, Toan V., et al.
Published: (2024)

Mind the Privacy Unit! User-Level Differential Privacy for Language Model Fine-Tuning
by: Chua, Lynn, et al.
Published: (2024)

In-Context Probing for Membership Inference in Fine-Tuned Language Models
by: Lu, Zhexi, et al.
Published: (2025)

PrivORL: Differentially Private Synthetic Dataset for Offline Reinforcement Learning
by: Gong, Chen, et al.
Published: (2025)

Delving into Differentially Private Transformer
by: Ding, Youlong, et al.
Published: (2024)

Private and Communication-Efficient Federated Learning based on Differentially Private Sketches
by: Zhang, Meifan, et al.
Published: (2024)

Privately Learning from Graphs with Applications in Fine-tuning Large Language Models
by: Yin, Haoteng, et al.
Published: (2024)

HRNet: Differentially Private Hierarchical and Multi-Resolution Network for Human Mobility Data Synthesization
by: Takagi, Shun, et al.
Published: (2024)

Differentially Private Training of Mixture of Experts Models
by: Tholoniat, Pierre, et al.
Published: (2024)

Pre-training Differentially Private Models with Limited Public Data
by: Bu, Zhiqi, et al.
Published: (2024)

Adaptively Private Next-Token Prediction of Large Language Models
by: Flemings, James, et al.
Published: (2024)

Private Linear Regression with Differential Privacy and PAC Privacy
by: Yang, Hillary, et al.
Published: (2024)

Position: Considerations for Differentially Private Learning with Large-Scale Public Pretraining
by: Tramèr, Florian, et al.
Published: (2022)

Locally Private Estimation with Public Features
by: Ma, Yuheng, et al.
Published: (2024)

The 'Sure' Trap: Multi-Scale Poisoning Analysis of Stealthy Compliance-Only Backdoors in Fine-Tuned Large Language Models
by: Tan, Yuting, et al.
Published: (2025)