Cover Image

Pre-training Differentially Private Models with Limited Public Data

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Bu, Zhiqi, Zhang, Xinwei, Hong, Mingyi, Zha, Sheng, Karypis, George
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Cryptography and Security
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

DOPPLER: Differentially Private Optimizers with Low-pass Filter for Privacy Noise Reduction
by: Zhang, Xinwei, et al.
Published: (2024)

Differentially Private SGD Without Clipping Bias: An Error-Feedback Approach
by: Zhang, Xinwei, et al.
Published: (2023)

Differentially Private Bias-Term Fine-tuning of Foundation Models
by: Bu, Zhiqi, et al.
Published: (2022)

DiSK: Differentially Private Optimizer with Simplified Kalman Filter for Noise Reduction
by: Zhang, Xinwei, et al.
Published: (2024)

Mitigating Noise Detriment in Differentially Private Federated Learning with Model Pre-training
by: Jin, Huitong, et al.
Published: (2024)

Accuracy Improvement in Differentially Private Logistic Regression: A Pre-training Approach
by: Hoseinpour, Mohammad, et al.
Published: (2023)

Selective Pre-training for Private Fine-tuning
by: Yu, Da, et al.
Published: (2023)

Oracle-Efficient Differentially Private Learning with Public Data
by: Block, Adam, et al.
Published: (2024)

Optimal Differentially Private Model Training with Public Data
by: Lowy, Andrew, et al.
Published: (2023)

Differentially Private Low-Rank Adaptation of Large Language Model Using Federated Learning
by: Liu, Xiao-Yang, et al.
Published: (2023)

Scaling Laws for Differentially Private Language Models
by: McKenna, Ryan, et al.
Published: (2025)

Differentially Private Diffusion Models
by: Dockhorn, Tim, et al.
Published: (2022)

Position: Considerations for Differentially Private Learning with Large-Scale Public Pretraining
by: Tramèr, Florian, et al.
Published: (2022)

Differentially Private Random Feature Model
by: Liao, Chunyang, et al.
Published: (2024)

Differentially Private Publication of Electricity Time Series Data in Smart Grids
by: Shaham, Sina, et al.
Published: (2024)

Optimal Locally Private Nonparametric Classification with Public Data
by: Ma, Yuheng, et al.
Published: (2023)

Private and Communication-Efficient Federated Learning based on Differentially Private Sketches
by: Zhang, Meifan, et al.
Published: (2024)

DP-SelFT: Differentially Private Selective Fine-Tuning for Large Language Models
by: Sha, Haichao, et al.
Published: (2026)

Differentially Private Training of Mixture of Experts Models
by: Tholoniat, Pierre, et al.
Published: (2024)

Distributed Differentially Private Data Analytics via Secure Sketching
by: Burkhardt, Jakob, et al.
Published: (2024)

Differentially Private Subspace Fine-Tuning for Large Language Models
by: Zheng, Lele, et al.
Published: (2026)

Differentially Private Log-Location-Scale Regression Using Functional Mechanism
by: Sheng, Jiewen, et al.
Published: (2024)

Privacy Backdoors: Enhancing Membership Inference through Poisoning Pre-trained Models
by: Wen, Yuxin, et al.
Published: (2024)

An Improved Privacy and Utility Analysis of Differentially Private SGD with Bounded Domain and Smooth Losses
by: Liang, Hao, et al.
Published: (2025)

DPDR: Gradient Decomposition and Reconstruction for Differentially Private Deep Learning
by: Liu, Yixuan, et al.
Published: (2024)

Bounding the Excess Risk for Linear Models Trained on Marginal-Preserving, Differentially-Private, Synthetic Data
by: Zhou, Yvonne, et al.
Published: (2024)

Efficient Differentially Private Fine-Tuning of Diffusion Models
by: Liu, Jing, et al.
Published: (2024)

Training Differentially Private Models with Secure Multiparty Computation
by: Pentyala, Sikha, et al.
Published: (2022)

DP-LDMs: Differentially Private Latent Diffusion Models
by: Liu, Michael F., et al.
Published: (2023)

Differentially Private Federated Learning: A Systematic Review
by: Fu, Jie, et al.
Published: (2024)

Differentially Private Active Learning: Balancing Effective Data Selection and Privacy
by: Schwethelm, Kristian, et al.
Published: (2024)

Data Poisoning Attacks to Locally Differentially Private Range Query Protocols
by: Liao, Ting-Wei, et al.
Published: (2025)

Differentially Private Federated $k$-Means Clustering with Server-Side Data
by: Scott, Jonathan, et al.
Published: (2025)

Differentially-Private Data Synthetisation for Efficient Re-Identification Risk Control
by: Carvalho, Tânia, et al.
Published: (2022)

Delving into Differentially Private Transformer
by: Ding, Youlong, et al.
Published: (2024)

Differentially Private Attention Computation
by: Gao, Yeqi, et al.
Published: (2023)

Indiscriminate Data Poisoning Attacks on Pre-trained Feature Extractors
by: Lu, Yiwei, et al.
Published: (2024)

Privately Learning Decision Lists and a Differentially Private Winnow
by: Bun, Mark, et al.
Published: (2026)

PCDP-SGD: Improving the Convergence of Differentially Private SGD via Projection in Advance
by: Sha, Haichao, et al.
Published: (2023)

Leveraging Vertical Public-Private Split for Improved Synthetic Data Generation
by: Maddock, Samuel, et al.
Published: (2025)