Cover Image

Selective Pre-training for Private Fine-tuning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yu, Da, Gopi, Sivakanth, Kulkarni, Janardhan, Lin, Zinan, Naik, Saurabh, Religa, Tomasz Lukasz, Yin, Jian, Zhang, Huishuai
Format:	Preprint
Published:	2023
Subjects:	Machine Learning Cryptography and Security
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Differentially Private Synthetic Data via Foundation Model APIs 1: Images
by: Lin, Zinan, et al.
Published: (2023)

Privacy-Preserving In-Context Learning with Differentially Private Few-Shot Generation
by: Tang, Xinyu, et al.
Published: (2023)

Individual Privacy Accounting for Differentially Private Stochastic Gradient Descent
by: Yu, Da, et al.
Published: (2022)

DP-SAPF: Saliency-Aware Parameter Fine-tuning of Public Models for Differentially Private Image Synthesis
by: Gong, Chen, et al.
Published: (2026)

Differentially Private Training of Mixture of Experts Models
by: Tholoniat, Pierre, et al.
Published: (2024)

Inferentially-Private Private Information
by: Wang, Shuaiqi, et al.
Published: (2024)

Privately Aligning Language Models with Reinforcement Learning
by: Wu, Fan, et al.
Published: (2023)

PE-means: Improved Differentially Private $k$-means Clustering through Private Evolution
by: Humphries, Thomas, et al.
Published: (2026)

Differentially Private Parameter-Efficient Fine-tuning for Large ASR Models
by: Liu, Hongbin, et al.
Published: (2024)

Differentially Private Contrastive Learning via Bounding Group-level Contribution
by: Li, Kecen, et al.
Published: (2026)

Algorithmic Aspects of the Log-Laplace Transform and a Non-Euclidean Proximal Sampler
by: Gopi, Sivakanth, et al.
Published: (2023)

DPImageBench: A Unified Benchmark for Differentially Private Image Synthesis
by: Gong, Chen, et al.
Published: (2025)

Privately Learning from Graphs with Applications in Fine-tuning Large Language Models
by: Yin, Haoteng, et al.
Published: (2024)

Pre-training Differentially Private Models with Limited Public Data
by: Bu, Zhiqi, et al.
Published: (2024)

Private LoRA Fine-tuning of Open-Source LLMs with Homomorphic Encryption
by: Frery, Jordan, et al.
Published: (2025)

Augmenting Parameter-Efficient Pre-trained Language Models with Large Language Models
by: Anand, Saurabh, et al.
Published: (2026)

Accuracy Improvement in Differentially Private Logistic Regression: A Pre-training Approach
by: Hoseinpour, Mohammad, et al.
Published: (2023)

Mitigating Noise Detriment in Differentially Private Federated Learning with Model Pre-training
by: Jin, Huitong, et al.
Published: (2024)

Token-level Data Selection for Safe LLM Fine-tuning
by: Li, Yanping, et al.
Published: (2026)

From Easy to Hard++: Promoting Differentially Private Image Synthesis Through Spatial-Frequency Curriculum
by: Gong, Chen, et al.
Published: (2026)

Private Fine-tuning of Large Language Models with Zeroth-order Optimization
by: Tang, Xinyu, et al.
Published: (2024)

Practical Differentially Private Hyperparameter Tuning with Subsampling
by: Koskela, Antti, et al.
Published: (2023)

Case Study: Fine-tuning Small Language Models for Accurate and Private CWE Detection in Python Code
by: Bappy, Md. Azizul Hakim, et al.
Published: (2025)

MAUI: Reconstructing Private Client Data in Federated Transfer Learning
by: Dabholkar, Ahaan, et al.
Published: (2025)

Efficiently Computing Similarities to Private Datasets
by: Backurs, Arturs, et al.
Published: (2024)

Alleviating the Fear of Losing Alignment in LLM Fine-tuning
by: Yang, Kang, et al.
Published: (2025)

Can Differentially Private Fine-tuning LLMs Protect Against Privacy Attacks?
by: Du, Hao, et al.
Published: (2025)

SelectFormer: Private and Practical Data Selection for Transformers
by: Ouyang, Xu, et al.
Published: (2023)

Privacy Profiles for Private Selection
by: Koskela, Antti, et al.
Published: (2024)

Characterizing the Training Dynamics of Private Fine-tuning with Langevin diffusion
by: Ke, Shuqi, et al.
Published: (2024)

Differentially Private Bias-Term Fine-tuning of Foundation Models
by: Bu, Zhiqi, et al.
Published: (2022)

SDD: Self-Degraded Defense against Malicious Fine-tuning
by: Chen, Zixuan, et al.
Published: (2025)

Fine-tuning Large Language Models for DGA and DNS Exfiltration Detection
by: Sayed, Md Abu, et al.
Published: (2024)

No Two Devils Alike: Unveiling Distinct Mechanisms of Fine-tuning Attacks
by: Leong, Chak Tou, et al.
Published: (2024)

DP-SelFT: Differentially Private Selective Fine-Tuning for Large Language Models
by: Sha, Haichao, et al.
Published: (2026)

Privacy Aware Memory Forensics
by: Kalikiri, Janardhan, et al.
Published: (2024)

SOFT: Selective Data Obfuscation for Protecting LLM Fine-tuning against Membership Inference Attacks
by: Zhang, Kaiyuan, et al.
Published: (2025)

Black-box Membership Inference Attacks against Fine-tuned Diffusion Models
by: Pang, Yan, et al.
Published: (2023)

Attack via Overfitting: 10-shot Benign Fine-tuning to Jailbreak LLMs
by: Xie, Zhixin, et al.
Published: (2025)

VertMark: A Unified Training-Free Robust Watermarking Framework for Vertical Domain Pre-trained Language Models
by: Kong, Cong, et al.
Published: (2026)