Cover Image

Private Fine-tuning of Large Language Models with Zeroth-order Optimization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Tang, Xinyu, Panda, Ashwinee, Nasr, Milad, Mahloujifar, Saeed, Mittal, Prateek
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Computation and Language Cryptography and Security
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A New Linear Scaling Rule for Private Adaptive Hyperparameter Optimization
by: Panda, Ashwinee, et al.
Published: (2022)

Privacy Auditing of Large Language Models
by: Panda, Ashwinee, et al.
Published: (2025)

Teach LLMs to Phish: Stealing Private Information from Language Models
by: Panda, Ashwinee, et al.
Published: (2024)

Privately Learning from Graphs with Applications in Fine-tuning Large Language Models
by: Yin, Haoteng, et al.
Published: (2024)

Publicly-Detectable Watermarking for Language Models
by: Fairoze, Jaiden, et al.
Published: (2023)

LMO-DP: Optimizing the Randomization Mechanism for Differentially Private Fine-Tuning (Large) Language Models
by: Yang, Qin, et al.
Published: (2024)

Model Provenance Testing for Large Language Models
by: Nikolic, Ivica, et al.
Published: (2025)

SentinelLMs: Encrypted Input Adaptation and Fine-tuning of Language Models for Private and Secure Inference
by: Mishra, Abhijit, et al.
Published: (2023)

Practical Membership Inference Attacks against Fine-tuned Large Language Models via Self-prompt Calibration
by: Fu, Wenjie, et al.
Published: (2023)

Why LLM Safety Guardrails Collapse After Fine-tuning: A Similarity Analysis Between Alignment and Fine-tuning Datasets
by: Hsiung, Lei, et al.
Published: (2025)

Differentially Private Bias-Term Fine-tuning of Foundation Models
by: Bu, Zhiqi, et al.
Published: (2022)

Differentially Private Next-Token Prediction of Large Language Models
by: Flemings, James, et al.
Published: (2024)

Remote Timing Attacks on Efficient Language Model Inference
by: Carlini, Nicholas, et al.
Published: (2024)

Differentially Private Tabular Data Synthesis using Large Language Models
by: Tran, Toan V., et al.
Published: (2024)

Virus: Harmful Fine-tuning Attack for Large Language Models Bypassing Guardrail Moderation
by: Huang, Tiansheng, et al.
Published: (2025)

Prompt Public Large Language Models to Synthesize Data for Private On-device Applications
by: Wu, Shanshan, et al.
Published: (2024)

Certifiably Robust RAG against Retrieval Corruption
by: Xiang, Chong, et al.
Published: (2024)

ObfuscaTune: Obfuscated Offsite Fine-tuning and Inference of Proprietary LLMs on Private Datasets
by: Frikha, Ahmed, et al.
Published: (2024)

A Study of Backdoors in Instruction Fine-tuned Language Models
by: Raghuram, Jayaram, et al.
Published: (2024)

Phantom: General Backdoor Attacks on Retrieval Augmented Language Generation
by: Chaudhari, Harsh, et al.
Published: (2024)

Auditing $f$-Differential Privacy in One Run
by: Mahloujifar, Saeed, et al.
Published: (2024)

Query-Based Adversarial Prompt Generation
by: Hayase, Jonathan, et al.
Published: (2024)

Improved Techniques for Optimization-Based Jailbreaking on Large Language Models
by: Jia, Xiaojun, et al.
Published: (2024)

The Janus Interface: How Fine-Tuning in Large Language Models Amplifies the Privacy Risks
by: Chen, Xiaoyi, et al.
Published: (2023)

Backdooring Instruction-Tuned Large Language Models with Virtual Prompt Injection
by: Yan, Jun, et al.
Published: (2023)

SALT: Steering Activations towards Leakage-free Thinking in Chain of Thought
by: Batra, Shourya, et al.
Published: (2025)

Selective Pre-training for Private Fine-tuning
by: Yu, Da, et al.
Published: (2023)

A Watermark for Large Language Models
by: Kirchenbauer, John, et al.
Published: (2023)

On the Reliability of Watermarks for Large Language Models
by: Kirchenbauer, John, et al.
Published: (2023)

Mind the Privacy Unit! User-Level Differential Privacy for Language Model Fine-Tuning
by: Chua, Lynn, et al.
Published: (2024)

SecAlign: Defending Against Prompt Injection with Preference Optimization
by: Chen, Sizhe, et al.
Published: (2024)

SafeCOMM: A Study on Safety Degradation in Fine-Tuned Telecom Large Language Models
by: Djuhera, Aladin, et al.
Published: (2025)

Topic-Based Watermarks for Large Language Models
by: Nemecek, Alexander, et al.
Published: (2024)

Representation Bending for Large Language Model Safety
by: Yousefpour, Ashkan, et al.
Published: (2025)

User Inference Attacks on Large Language Models
by: Kandpal, Nikhil, et al.
Published: (2023)

Can Federated Learning Safeguard Private Data in LLM Training? Vulnerabilities, Attacks, and Defense Evaluation
by: Guo, Wenkai, et al.
Published: (2025)

Private Zeroth-Order Nonsmooth Nonconvex Optimization
by: Zhang, Qinzi, et al.
Published: (2024)

Detecting Pretraining Data from Large Language Models
by: Shi, Weijia, et al.
Published: (2023)

Learning to Poison Large Language Models for Downstream Manipulation
by: Zhou, Xiangyu, et al.
Published: (2024)

Watermarks for Embeddings-as-a-Service Large Language Models
by: Shetty, Anudeex
Published: (2025)