Cover Image

Differentially Private Learning Needs Better Model Initialization and Self-Distillation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ngong, Ivoline C., Near, Joseph P., Mireshghallah, Niloofar
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence Computation and Language Cryptography and Security
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Position: Privacy Is Not Just Memorization!
by: Mireshghallah, Niloofar, et al.
Published: (2025)

Distributed HDMM: Scalable, Distributed, Accurate, and Differentially Private Query Workloads without a Trusted Curator
by: Sedimo, Ratang, et al.
Published: (2025)

Synthetic Data Can Mislead Evaluations: Membership Inference as Machine Text Detection
by: Naseh, Ali, et al.
Published: (2025)

Evaluating the Usability of Differential Privacy Tools with Data Practitioners
by: Ngong, Ivoline C., et al.
Published: (2023)

OLYMPIA: A Simulation Framework for Evaluating the Concrete Scalability of Secure Aggregation Protocols
by: Ngong, Ivoline C., et al.
Published: (2023)

Differentially Private Multimodal In-Context Learning
by: Ngong, Ivoline C., et al.
Published: (2026)

Clustering and Median Aggregation Improve Differentially Private Inference
by: Amin, Kareem, et al.
Published: (2025)

Protecting Users From Themselves: Safeguarding Contextual Privacy in Interactions with Conversational Agents
by: Ngong, Ivoline, et al.
Published: (2025)

Learning to Diagnose Privately: DP-Powered LLMs for Radiology Report Classification
by: Bhattacharjee, Payel, et al.
Published: (2025)

Urania: Differentially Private Insights into AI Use
by: Liu, Daogao, et al.
Published: (2025)

How Private is Your Attention? Bridging Privacy with In-Context Learning
by: Bonnerjee, Soham, et al.
Published: (2025)

Can LLMs Keep a Secret? Testing Privacy Implications of Language Models via Contextual Integrity Theory
by: Mireshghallah, Niloofar, et al.
Published: (2023)

Teach LLMs to Phish: Stealing Private Information from Language Models
by: Panda, Ashwinee, et al.
Published: (2024)

DP-MemArc: Differential Privacy Transfer Learning for Memory Efficient Language Models
by: Liu, Yanming, et al.
Published: (2024)

SentinelLMs: Encrypted Input Adaptation and Fine-tuning of Language Models for Private and Secure Inference
by: Mishra, Abhijit, et al.
Published: (2023)

MAPLE: Metadata Augmented Private Language Evolution
by: Chien, Eli, et al.
Published: (2026)

Differentially Private Knowledge Distillation via Synthetic Text Generation
by: Flemings, James, et al.
Published: (2024)

EPSVec: Efficient and Private Synthetic Data Generation via Dataset Vectors
by: Banayeeanzade, Amin, et al.
Published: (2026)

Fine-Tuning Language Models with Differential Privacy through Adaptive Noise Allocation
by: Li, Xianzhi, et al.
Published: (2024)

Differentially Private Deep Model-Based Reinforcement Learning
by: Rio, Alexandre, et al.
Published: (2024)

SecEncoder: Logs are All You Need in Security
by: Bulut, Muhammed Fatih, et al.
Published: (2024)

Privacy-Preserving Student Learning with Differentially Private Data-Free Distillation
by: Liu, Bochao, et al.
Published: (2024)

ObfuscaTune: Obfuscated Offsite Fine-tuning and Inference of Proprietary LLMs on Private Datasets
by: Frikha, Ahmed, et al.
Published: (2024)

Differentially Private Model Merging
by: Yin, Qichuan, et al.
Published: (2026)

FERRET: Private Deep Learning Faster And Better Than DPSGD
by: Zagardo, David
Published: (2025)

IncogniText: Privacy-enhancing Conditional Text Anonymization via LLM-based Private Attribute Randomization
by: Frikha, Ahmed, et al.
Published: (2024)

KDA: A Knowledge-Distilled Attacker for Generating Diverse Prompts to Jailbreak LLMs
by: Liang, Buyun, et al.
Published: (2025)

Differentially Private Reinforcement Learning with Self-Play
by: Qiao, Dan, et al.
Published: (2024)

SoK: Usability Studies in Differential Privacy
by: Dibia, Onyinye, et al.
Published: (2024)

On Adversarial Robustness of Language Models in Transfer Learning
by: Turbal, Bohdan, et al.
Published: (2024)

FedMentor: Domain-Aware Differential Privacy for Heterogeneous Federated LLMs in Mental Health
by: Sarwar, Nobin, et al.
Published: (2025)

Differentially Private In-Context Learning with Nearest Neighbor Search
by: Koskela, Antti, et al.
Published: (2025)

Improved Algorithms for Differentially Private Language Model Alignment
by: Chen, Keyu, et al.
Published: (2025)

Differentially Private Retrieval-Augmented Generation
by: Tang, Tingting, et al.
Published: (2026)

Differentially Private Block-wise Gradient Shuffle for Deep Learning
by: Zagardo, David
Published: (2024)

Privacy-Preserving Federated Learning with Differentially Private Hyperdimensional Computing
by: Piran, Fardin Jalil, et al.
Published: (2024)

Data-adaptive Differentially Private Prompt Synthesis for In-Context Learning
by: Gao, Fengyu, et al.
Published: (2024)

Revealing Weaknesses in Text Watermarking Through Self-Information Rewrite Attacks
by: Cheng, Yixin, et al.
Published: (2025)

Privacy-Preserving Data Deduplication for Enhancing Federated Learning of Language Models (Extended Version)
by: Abadi, Aydin, et al.
Published: (2024)

LLM Ghostbusters: Surgical Hallucination Suppression via Adaptive Unlearning
by: Spracklen, Joseph, et al.
Published: (2026)