Cover Image

Differentially Private Training of Mixture of Experts Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Tholoniat, Pierre, Inan, Huseyin A., Kulkarni, Janardhan, Sim, Robert
Format:	Preprint
Published:	2024
Subjects:	Cryptography and Security Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Privately Aligning Language Models with Reinforcement Learning
by: Wu, Fan, et al.
Published: (2023)

Privacy-Preserving In-Context Learning with Differentially Private Few-Shot Generation
by: Tang, Xinyu, et al.
Published: (2023)

Differentially Private Synthetic Data via Foundation Model APIs 1: Images
by: Lin, Zinan, et al.
Published: (2023)

Practical Differentially Private Hyperparameter Tuning with Subsampling
by: Koskela, Antti, et al.
Published: (2023)

Individual Privacy Accounting for Differentially Private Stochastic Gradient Descent
by: Yu, Da, et al.
Published: (2022)

Selective Pre-training for Private Fine-tuning
by: Yu, Da, et al.
Published: (2023)

Training Differentially Private Models with Secure Multiparty Computation
by: Pentyala, Sikha, et al.
Published: (2022)

Banded Square Root Matrix Factorization for Differentially Private Model Training
by: Kalinin, Nikita P., et al.
Published: (2024)

Differentially Private In-Context Learning with Nearest Neighbor Search
by: Koskela, Antti, et al.
Published: (2025)

Differentially Private Diffusion Models
by: Dockhorn, Tim, et al.
Published: (2022)

PM-MOE: Mixture of Experts on Private Model Parameters for Personalized Federated Learning
by: Feng, Yu, et al.
Published: (2025)

DPack: Efficiency-Oriented Privacy Budget Scheduling
by: Tholoniat, Pierre, et al.
Published: (2022)

Differentially Private Random Feature Model
by: Liao, Chunyang, et al.
Published: (2024)

Scaling Laws for Differentially Private Language Models
by: McKenna, Ryan, et al.
Published: (2025)

Bounding the Excess Risk for Linear Models Trained on Marginal-Preserving, Differentially-Private, Synthetic Data
by: Zhou, Yvonne, et al.
Published: (2024)

Optimal Differentially Private Model Training with Public Data
by: Lowy, Andrew, et al.
Published: (2023)

Buffer Overflow in Mixture of Experts
by: Hayes, Jamie, et al.
Published: (2024)

Training Set Reconstruction from Differentially Private Forests: How Effective is DP?
by: Gorgé, Alice, et al.
Published: (2025)

Bayesian Pseudo Posterior Mechanism for Differentially Private Machine Learning
by: Chew, Robert, et al.
Published: (2025)

Tighter Risk Bounds for Mixtures of Experts
by: Akretche, Wissam, et al.
Published: (2024)

HoGS: Homophily-Oriented Graph Synthesis for Local Differentially Private GNN Training
by: Xu, Wen, et al.
Published: (2026)

Efficient Differentially Private Fine-Tuning of Diffusion Models
by: Liu, Jing, et al.
Published: (2024)

DP-LDMs: Differentially Private Latent Diffusion Models
by: Liu, Michael F., et al.
Published: (2023)

Delving into Differentially Private Transformer
by: Ding, Youlong, et al.
Published: (2024)

Differentially Private Attention Computation
by: Gao, Yeqi, et al.
Published: (2023)

Privately Learning Decision Lists and a Differentially Private Winnow
by: Bun, Mark, et al.
Published: (2026)

Training Differentially Private Ad Prediction Models with Semi-Sensitive Features
by: Chua, Lynn, et al.
Published: (2024)

Pre-training Differentially Private Models with Limited Public Data
by: Bu, Zhiqi, et al.
Published: (2024)

DP-TLDM: Differentially Private Tabular Latent Diffusion Model
by: Zhu, Chaoyi, et al.
Published: (2024)

Differentially Private Subspace Fine-Tuning for Large Language Models
by: Zheng, Lele, et al.
Published: (2026)

Releasing Differentially Private Event Logs Using Generative Models
by: Wangelik, Frederik, et al.
Published: (2025)

Private and Communication-Efficient Federated Learning based on Differentially Private Sketches
by: Zhang, Meifan, et al.
Published: (2024)

Differentially Private Conditional Independence Testing
by: Kalemaj, Iden, et al.
Published: (2023)

Correlated Noise Mechanisms for Differentially Private Learning
by: Pillutla, Krishna, et al.
Published: (2025)

Locally Differentially Private Embedding Models in Distributed Fraud Prevention Systems
by: Perez, Iker, et al.
Published: (2024)

Enhancing the "Immunity" of Mixture-of-Experts Networks for Adversarial Defense
by: Han, Qiao, et al.
Published: (2024)

Differentially Private Model Merging
by: Yin, Qichuan, et al.
Published: (2026)

Revisiting Differentially Private Hyper-parameter Tuning
by: Xiang, Zihang, et al.
Published: (2024)

Differentially Private Decentralized Learning with Random Walks
by: Cyffers, Edwige, et al.
Published: (2024)

Noise-Aware Differentially Private Variational Inference
by: Alrawajfeh, Talal, et al.
Published: (2024)