Cover Image

Efficient and Private: Memorisation under differentially private parameter-efficient fine-tuning in language models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ma, Olivia, Passerat-Palmbach, Jonathan, Usynin, Dmitrii
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Biologically-Informed Hybrid Membership Inference Attacks on Generative Genomic Models
by: Belfiore, Asia, et al.
Published: (2025)

Incentivising the federation: gradient-based metrics for data selection and valuation in private decentralised training
by: Usynin, Dmitrii, et al.
Published: (2023)

An Architecture Built for Federated Learning: Addressing Data Heterogeneity through Adaptive Normalization-Free Feature Recalibration
by: Siomos, Vasilis, et al.
Published: (2024)

Trust the Process: Zero-Knowledge Machine Learning to Enhance Trust in Generative AI Interactions
by: Ganescu, Bianca-Mihaela, et al.
Published: (2024)

GeoLoRA: Geometric integration for parameter efficient fine-tuning
by: Schotthöfer, Steffen, et al.
Published: (2024)

Open-weight genome language model safeguards: Assessing robustness via adversarial fine-tuning
by: Black, James R. M., et al.
Published: (2025)

FLoRA: Fused forward-backward adapters for parameter efficient fine-tuning and reducing inference-time latencies of LLMs
by: Gowda, Dhananjaya, et al.
Published: (2025)

FedCLAM: Client Adaptive Momentum with Foreground Intensity Matching for Federated Medical Image Segmentation
by: Siomos, Vasilis, et al.
Published: (2025)

Learning from models beyond fine-tuning
by: Zheng, Hongling, et al.
Published: (2023)

Physics-informed fine-tuning of foundation models for partial differential equations
by: Medvedev, Vlad, et al.
Published: (2026)

Entropy-guided sequence weighting for efficient exploration in RL-based LLM fine-tuning
by: Vanlioglu, Abdullah
Published: (2025)

Differentially Private aggregate hints in mev-share
by: Passerat-Palmbach, Jonathan, et al.
Published: (2025)

Fine-tuning LLaMA 2 interference: a comparative study of language implementations for optimal efficiency
by: Hossain, Sazzad, et al.
Published: (2025)

AdaGradSelect: An adaptive gradient-guided layer selection method for efficient fine-tuning of SLMs
by: Kumar, Anshul, et al.
Published: (2025)

Implicit meta-learning may lead language models to trust more reliable sources
by: Krasheninnikov, Dmitrii, et al.
Published: (2023)

Machine unlearning through fine-grained model parameters perturbation
by: Zuo, Zhiwei, et al.
Published: (2024)

Empirical influence functions to understand the logic of fine-tuning
by: Matelsky, Jordan K., et al.
Published: (2024)

Rethinking harmless refusals when fine-tuning foundation models
by: Pop, Florin, et al.
Published: (2024)

Scores as Actions: a framework of fine-tuning diffusion models by continuous-time reinforcement learning
by: Zhao, Hanyang, et al.
Published: (2024)

Fresh in memory: Training-order recency is linearly encoded in language model activations
by: Krasheninnikov, Dmitrii, et al.
Published: (2025)

Uncertainty modeling for fine-tuned implicit functions
by: Susmelj, Anna, et al.
Published: (2024)

Naturally Private Recommendations with Determinantal Point Processes
by: Fitzsimons, Jack, et al.
Published: (2024)

Correlating instruction-tuning (in multimodal models) with vision-language processing (in the brain)
by: Oota, Subba Reddy, et al.
Published: (2025)

Evolution of meta's llama models and parameter-efficient fine-tuning of large language models: a survey
by: Abdullah, Abdulhady Abas, et al.
Published: (2025)

Train on Validation (ToV): Fast data selection with applications to fine-tuning
by: Jain, Ayush, et al.
Published: (2025)

Evolutionary fine tuning of quantized convolution-based deep learning models
by: Pietroń, Marcin
Published: (2026)

ARIA: On the Interaction Between Architectures, Initialization and Aggregation Methods for Federated Visual Classification
by: Siomos, Vasilis, et al.
Published: (2023)

Jal Anveshak: Prediction of fishing zones using fine-tuned LlaMa 2
by: Mejari, Arnav, et al.
Published: (2024)

LIFT: Interpretable truck driving risk prediction with literature-informed fine-tuned LLMs
by: Hu, Xiao, et al.
Published: (2025)

Rethinking Reinforcement fine-tuning of LLMs: A Multi-armed Bandit Learning Perspective
by: Hu, Xiao, et al.
Published: (2026)

Uncertainty quantification in fine-tuned LLMs using LoRA ensembles
by: Balabanov, Oleksandr, et al.
Published: (2024)

A note on the impossibility of conditional PAC-efficient reasoning in large language models
by: Zeng, Hao
Published: (2025)

Perturbation: A simple and efficient adversarial tracer for representation learning in language models
by: Rozner, Joshua, et al.
Published: (2026)

Improving embedding with contrastive fine-tuning on small datasets with expert-augmented scores
by: Lu, Jun, et al.
Published: (2024)

Overcoming systematic softening in universal machine learning interatomic potentials by fine-tuning
by: Deng, Bowen, et al.
Published: (2024)

Can Differentially Private Fine-tuning LLMs Protect Against Privacy Attacks?
by: Du, Hao, et al.
Published: (2025)

The effect of fine-tuning on language model toxicity
by: Hawkins, Will, et al.
Published: (2024)

Efficient and Private Marginal Reconstruction with Local Non-Negativity
by: Mullins, Brett, et al.
Published: (2024)

Lightweight reranking for language model generations
by: Jain, Siddhartha, et al.
Published: (2023)

Harmony in Divergence: Towards Fast, Accurate, and Memory-efficient Zeroth-order LLM Fine-tuning
by: Tan, Qitao, et al.
Published: (2025)