Cover Image

LoRA and Privacy: When Random Projections Help (and When They Don't)

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Hu, Yaxi, Düngler, Johanna, Schölkopf, Bernhard, Sanyal, Amartya
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Provable Privacy with Non-Private Pre-Processing
by: Hu, Yaxi, et al.
Published: (2024)

Online Learning and Unlearning
by: Hu, Yaxi, et al.
Published: (2025)

An Iterative Algorithm for Differentially Private $k$-PCA with Adaptive Noise
by: Düngler, Johanna, et al.
Published: (2025)

Accuracy on the wrong line: On the pitfalls of noisy data for out-of-distribution generalisation
by: Sanyal, Amartya, et al.
Published: (2024)

Differentially Private Steering for Large Language Model Alignment
by: Goel, Anmol, et al.
Published: (2025)

CE-LoRA: Computation-Efficient LoRA Fine-Tuning for Language Models
by: Chen, Guanduo, et al.
Published: (2025)

R-LoRA: Randomized Multi-Head LoRA for Efficient Multi-Task Learning
by: Liu, Jinda, et al.
Published: (2025)

LoRA Provides Differential Privacy by Design via Random Sketching
by: Malekmohammadi, Saber, et al.
Published: (2024)

FedRand: Enhancing Privacy in Federated Learning with Randomized LoRA Subparameter Updates
by: Park, Sangwoo, et al.
Published: (2025)

Run LoRA Run: Faster and Lighter LoRA Implementations
by: Cherniuk, Daria, et al.
Published: (2023)

Neurosymbolic LoRA: Why and When to Tune Weights vs. Rewrite Prompts
by: Wang, Kevin, et al.
Published: (2026)

When Models Don't Collapse: On the Consistency of Iterative MLE
by: Barzilai, Daniel, et al.
Published: (2025)

Risks When Sharing LoRA Fine-Tuned Diffusion Model Weights
by: Yao, Dixi
Published: (2024)

Revisiting LoRA through the Lens of Parameter Redundancy: Spectral Encoding Helps
by: Cheng, Jiashun, et al.
Published: (2025)

LoRA Diffusion: Zero-Shot LoRA Synthesis for Diffusion Model Personalization
by: Smith, Ethan, et al.
Published: (2024)

Block-Diagonal LoRA for Eliminating Communication Overhead in Tensor Parallel LoRA Serving
by: Wang, Xinyu, et al.
Published: (2025)

S-LoRA: Serving Thousands of Concurrent LoRA Adapters
by: Sheng, Ying, et al.
Published: (2023)

LoRA-drop: Efficient LoRA Parameter Pruning based on Output Evaluation
by: Zhou, Hongyun, et al.
Published: (2024)

Improving LoRA in Privacy-preserving Federated Learning
by: Sun, Youbang, et al.
Published: (2024)

Cross-LoRA: A Data-Free LoRA Transfer Framework across Heterogeneous LLMs
by: Xia, Feifan, et al.
Published: (2025)

WinFLoRA: Incentivizing Client-Adaptive Aggregation in Federated LoRA under Privacy Heterogeneity
by: Kou, Mengsha, et al.
Published: (2026)

LoRA on the Go: Instance-level Dynamic LoRA Selection and Merging
by: Lee, Seungeon, et al.
Published: (2025)

Rethinking LoRA for Privacy-Preserving Federated Learning in Large Models
by: Liu, Jin, et al.
Published: (2026)

Orthogonal Subspace Projection for Continual Machine Unlearning via SVD-Based LoRA
by: Rahulamathavan, Yogachandran, et al.
Published: (2026)

Latent Space Factorization in LoRA
by: Kumar, Shashi, et al.
Published: (2025)

Kron-LoRA: Hybrid Kronecker-LoRA Adapters for Scalable, Sustainable Fine-tuning
by: Shen, Yixin
Published: (2025)

AFA-LoRA: Enabling Non-Linear Adaptations in LoRA with Activation Function Annealing
by: Li, Jiacheng, et al.
Published: (2025)

LoRA-Mixer: Coordinate Modular LoRA Experts Through Serial Attention Routing
by: Li, Wenbing, et al.
Published: (2025)

LoRA-FAIR: Federated LoRA Fine-Tuning with Aggregation and Initialization Refinement
by: Bian, Jieming, et al.
Published: (2024)

LoRA Done RITE: Robust Invariant Transformation Equilibration for LoRA Optimization
by: Yen, Jui-Nan, et al.
Published: (2024)

GEM-Style Constraints for PEFT with Dual Gradient Projection in LoRA
by: Tekmen, Brian, et al.
Published: (2026)

Mixture of LoRA Experts
by: Wu, Xun, et al.
Published: (2024)

CopRA: A Progressive LoRA Training Strategy
by: Zhuang, Zhan, et al.
Published: (2024)

LoRA-MME: Multi-Model Ensemble of LoRA-Tuned Encoders for Code Comment Classification
by: Haider, Md Akib, et al.
Published: (2026)

SCALE-LoRA: Auditing Post-Retrieval LoRA Composition with Residual Merging and View Reliability
by: Zhou, Shuaipeng, et al.
Published: (2026)

Adaptive Selection of LoRA Components in Privacy-Preserving Federated Learning
by: Kim, Myoungjun, et al.
Published: (2026)

When Respondents Don't Care Anymore: Identifying the Onset of Careless Responding
by: Welz, Max, et al.
Published: (2023)

SDFLoRA: Selective Decoupled Federated LoRA for Privacy-preserving Fine-tuning with Heterogeneous Clients
by: Shen, Zhikang, et al.
Published: (2026)

A Note on LoRA
by: Fomenko, Vlad, et al.
Published: (2024)

PRoLoRA: Partial Rotation Empowers More Parameter-Efficient LoRA
by: Wang, Sheng, et al.
Published: (2024)