Imagen de Portada

DP-DyLoRA: Fine-Tuning Transformer-Based Models On-Device under Differentially Private Federated Learning using Dynamic Low-Rank Adaptation

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Xu, Jie, Saravanan, Karthikeyan, van Dalen, Rogier, Mehmood, Haaris, Tuckey, David, Ozay, Mete
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Cryptography and Security Distributed, Parallel, and Cluster Computing
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

DP-LAC: Lightweight Adaptive Clipping for Differentially Private Federated Fine-tuning of Language Models
por: Mehmood, Haaris, et al.
Publicado: (2026)

DisAgg: Distributed Aggregators for Efficient Secure Aggregation in Federated Learning
por: Mehmood, Haaris, et al.
Publicado: (2026)

LoRA-C: Parameter-Efficient Fine-Tuning of Robust CNN for IoT Devices
por: Ding, Chuntao, et al.
Publicado: (2024)

Heterogeneous Federated Fine-Tuning with Parallel One-Rank Adaptation
por: Zhang, Zikai, et al.
Publicado: (2026)

EcoLoRA: Communication-Efficient Federated Fine-Tuning of Large Language Models
por: Liu, Han, et al.
Publicado: (2025)

FLoRA: Federated Fine-Tuning Large Language Models with Heterogeneous Low-Rank Adaptations
por: Wang, Ziyao, et al.
Publicado: (2024)

FedQuad: Adaptive Layer-wise LoRA Deployment and Activation Quantization for Federated Fine-Tuning
por: Li, Rukuo, et al.
Publicado: (2025)

Heterogeneous LoRA for Federated Fine-tuning of On-Device Foundation Models
por: Cho, Yae Jee, et al.
Publicado: (2024)

FDLoRA: Personalized Federated Learning of Large Language Model via Dual LoRA Tuning
por: QI, Jiaxing, et al.
Publicado: (2024)

SHE-LoRA: Selective Homomorphic Encryption for Federated Tuning with Heterogeneous LoRA
por: Liu, Jianmin, et al.
Publicado: (2025)

Stabilizing Decentralized Federated Fine-Tuning via Topology-Aware Alternating LoRA
por: Wang, Xiaoyu, et al.
Publicado: (2026)

HLoRA: Efficient Federated Learning System for LLM Heterogeneous Fine-Tuning
por: Liu, Qianli, et al.
Publicado: (2025)

Differentially Private Clustered Federated Learning with Privacy-Preserving Initialization and Normality-Driven Aggregation
por: Xu, Jie, et al.
Publicado: (2026)

pFedLoRA: Model-Heterogeneous Personalized Federated Learning with LoRA Tuning
por: Yi, Liping, et al.
Publicado: (2023)

Fed-pilot: Optimizing LoRA Allocation for Efficient Federated Fine-Tuning with Heterogeneous Clients
por: Zhang, Zikai, et al.
Publicado: (2024)

Fed-HeLLo: Efficient Federated Foundation Model Fine-Tuning with Heterogeneous LoRA Allocation
por: Zhang, Zikai, et al.
Publicado: (2025)

Elastic Mixture of Rank-Wise Experts for Knowledge Reuse in Federated Fine-Tuning
por: Wu, Yebo, et al.
Publicado: (2025)

Memory-Efficient Split Federated Learning for LLM Fine-Tuning on Heterogeneous Mobile Devices
por: Chen, Xiaopei, et al.
Publicado: (2025)

LoRAFusion: Efficient LoRA Fine-Tuning for LLMs
por: Zhu, Zhanda, et al.
Publicado: (2025)

RBLA: Rank-Based-LoRA-Aggregation for Fine-tuning Heterogeneous Models in FLaaS
por: Chen, Shuaijun, et al.
Publicado: (2024)

CaraServe: CPU-Assisted and Rank-Aware LoRA Serving for Generative LLM Inference
por: Li, Suyi, et al.
Publicado: (2024)

InfiniLoRA: Disaggregated Multi-LoRA Serving for Large Language Models
por: Chen, Hongyu, et al.
Publicado: (2026)

Federated LoRA with Sparse Communication
por: Kuo, Kevin, et al.
Publicado: (2024)

ADF-LoRA: Alternating Low-Rank Aggregation for Decentralized Federated Fine-Tuning
por: Wang, Xiaoyu, et al.
Publicado: (2025)

Fed-SB: A Silver Bullet for Extreme Communication Efficiency and Performance in (Private) Federated LoRA Fine-Tuning
por: Singhal, Raghav, et al.
Publicado: (2025)

AutoRank: MCDA Based Rank Personalization for LoRA-Enabled Distributed Learning
por: Chen, Shuaijun, et al.
Publicado: (2024)

Flexible Personalized Split Federated Learning for On-Device Fine-Tuning of Foundation Models
por: Yuan, Tianjun, et al.
Publicado: (2025)

One-Bit Model Aggregation for Differentially Private and Byzantine-Robust Personalized Federated Learning
por: Lan, Muhang, et al.
Publicado: (2025)

Federated Fine-Tuning of Sparsely-Activated Large Language Models on Resource-Constrained Devices
por: Chen, Fahao, et al.
Publicado: (2025)

Robust Federated Fine-Tuning in Heterogeneous Networks with Unreliable Connections: An Aggregation View
por: Wang, Yanmeng, et al.
Publicado: (2025)

HAFLQ: Heterogeneous Adaptive Federated LoRA Fine-tuned LLM with Quantization
por: Su, Yang, et al.
Publicado: (2024)

RingAda: Pipelining Large Model Fine-Tuning on Edge Devices with Scheduled Layer Unfreezing
por: Li, Liang, et al.
Publicado: (2025)

ALTO: Adaptive LoRA Tuning and Orchestration for Heterogeneous LoRA Training Workloads
por: Zuo, Jingwei, et al.
Publicado: (2026)

JORA: JAX Tensor-Parallel LoRA Library for Retrieval Augmented Fine-Tuning
por: Tahir, Anique, et al.
Publicado: (2024)

FedEx-LoRA: Exact Aggregation for Federated and Efficient Fine-Tuning of Foundation Models
por: Singhal, Raghav, et al.
Publicado: (2024)

Memory-Efficient Federated Fine-Tuning of Large Language Models via Layer Pruning
por: Wu, Yebo, et al.
Publicado: (2025)

Low-Latency Federated Fine-Tuning for Large Language Models Over Wireless Networks
por: Pang, Zhiwen, et al.
Publicado: (2026)

DySTop
por: Shi, Yizhou, et al.
Publicado: (2025)

DP$^2$-FedSAM: Enhancing Differentially Private Federated Learning Through Personalized Sharpness-Aware Minimization
por: Zhang, Zhenxiao, et al.
Publicado: (2024)

FedRPCA: Enhancing Federated LoRA Aggregation Using Robust PCA
por: Jhunjhunwala, Divyansh, et al.
Publicado: (2025)