Imagen de Portada

Adaptive and Fine-grained Module-wise Expert Pruning for Efficient LoRA-MoE Fine-Tuning

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Li, Weihang, Liu, Jianchun, Xu, Hongli
Formato:	Preprint
Publicado:	2026
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

MoE-Sieve: Routing-Guided LoRA for Efficient MoE Fine-Tuning
por: Manzoni, Andrea
Publicado: (2026)

A Sensitivity-Driven Expert Allocation Method in LoRA-MoE for Efficient Fine-Tuning
por: Xu, Junzhou, et al.
Publicado: (2025)

TT-LoRA MoE: Unifying Parameter-Efficient Fine-Tuning and Sparse Mixture-of-Experts
por: Kunwar, Pradip, et al.
Publicado: (2025)

Adaptive LoRA Experts Allocation and Selection for Federated Fine-Tuning
por: Wang, Lei, et al.
Publicado: (2025)

FedQuad: Adaptive Layer-wise LoRA Deployment and Activation Quantization for Federated Fine-Tuning
por: Li, Rukuo, et al.
Publicado: (2025)

CE-LoRA: Computation-Efficient LoRA Fine-Tuning for Language Models
por: Chen, Guanduo, et al.
Publicado: (2025)

AT-MoE: Adaptive Task-planning Mixture of Experts via LoRA Approach
por: Li, Xurui, et al.
Publicado: (2024)

Hierarchical LoRA MoE for Efficient CTR Model Scaling
por: Zeng, Zhichen, et al.
Publicado: (2025)

LoRA-FAIR: Federated LoRA Fine-Tuning with Aggregation and Initialization Refinement
por: Bian, Jieming, et al.
Publicado: (2024)

LoRAFusion: Efficient LoRA Fine-Tuning for LLMs
por: Zhu, Zhanda, et al.
Publicado: (2025)

LoRA-PAR: A Flexible Dual-System LoRA Partitioning Approach to Efficient LLM Fine-Tuning
por: Huang, Yining, et al.
Publicado: (2025)

KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillation
por: Azimi, Rambod, et al.
Publicado: (2024)

GeLoRA: Geometric Adaptive Ranks For Efficient LoRA Fine-tuning
por: Ed-dib, Abdessalam, et al.
Publicado: (2024)

Rethinking the Rank Threshold for LoRA Fine-Tuning
por: Park, Juneyoung
Publicado: (2026)

Noise-Robustness Through Noise: A Framework combining Asymmetric LoRA with Poisoning MoE
por: Wang, Zhaokun, et al.
Publicado: (2025)

LoRA-drop: Efficient LoRA Parameter Pruning based on Output Evaluation
por: Zhou, Hongyun, et al.
Publicado: (2024)

LoRALib: A Standardized Benchmark for Evaluating LoRA-MoE Methods
por: Wang, Shaoheng, et al.
Publicado: (2025)

FedTreeLoRA: Reconciling Statistical and Functional Heterogeneity in Federated LoRA Fine-Tuning
por: Bian, Jieming, et al.
Publicado: (2026)

LUNE: Efficient LLM Unlearning via LoRA Fine-Tuning with Negative Examples
por: Liu, Yezi, et al.
Publicado: (2025)

Parameter-Efficient Fine-Tuning for HAR: Integrating LoRA and QLoRA into Transformer Models
por: Seregina, Irina, et al.
Publicado: (2025)

Bi-LoRA: Efficient Sharpness-Aware Minimization for Fine-Tuning Large-Scale Models
por: Liu, Yuhang, et al.
Publicado: (2025)

SC-LoRA: Balancing Efficient Fine-tuning and Knowledge Preservation via Subspace-Constrained LoRA
por: Luo, Minrui, et al.
Publicado: (2025)

Fed-pilot: Optimizing LoRA Allocation for Efficient Federated Fine-Tuning with Heterogeneous Clients
por: Zhang, Zikai, et al.
Publicado: (2024)

LoRA vs. Full Fine-Tuning: A Theoretical Perspective
por: Zindari, Ali, et al.
Publicado: (2026)

mLoRA: Fine-Tuning LoRA Adapters via Highly-Efficient Pipeline Parallelism in Multiple GPUs
por: Ye, Zhengmao, et al.
Publicado: (2023)

Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models
por: Zhang, Fangzhao, et al.
Publicado: (2024)

Echo-LoRA: Parameter-Efficient Fine-Tuning via Cross-Layer Representation Injection
por: Peng, Yihang, et al.
Publicado: (2026)

Beyond LoRA: Exploring Efficient Fine-Tuning Techniques for Time Series Foundational Models
por: Gupta, Divij, et al.
Publicado: (2024)

Fed-HeLLo: Efficient Federated Foundation Model Fine-Tuning with Heterogeneous LoRA Allocation
por: Zhang, Zikai, et al.
Publicado: (2025)

LowRA: Accurate and Efficient LoRA Fine-Tuning of LLMs under 2 Bits
por: Zhou, Zikai, et al.
Publicado: (2025)

Learning in the Fisher Subspace: A Guided Initialization for LoRA Fine-Tuning
por: Feng, Zhi-Quan, et al.
Publicado: (2026)

Sensitivity-LoRA: Low-Load Sensitivity-Based Fine-Tuning for Large Language Models
por: Zhang, Hao, et al.
Publicado: (2025)

FedALT: Federated Fine-Tuning through Adaptive Local Training with Rest-of-World LoRA
por: Bian, Jieming, et al.
Publicado: (2025)

Kron-LoRA: Hybrid Kronecker-LoRA Adapters for Scalable, Sustainable Fine-tuning
por: Shen, Yixin
Publicado: (2025)

Localized LoRA: A Structured Low-Rank Approximation for Efficient Fine-Tuning
por: Barazandeh, Babak, et al.
Publicado: (2025)

Stabilizing Decentralized Federated Fine-Tuning via Topology-Aware Alternating LoRA
por: Wang, Xiaoyu, et al.
Publicado: (2026)

Aletheia: Gradient-Guided Layer Selection for Efficient LoRA Fine-Tuning Across Architectures
por: Saket, Abdulmalek
Publicado: (2026)

On-the-Fly Adaptation to Quantization: Configuration-Aware LoRA for Efficient Fine-Tuning of Quantized LLMs
por: Ye, Rongguang, et al.
Publicado: (2025)

FedLoRA-Optimizer: Federated LoRA Fine-Tuning with Global and Local Optimization in Heterogeneous Data Scenarios
por: Zhao, Jianzhe, et al.
Publicado: (2025)

Efficient Federated Fine-Tuning of Large Language Models with Layer Dropout
por: Wang, Shilong, et al.
Publicado: (2025)