Image de couverture de livre

LoRALib: A Standardized Benchmark for Evaluating LoRA-MoE Methods

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Wang, Shaoheng, Lu, Yao, Li, Yuqi, Gao, Yaxin, Nie, Jiaqi, Yu, Shanqing, Tian, Yingli, Xuan, Qi
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

MoE-Sieve: Routing-Guided LoRA for Efficient MoE Fine-Tuning
par: Manzoni, Andrea
Publié: (2026)

AT-MoE: Adaptive Task-planning Mixture of Experts via LoRA Approach
par: Li, Xurui, et autres
Publié: (2024)

MoRAL: MoE Augmented LoRA for LLMs' Lifelong Learning
par: Yang, Shu, et autres
Publié: (2024)

Hierarchical LoRA MoE for Efficient CTR Model Scaling
par: Zeng, Zhichen, et autres
Publié: (2025)

Octavius: Mitigating Task Interference in MLLMs via LoRA-MoE
par: Chen, Zeren, et autres
Publié: (2023)

Vision as LoRA
par: Wang, Han, et autres
Publié: (2025)

A Sensitivity-Driven Expert Allocation Method in LoRA-MoE for Efficient Fine-Tuning
par: Xu, Junzhou, et autres
Publié: (2025)

HMVLM: Human Motion-Vision-Lanuage Model via MoE LoRA
par: Hu, Lei, et autres
Publié: (2025)

Noise-Robustness Through Noise: A Framework combining Asymmetric LoRA with Poisoning MoE
par: Wang, Zhaokun, et autres
Publié: (2025)

LoRA-drop: Efficient LoRA Parameter Pruning based on Output Evaluation
par: Zhou, Hongyun, et autres
Publié: (2024)

AC-LoRA: Auto Component LoRA for Personalized Artistic Style Image Generation
par: Cui, Zhipu, et autres
Publié: (2025)

GuiLoMo: Allocating Expert Number and Rank for LoRA-MoE via Bilevel Optimization with GuidedSelection Vectors
par: Zhang, Hengyuan, et autres
Publié: (2025)

A Language-Agnostic Hierarchical LoRA-MoE Architecture for CTC-based Multilingual ASR
par: Zheng, Yuang, et autres
Publié: (2026)

TT-LoRA MoE: Unifying Parameter-Efficient Fine-Tuning and Sparse Mixture-of-Experts
par: Kunwar, Pradip, et autres
Publié: (2025)

FinLoRA: Benchmarking LoRA Methods for Fine-Tuning LLMs on Financial Datasets
par: Wang, Dannong, et autres
Publié: (2025)

S-LoRA: Serving Thousands of Concurrent LoRA Adapters
par: Sheng, Ying, et autres
Publié: (2023)

Adaptive and Fine-grained Module-wise Expert Pruning for Efficient LoRA-MoE Fine-Tuning
par: Li, Weihang, et autres
Publié: (2026)

Run LoRA Run: Faster and Lighter LoRA Implementations
par: Cherniuk, Daria, et autres
Publié: (2023)

Dual LoRA: Enhancing LoRA with Magnitude and Direction Updates
par: Xu, Yixing, et autres
Publié: (2025)

DSPC: Dual-Stage Progressive Compression Framework for Efficient Long-Context Reasoning
par: Gao, Yaxin, et autres
Publié: (2025)

LoRA as Oracle
par: Arazzi, Marco, et autres
Publié: (2026)

HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
par: Tian, Chunlin, et autres
Publié: (2024)

FedRot-LoRA: Mitigating Rotational Misalignment in Federated LoRA
par: Zhang, Haoran, et autres
Publié: (2026)

LoRA-Drop: Temporal LoRA Decoding for Efficient LLM Inference
par: Rajabzadeh, Hossein, et autres
Publié: (2026)

TAS-LoRA: Transformer Architecture Search with Mixture-of-LoRA Experts
par: Jeon, Jeimin, et autres
Publié: (2026)

LoRA on the Go: Instance-level Dynamic LoRA Selection and Merging
par: Lee, Seungeon, et autres
Publié: (2025)

LoRA in LoRA: Towards Parameter-Efficient Architecture Expansion for Continual Visual Instruction Tuning
par: Che, Chang, et autres
Publié: (2025)

LoRA-Leak: Membership Inference Attacks Against LoRA Fine-tuned Language Models
par: Ran, Delong, et autres
Publié: (2025)

Brainstacks: Cross-Domain Cognitive Capabilities via Frozen MoE-LoRA Stacks for Continual LLM Learning
par: Ayyash, Mohammad R. Abu
Publié: (2026)

Towards Specialized Generalists: A Multi-Task MoE-LoRA Framework for Domain-Specific LLM Adaptation
par: Yang, Yuxin, et autres
Publié: (2026)

ALTO: Adaptive LoRA Tuning and Orchestration for Heterogeneous LoRA Training Workloads
par: Zuo, Jingwei, et autres
Publié: (2026)

LoRA-FAIR: Federated LoRA Fine-Tuning with Aggregation and Initialization Refinement
par: Bian, Jieming, et autres
Publié: (2024)

LoRA Done RITE: Robust Invariant Transformation Equilibration for LoRA Optimization
par: Yen, Jui-Nan, et autres
Publié: (2024)

CE-LoRA: Computation-Efficient LoRA Fine-Tuning for Language Models
par: Chen, Guanduo, et autres
Publié: (2025)

LoRA Diffusion: Zero-Shot LoRA Synthesis for Diffusion Model Personalization
par: Smith, Ethan, et autres
Publié: (2024)

SHE-LoRA: Selective Homomorphic Encryption for Federated Tuning with Heterogeneous LoRA
par: Liu, Jianmin, et autres
Publié: (2025)

TC-LoRA: Temporally Modulated Conditional LoRA for Adaptive Diffusion Control
par: Cho, Minkyoung, et autres
Publié: (2025)

NP-LoRA: Null Space Projection for Subject-Style LoRA Fusion
par: Chen, Chuheng, et autres
Publié: (2025)

ID-LoRA: Identity-Driven Audio-Video Personalization with In-Context LoRA
par: Dahan, Aviad, et autres
Publié: (2026)

A Note on LoRA
par: Fomenko, Vlad, et autres
Publié: (2024)