CopRA: A Progressive LoRA Training Strategy
Fuente:
arXiv
Guardado en:
| Autores principales: | Zhuang, Zhan, Wang, Xiequn, Zhang, Yulong, Li, Wei, Zhang, Yu, Wei, Ying |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
LoRA-Mixer: Coordinate Modular LoRA Experts Through Serial Attention Routing
por: Li, Wenbing, et al.
Publicado: (2025)
por: Li, Wenbing, et al.
Publicado: (2025)
ALTO: Adaptive LoRA Tuning and Orchestration for Heterogeneous LoRA Training Workloads
por: Zuo, Jingwei, et al.
Publicado: (2026)
por: Zuo, Jingwei, et al.
Publicado: (2026)
PLoRA: Efficient LoRA Hyperparameter Tuning for Large Models
por: Yan, Minghao, et al.
Publicado: (2025)
por: Yan, Minghao, et al.
Publicado: (2025)
SCALE-LoRA: Auditing Post-Retrieval LoRA Composition with Residual Merging and View Reliability
por: Zhou, Shuaipeng, et al.
Publicado: (2026)
por: Zhou, Shuaipeng, et al.
Publicado: (2026)
S-LoRA: Serving Thousands of Concurrent LoRA Adapters
por: Sheng, Ying, et al.
Publicado: (2023)
por: Sheng, Ying, et al.
Publicado: (2023)
Mixture of LoRA Experts
por: Wu, Xun, et al.
Publicado: (2024)
por: Wu, Xun, et al.
Publicado: (2024)
Run LoRA Run: Faster and Lighter LoRA Implementations
por: Cherniuk, Daria, et al.
Publicado: (2023)
por: Cherniuk, Daria, et al.
Publicado: (2023)
LoRA-FAIR: Federated LoRA Fine-Tuning with Aggregation and Initialization Refinement
por: Bian, Jieming, et al.
Publicado: (2024)
por: Bian, Jieming, et al.
Publicado: (2024)
HiLoRA: Adaptive Hierarchical LoRA Routing for Training-Free Domain Generalization
por: Han, Ziyi, et al.
Publicado: (2025)
por: Han, Ziyi, et al.
Publicado: (2025)
Come Together, But Not Right Now: A Progressive Strategy to Boost Low-Rank Adaptation
por: Zhuang, Zhan, et al.
Publicado: (2025)
por: Zhuang, Zhan, et al.
Publicado: (2025)
tLoRA: Efficient Multi-LoRA Training with Elastic Shared Super-Models
por: Li, Kevin, et al.
Publicado: (2026)
por: Li, Kevin, et al.
Publicado: (2026)
Block-Diagonal LoRA for Eliminating Communication Overhead in Tensor Parallel LoRA Serving
por: Wang, Xinyu, et al.
Publicado: (2025)
por: Wang, Xinyu, et al.
Publicado: (2025)
Cross-LoRA: A Data-Free LoRA Transfer Framework across Heterogeneous LLMs
por: Xia, Feifan, et al.
Publicado: (2025)
por: Xia, Feifan, et al.
Publicado: (2025)
LoRA Diffusion: Zero-Shot LoRA Synthesis for Diffusion Model Personalization
por: Smith, Ethan, et al.
Publicado: (2024)
por: Smith, Ethan, et al.
Publicado: (2024)
CE-LoRA: Computation-Efficient LoRA Fine-Tuning for Language Models
por: Chen, Guanduo, et al.
Publicado: (2025)
por: Chen, Guanduo, et al.
Publicado: (2025)
LoRA-drop: Efficient LoRA Parameter Pruning based on Output Evaluation
por: Zhou, Hongyun, et al.
Publicado: (2024)
por: Zhou, Hongyun, et al.
Publicado: (2024)
A Note on LoRA
por: Fomenko, Vlad, et al.
Publicado: (2024)
por: Fomenko, Vlad, et al.
Publicado: (2024)
HyperAdaLoRA: Accelerating LoRA Rank Allocation During Training via Hypernetworks without Sacrificing Performance
por: Zhang, Hao, et al.
Publicado: (2025)
por: Zhang, Hao, et al.
Publicado: (2025)
SC-LoRA: Balancing Efficient Fine-tuning and Knowledge Preservation via Subspace-Constrained LoRA
por: Luo, Minrui, et al.
Publicado: (2025)
por: Luo, Minrui, et al.
Publicado: (2025)
LoRA Done RITE: Robust Invariant Transformation Equilibration for LoRA Optimization
por: Yen, Jui-Nan, et al.
Publicado: (2024)
por: Yen, Jui-Nan, et al.
Publicado: (2024)
Hybrid-LoRA: Bridging Full Fine-Tuning and Low-Rank Adaptation for Post-Training
por: Zhang, Chengqian, et al.
Publicado: (2026)
por: Zhang, Chengqian, et al.
Publicado: (2026)
AFA-LoRA: Enabling Non-Linear Adaptations in LoRA with Activation Function Annealing
por: Li, Jiacheng, et al.
Publicado: (2025)
por: Li, Jiacheng, et al.
Publicado: (2025)
LoRA on the Go: Instance-level Dynamic LoRA Selection and Merging
por: Lee, Seungeon, et al.
Publicado: (2025)
por: Lee, Seungeon, et al.
Publicado: (2025)
Tensorized Clustered LoRA Merging for Multi-Task Interference
por: Su, Zhan, et al.
Publicado: (2025)
por: Su, Zhan, et al.
Publicado: (2025)
DLP-LoRA: Efficient Task-Specific LoRA Fusion with a Dynamic, Lightweight Plugin for Large Language Models
por: Zhang, Yuxuan, et al.
Publicado: (2024)
por: Zhang, Yuxuan, et al.
Publicado: (2024)
Uni-LoRA: One Vector is All You Need
por: Li, Kaiyang, et al.
Publicado: (2025)
por: Li, Kaiyang, et al.
Publicado: (2025)
PRoLoRA: Partial Rotation Empowers More Parameter-Efficient LoRA
por: Wang, Sheng, et al.
Publicado: (2024)
por: Wang, Sheng, et al.
Publicado: (2024)
ServerlessLoRA: Minimizing Latency and Cost in Serverless Inference for LoRA-Based LLMs
por: Sui, Yifan, et al.
Publicado: (2025)
por: Sui, Yifan, et al.
Publicado: (2025)
Kron-LoRA: Hybrid Kronecker-LoRA Adapters for Scalable, Sustainable Fine-tuning
por: Shen, Yixin
Publicado: (2025)
por: Shen, Yixin
Publicado: (2025)
R-LoRA: Randomized Multi-Head LoRA for Efficient Multi-Task Learning
por: Liu, Jinda, et al.
Publicado: (2025)
por: Liu, Jinda, et al.
Publicado: (2025)
FedTreeLoRA: Reconciling Statistical and Functional Heterogeneity in Federated LoRA Fine-Tuning
por: Bian, Jieming, et al.
Publicado: (2026)
por: Bian, Jieming, et al.
Publicado: (2026)
pFedLoRA: Model-Heterogeneous Personalized Federated Learning with LoRA Tuning
por: Yi, Liping, et al.
Publicado: (2023)
por: Yi, Liping, et al.
Publicado: (2023)
FedLoRA-Optimizer: Federated LoRA Fine-Tuning with Global and Local Optimization in Heterogeneous Data Scenarios
por: Zhao, Jianzhe, et al.
Publicado: (2025)
por: Zhao, Jianzhe, et al.
Publicado: (2025)
FedRot-LoRA: Mitigating Rotational Misalignment in Federated LoRA
por: Zhang, Haoran, et al.
Publicado: (2026)
por: Zhang, Haoran, et al.
Publicado: (2026)
Latent Space Factorization in LoRA
por: Kumar, Shashi, et al.
Publicado: (2025)
por: Kumar, Shashi, et al.
Publicado: (2025)
LoRA-PAR: A Flexible Dual-System LoRA Partitioning Approach to Efficient LLM Fine-Tuning
por: Huang, Yining, et al.
Publicado: (2025)
por: Huang, Yining, et al.
Publicado: (2025)
Conditional LoRA Parameter Generation
por: Jin, Xiaolong, et al.
Publicado: (2024)
por: Jin, Xiaolong, et al.
Publicado: (2024)
AuroRA: Breaking Low-Rank Bottleneck of LoRA with Nonlinear Mapping
por: Dong, Haonan, et al.
Publicado: (2025)
por: Dong, Haonan, et al.
Publicado: (2025)
PLAN: Proactive Low-Rank Allocation for Continual Learning
por: Wang, Xiequn, et al.
Publicado: (2025)
por: Wang, Xiequn, et al.
Publicado: (2025)
Convergent Stochastic Training of Attention and Understanding LoRA
por: Sun, Zhengkai, et al.
Publicado: (2026)
por: Sun, Zhengkai, et al.
Publicado: (2026)
Ejemplares similares
-
LoRA-Mixer: Coordinate Modular LoRA Experts Through Serial Attention Routing
por: Li, Wenbing, et al.
Publicado: (2025) -
ALTO: Adaptive LoRA Tuning and Orchestration for Heterogeneous LoRA Training Workloads
por: Zuo, Jingwei, et al.
Publicado: (2026) -
PLoRA: Efficient LoRA Hyperparameter Tuning for Large Models
por: Yan, Minghao, et al.
Publicado: (2025) -
SCALE-LoRA: Auditing Post-Retrieval LoRA Composition with Residual Merging and View Reliability
por: Zhou, Shuaipeng, et al.
Publicado: (2026) -
S-LoRA: Serving Thousands of Concurrent LoRA Adapters
por: Sheng, Ying, et al.
Publicado: (2023)