LoRA Fine-Tuning Without GPUs: A CPU-Efficient Meta-Generation Framework for LLMs
Fuente:
arXiv
Guardado en:
| Autores principales: | Arabpour, Reza, Borde, Haitz Sáez de Ocáriz, Kratsios, Anastasis |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
Sharp Generalization Bounds for Foundation Models with Asymmetric Randomized Low-Rank Adapters
por: Kratsios, Anastasis, et al.
Publicado: (2025)
por: Kratsios, Anastasis, et al.
Publicado: (2025)
Neural Snowflakes: Universal Latent Graph Inference via Trainable Latent Geometries
por: Borde, Haitz Sáez de Ocáriz, et al.
Publicado: (2023)
por: Borde, Haitz Sáez de Ocáriz, et al.
Publicado: (2023)
Fine-Tuning Next-Scale Visual Autoregressive Models with Group Relative Policy Optimization
por: Gallici, Matteo, et al.
Publicado: (2025)
por: Gallici, Matteo, et al.
Publicado: (2025)
HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
por: Tian, Chunlin, et al.
Publicado: (2024)
por: Tian, Chunlin, et al.
Publicado: (2024)
DR-LoRA: Dynamic Rank LoRA for Fine-Tuning Mixture-of-Experts Models
por: Deng, Guanzhi, et al.
Publicado: (2026)
por: Deng, Guanzhi, et al.
Publicado: (2026)
Mathematical Foundations of Geometric Deep Learning
por: Borde, Haitz Sáez de Ocáriz, et al.
Publicado: (2025)
por: Borde, Haitz Sáez de Ocáriz, et al.
Publicado: (2025)
KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillation
por: Azimi, Rambod, et al.
Publicado: (2024)
por: Azimi, Rambod, et al.
Publicado: (2024)
LoRA-Squeeze: Simple and Effective Post-Tuning and In-Tuning Compression of LoRA Modules
por: Vulić, Ivan, et al.
Publicado: (2026)
por: Vulić, Ivan, et al.
Publicado: (2026)
The Stepwise Informativeness Assumption: Why are Entropy Dynamics and Reasoning Correlated in LLMs?
por: Català, Mar Gonzàlez I, et al.
Publicado: (2026)
por: Català, Mar Gonzàlez I, et al.
Publicado: (2026)
HypeLoRA: Hyper-Network-Generated LoRA Adapters for Calibrated Language Model Fine-Tuning
por: Trojan, Bartosz, et al.
Publicado: (2026)
por: Trojan, Bartosz, et al.
Publicado: (2026)
RadLite: Multi-Task LoRA Fine-Tuning of Small Language Models for CPU-Deployable Radiology AI
por: Gupta, Pankaj, et al.
Publicado: (2026)
por: Gupta, Pankaj, et al.
Publicado: (2026)
Approximation Rates and VC-Dimension Bounds for (P)ReLU MLP Mixture of Experts
por: Kratsios, Anastasis, et al.
Publicado: (2024)
por: Kratsios, Anastasis, et al.
Publicado: (2024)
Soro: A Lightweight Foundation Model and Chatbot for Tajik
por: Liashkov, Stanislav, et al.
Publicado: (2026)
por: Liashkov, Stanislav, et al.
Publicado: (2026)
MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA-based Mixture of Experts
por: Li, Dengchun, et al.
Publicado: (2024)
por: Li, Dengchun, et al.
Publicado: (2024)
In-Context Meta LoRA Generation
por: Shao, Yihua, et al.
Publicado: (2025)
por: Shao, Yihua, et al.
Publicado: (2025)
Localized LoRA: A Structured Low-Rank Approximation for Efficient Fine-Tuning
por: Barazandeh, Babak, et al.
Publicado: (2025)
por: Barazandeh, Babak, et al.
Publicado: (2025)
mLoRA: Fine-Tuning LoRA Adapters via Highly-Efficient Pipeline Parallelism in Multiple GPUs
por: Ye, Zhengmao, et al.
Publicado: (2023)
por: Ye, Zhengmao, et al.
Publicado: (2023)
LoRAFusion: Efficient LoRA Fine-Tuning for LLMs
por: Zhu, Zhanda, et al.
Publicado: (2025)
por: Zhu, Zhanda, et al.
Publicado: (2025)
Quantifying and Mitigating Selection Bias in LLMs: A Transferable LoRA Fine-Tuning and Efficient Majority Voting Approach
por: Guda, Blessed, et al.
Publicado: (2025)
por: Guda, Blessed, et al.
Publicado: (2025)
LoRA-Gen: Specializing Large Language Model via Online LoRA Generation
por: Xiao, Yicheng, et al.
Publicado: (2025)
por: Xiao, Yicheng, et al.
Publicado: (2025)
STAR: Constraint LoRA with Dynamic Active Learning for Data-Efficient Fine-Tuning of Large Language Models
por: Zhang, Linhai, et al.
Publicado: (2024)
por: Zhang, Linhai, et al.
Publicado: (2024)
k-Maximum Inner Product Attention for Graph Transformers and the Expressive Power of GraphGPS
por: De Schouwer, Jonas, et al.
Publicado: (2026)
por: De Schouwer, Jonas, et al.
Publicado: (2026)
LoRA-Leak: Membership Inference Attacks Against LoRA Fine-tuned Language Models
por: Ran, Delong, et al.
Publicado: (2025)
por: Ran, Delong, et al.
Publicado: (2025)
NaRA: Noise-Aware LoRA for Parameter-Efficient Fine-Tuning of Diffusion LLMs
por: Wang, Shuaidi, et al.
Publicado: (2026)
por: Wang, Shuaidi, et al.
Publicado: (2026)
Structured Captions Improve Prompt Adherence in Text-to-Image Models (Re-LAION-Caption 19M)
por: Merchant, Nicholas, et al.
Publicado: (2025)
por: Merchant, Nicholas, et al.
Publicado: (2025)
MiCA Learns More Knowledge Than LoRA and Full Fine-Tuning
por: Rüdiger, Sten, et al.
Publicado: (2026)
por: Rüdiger, Sten, et al.
Publicado: (2026)
Beyond LoRA vs. Full Fine-Tuning: Gradient-Guided Optimizer Routing for LLM Adaptation
por: Tang, Haozhan, et al.
Publicado: (2026)
por: Tang, Haozhan, et al.
Publicado: (2026)
Classification Fields: Arbitrarily Fine Recursive Hierarchical Clustering From Few Examples
por: Li, Yicen, et al.
Publicado: (2026)
por: Li, Yicen, et al.
Publicado: (2026)
Metric Learning for Clifford Group Equivariant Neural Networks
por: Ali, Riccardo, et al.
Publicado: (2024)
por: Ali, Riccardo, et al.
Publicado: (2024)
A Lightweight Framework for Trigger-Guided LoRA-Based Self-Adaptation in LLMs
por: Wei, Jiacheng, et al.
Publicado: (2025)
por: Wei, Jiacheng, et al.
Publicado: (2025)
Neural Spacetimes for DAG Representation Learning
por: Borde, Haitz Sáez de Ocáriz, et al.
Publicado: (2024)
por: Borde, Haitz Sáez de Ocáriz, et al.
Publicado: (2024)
Scalable Message Passing Neural Networks: No Need for Attention in Large Graph Representation Learning
por: Borde, Haitz Sáez de Ocáriz, et al.
Publicado: (2024)
por: Borde, Haitz Sáez de Ocáriz, et al.
Publicado: (2024)
Keep It Light! Simplifying Image Clustering Via Text-Free Adapters
por: Li, Yicen, et al.
Publicado: (2025)
por: Li, Yicen, et al.
Publicado: (2025)
NAS-LoRA: Empowering Parameter-Efficient Fine-Tuning for Visual Foundation Models with Searchable Adaptation
por: Chen, Renqi, et al.
Publicado: (2025)
por: Chen, Renqi, et al.
Publicado: (2025)
LoRA on the Go: Instance-level Dynamic LoRA Selection and Merging
por: Lee, Seungeon, et al.
Publicado: (2025)
por: Lee, Seungeon, et al.
Publicado: (2025)
DynMoLE: Boosting Mixture of LoRA Experts Fine-Tuning with a Hybrid Routing Mechanism
por: Li, Dengchun, et al.
Publicado: (2025)
por: Li, Dengchun, et al.
Publicado: (2025)
Enhancing Aviation Communication Transcription: Fine-Tuning Distil-Whisper with LoRA
por: Mirzaei, Shokoufeh, et al.
Publicado: (2025)
por: Mirzaei, Shokoufeh, et al.
Publicado: (2025)
Profiling LoRA/QLoRA Fine-Tuning Efficiency on Consumer GPUs: An RTX 4060 Case Study
por: Avinash, MSR
Publicado: (2025)
por: Avinash, MSR
Publicado: (2025)
ALTER: Asymmetric LoRA for Token-Entropy-Guided Unlearning of LLMs
por: Chen, Xunlei, et al.
Publicado: (2026)
por: Chen, Xunlei, et al.
Publicado: (2026)
LoRA Meets Dropout under a Unified Framework
por: Wang, Sheng, et al.
Publicado: (2024)
por: Wang, Sheng, et al.
Publicado: (2024)
Ejemplares similares
-
Sharp Generalization Bounds for Foundation Models with Asymmetric Randomized Low-Rank Adapters
por: Kratsios, Anastasis, et al.
Publicado: (2025) -
Neural Snowflakes: Universal Latent Graph Inference via Trainable Latent Geometries
por: Borde, Haitz Sáez de Ocáriz, et al.
Publicado: (2023) -
Fine-Tuning Next-Scale Visual Autoregressive Models with Group Relative Policy Optimization
por: Gallici, Matteo, et al.
Publicado: (2025) -
HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
por: Tian, Chunlin, et al.
Publicado: (2024) -
DR-LoRA: Dynamic Rank LoRA for Fine-Tuning Mixture-of-Experts Models
por: Deng, Guanzhi, et al.
Publicado: (2026)