Image de couverture de livre

ROSA: Random Subspace Adaptation for Efficient Fine-Tuning

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Hameed, Marawan Gamal Abdel, Milios, Aristides, Reddy, Siva, Rabusseau, Guillaume
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning Artificial Intelligence Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Efficient Probabilistic Tensor Networks
par: Hameed, Marawan Gamal Abdel, et autres
Publié: (2025)

A Tensor Decomposition Perspective on Second-order RNNs
par: Lizaire, Maude, et autres
Publié: (2024)

Safety Subspaces are Not Linearly Distinct: A Fine-Tuning Case Study
par: Ponkshe, Kaustubh, et autres
Publié: (2025)

RoSA: Accurate Parameter-Efficient Fine-Tuning via Robust Adaptation
par: Nikdan, Mahdi, et autres
Publié: (2024)

Parameter-Efficient Routed Fine-Tuning: Mixture-of-Experts Demands Mixture of Adaptation Modules
par: Liu, Yilun, et autres
Publié: (2025)

AFLoRA: Adaptive Freezing of Low Rank Adaptation in Parameter Efficient Fine-Tuning of Large Models
par: Liu, Zeyu, et autres
Publié: (2024)

Are self-explanations from Large Language Models faithful?
par: Madsen, Andreas, et autres
Publié: (2024)

Parameter-Efficient Fine-Tuning for Foundation Models
par: Zhang, Dan, et autres
Publié: (2025)

Reasoning Towards Fairness: Mitigating Bias in Language Models through Reasoning-Guided Fine-Tuning
par: Kabra, Sanchit, et autres
Publié: (2025)

Parameter-Efficient Fine-Tuning with Discrete Fourier Transform
par: Gao, Ziqi, et autres
Publié: (2024)

SVFT: Parameter-Efficient Fine-Tuning with Singular Vectors
par: Lingam, Vijay, et autres
Publié: (2024)

Model Merging via Data-Free Covariance Estimation
par: Hameed, Marawan Gamal Abdel, et autres
Publié: (2026)

Parameter Efficient Fine-tuning via Explained Variance Adaptation
par: Paischer, Fabian, et autres
Publié: (2024)

Crafting Efficient Fine-Tuning Strategies for Large Language Models
par: Oliver, Michael, et autres
Publié: (2024)

ABBA-Adapters: Efficient and Expressive Fine-Tuning of Foundation Models
par: Singhal, Raghav, et autres
Publié: (2025)

LaMDA: Large Model Fine-Tuning via Spectrally Decomposed Low-Dimensional Adaptation
par: Azizi, Seyedarmin, et autres
Publié: (2024)

CERSA: Cumulative Energy-Retaining Subspace Adaptation for Memory-Efficient Fine-Tuning
par: Ge, Jingze, et autres
Publié: (2026)

Assessing the Macro and Micro Effects of Random Seeds on Fine-Tuning Large Language Models
par: Bui, Nghia, et autres
Publié: (2025)

Fine-Tuning and Evaluating Conversational AI for Agricultural Advisory
par: Singh, Sanyam, et autres
Publié: (2026)

SPARC: Subspace-Aware Prompt Adaptation for Robust Continual Learning in LLMs
par: Jayasuriya, Dinithi, et autres
Publié: (2025)

Parameter Efficient Fine Tuning: A Comprehensive Analysis Across Applications
par: Balne, Charith Chandra Sai, et autres
Publié: (2024)

Parameter-Efficient Fine-Tuning in Large Models: A Survey of Methodologies
par: Wang, Luping, et autres
Publié: (2024)

Parameter Efficient Quasi-Orthogonal Fine-Tuning via Givens Rotation
par: Ma, Xinyu, et autres
Publié: (2024)

Hallucination Detection in LLMs: Fast and Memory-Efficient Fine-Tuned Models
par: Arteaga, Gabriel Y., et autres
Publié: (2024)

Solo Connection: A Parameter Efficient Fine-Tuning Technique for Transformers
par: Pathak, Harsh Nilesh, et autres
Publié: (2025)

Efficient Differentially Private Fine-Tuning of LLMs via Reinforcement Learning
par: Khadangi, Afshin, et autres
Publié: (2025)

AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning
par: Zhou, Han, et autres
Publié: (2023)

Interpretable Safety Alignment via SAE-Constructed Low-Rank Subspace Adaptation
par: Wang, Dianyun, et autres
Publié: (2025)

Random Masking Finds Winning Tickets for Parameter Efficient Fine-tuning
par: Xu, Jing, et autres
Publié: (2024)

NeuroAda: Activating Each Neuron's Potential for Parameter-Efficient Fine-Tuning
par: Zhang, Zhi, et autres
Publié: (2025)

BEFT: Bias-Efficient Fine-Tuning of Language Models in Low-Data Regimes
par: Huang, Baichuan, et autres
Publié: (2025)

ElaLoRA: Elastic & Learnable Low-Rank Adaptation for Efficient Model Fine-Tuning
par: Chang, Huandong, et autres
Publié: (2025)

Proximal Supervised Fine-Tuning
par: Zhu, Wenhong, et autres
Publié: (2025)

CoRA: Optimizing Low-Rank Adaptation with Common Subspace of Large Language Models
par: Xiao, Xiaojun, et autres
Publié: (2024)

Memory-Efficient LLM Training with Online Subspace Descent
par: Liang, Kaizhao, et autres
Publié: (2024)

Deconfounded Causality-aware Parameter-Efficient Fine-Tuning for Problem-Solving Improvement of LLMs
par: Wang, Ruoyu, et autres
Publié: (2024)

Position-Aware Parameter Efficient Fine-Tuning Approach for Reducing Positional Bias in LLMs
par: Zhang, Zheng, et autres
Publié: (2024)

EMORL: Ensemble Multi-Objective Reinforcement Learning for Efficient and Flexible LLM Fine-Tuning
par: Kong, Lingxiao, et autres
Publié: (2025)

An Efficient Sparse Fine-Tuning with Low Quantization Error via Neural Network Pruning
par: Li, Cen-Jhih, et autres
Publié: (2025)

Long Exposure: Accelerating Parameter-Efficient Fine-Tuning for LLMs under Shadowy Sparsity
par: Wang, Tuowei, et autres
Publié: (2025)