Imagen de Portada

ROSA: Random Subspace Adaptation for Efficient Fine-Tuning

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Hameed, Marawan Gamal Abdel, Milios, Aristides, Reddy, Siva, Rabusseau, Guillaume
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Artificial Intelligence Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Efficient Probabilistic Tensor Networks
por: Hameed, Marawan Gamal Abdel, et al.
Publicado: (2025)

A Tensor Decomposition Perspective on Second-order RNNs
por: Lizaire, Maude, et al.
Publicado: (2024)

Safety Subspaces are Not Linearly Distinct: A Fine-Tuning Case Study
por: Ponkshe, Kaustubh, et al.
Publicado: (2025)

RoSA: Accurate Parameter-Efficient Fine-Tuning via Robust Adaptation
por: Nikdan, Mahdi, et al.
Publicado: (2024)

Parameter-Efficient Routed Fine-Tuning: Mixture-of-Experts Demands Mixture of Adaptation Modules
por: Liu, Yilun, et al.
Publicado: (2025)

AFLoRA: Adaptive Freezing of Low Rank Adaptation in Parameter Efficient Fine-Tuning of Large Models
por: Liu, Zeyu, et al.
Publicado: (2024)

Are self-explanations from Large Language Models faithful?
por: Madsen, Andreas, et al.
Publicado: (2024)

Parameter-Efficient Fine-Tuning for Foundation Models
por: Zhang, Dan, et al.
Publicado: (2025)

Reasoning Towards Fairness: Mitigating Bias in Language Models through Reasoning-Guided Fine-Tuning
por: Kabra, Sanchit, et al.
Publicado: (2025)

Parameter-Efficient Fine-Tuning with Discrete Fourier Transform
por: Gao, Ziqi, et al.
Publicado: (2024)

SVFT: Parameter-Efficient Fine-Tuning with Singular Vectors
por: Lingam, Vijay, et al.
Publicado: (2024)

Model Merging via Data-Free Covariance Estimation
por: Hameed, Marawan Gamal Abdel, et al.
Publicado: (2026)

Parameter Efficient Fine-tuning via Explained Variance Adaptation
por: Paischer, Fabian, et al.
Publicado: (2024)

Crafting Efficient Fine-Tuning Strategies for Large Language Models
por: Oliver, Michael, et al.
Publicado: (2024)

ABBA-Adapters: Efficient and Expressive Fine-Tuning of Foundation Models
por: Singhal, Raghav, et al.
Publicado: (2025)

LaMDA: Large Model Fine-Tuning via Spectrally Decomposed Low-Dimensional Adaptation
por: Azizi, Seyedarmin, et al.
Publicado: (2024)

CERSA: Cumulative Energy-Retaining Subspace Adaptation for Memory-Efficient Fine-Tuning
por: Ge, Jingze, et al.
Publicado: (2026)

Assessing the Macro and Micro Effects of Random Seeds on Fine-Tuning Large Language Models
por: Bui, Nghia, et al.
Publicado: (2025)

Fine-Tuning and Evaluating Conversational AI for Agricultural Advisory
por: Singh, Sanyam, et al.
Publicado: (2026)

SPARC: Subspace-Aware Prompt Adaptation for Robust Continual Learning in LLMs
por: Jayasuriya, Dinithi, et al.
Publicado: (2025)

Parameter Efficient Fine Tuning: A Comprehensive Analysis Across Applications
por: Balne, Charith Chandra Sai, et al.
Publicado: (2024)

Parameter-Efficient Fine-Tuning in Large Models: A Survey of Methodologies
por: Wang, Luping, et al.
Publicado: (2024)

Parameter Efficient Quasi-Orthogonal Fine-Tuning via Givens Rotation
por: Ma, Xinyu, et al.
Publicado: (2024)

Hallucination Detection in LLMs: Fast and Memory-Efficient Fine-Tuned Models
por: Arteaga, Gabriel Y., et al.
Publicado: (2024)

Solo Connection: A Parameter Efficient Fine-Tuning Technique for Transformers
por: Pathak, Harsh Nilesh, et al.
Publicado: (2025)

Efficient Differentially Private Fine-Tuning of LLMs via Reinforcement Learning
por: Khadangi, Afshin, et al.
Publicado: (2025)

AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning
por: Zhou, Han, et al.
Publicado: (2023)

Interpretable Safety Alignment via SAE-Constructed Low-Rank Subspace Adaptation
por: Wang, Dianyun, et al.
Publicado: (2025)

Random Masking Finds Winning Tickets for Parameter Efficient Fine-tuning
por: Xu, Jing, et al.
Publicado: (2024)

NeuroAda: Activating Each Neuron's Potential for Parameter-Efficient Fine-Tuning
por: Zhang, Zhi, et al.
Publicado: (2025)

BEFT: Bias-Efficient Fine-Tuning of Language Models in Low-Data Regimes
por: Huang, Baichuan, et al.
Publicado: (2025)

ElaLoRA: Elastic & Learnable Low-Rank Adaptation for Efficient Model Fine-Tuning
por: Chang, Huandong, et al.
Publicado: (2025)

Proximal Supervised Fine-Tuning
por: Zhu, Wenhong, et al.
Publicado: (2025)

CoRA: Optimizing Low-Rank Adaptation with Common Subspace of Large Language Models
por: Xiao, Xiaojun, et al.
Publicado: (2024)

Memory-Efficient LLM Training with Online Subspace Descent
por: Liang, Kaizhao, et al.
Publicado: (2024)

Deconfounded Causality-aware Parameter-Efficient Fine-Tuning for Problem-Solving Improvement of LLMs
por: Wang, Ruoyu, et al.
Publicado: (2024)

Position-Aware Parameter Efficient Fine-Tuning Approach for Reducing Positional Bias in LLMs
por: Zhang, Zheng, et al.
Publicado: (2024)

EMORL: Ensemble Multi-Objective Reinforcement Learning for Efficient and Flexible LLM Fine-Tuning
por: Kong, Lingxiao, et al.
Publicado: (2025)

An Efficient Sparse Fine-Tuning with Low Quantization Error via Neural Network Pruning
por: Li, Cen-Jhih, et al.
Publicado: (2025)

Long Exposure: Accelerating Parameter-Efficient Fine-Tuning for LLMs under Shadowy Sparsity
por: Wang, Tuowei, et al.
Publicado: (2025)