Image de couverture de livre

LoRMA: Low-Rank Multiplicative Adaptation for LLMs

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Bihany, Harsh, Patel, Shubham, Modi, Ashutosh
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language Artificial Intelligence Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

IITK at SemEval-2024 Task 10: Who is the speaker? Improving Emotion Recognition and Flip Reasoning in Conversations via Speaker Embeddings
par: Patel, Shubham, et autres
Publié: (2024)

IITK at SemEval-2024 Task 2: Exploring the Capabilities of LLMs for Safe Biomedical Natural Language Inference for Clinical Trials
par: Mandal, Shreyasi, et autres
Publié: (2024)

Calibration Across Layers: Understanding Calibration Evolution in LLMs
par: Joshi, Abhinav, et autres
Publié: (2025)

LoTR: Low Tensor Rank Weight Adaptation
par: Bershatsky, Daniel, et autres
Publié: (2024)

LoRA+: Efficient Low Rank Adaptation of Large Models
par: Hayou, Soufiane, et autres
Publié: (2024)

Towards Robust Evaluation of Unlearning in LLMs via Data Transformations
par: Joshi, Abhinav, et autres
Publié: (2024)

Calibration vs Decision Making: Revisiting the Reliability Paradox in Unlearned Language Models
par: Shukla, Divyaksh, et autres
Publié: (2026)

MTL-LoRA: Low-Rank Adaptation for Multi-Task Learning
par: Yang, Yaming, et autres
Publié: (2024)

AdaPreLoRA: Adafactor Preconditioned Low-Rank Adaptation
par: Liu, Ziyun, et autres
Publié: (2026)

SwitchLoRA: Switched Low-Rank Adaptation Can Learn Full-Rank Information
par: Zhou, Kaiye, et autres
Publié: (2024)

LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters
par: Bałazy, Klaudia, et autres
Publié: (2024)

AutoLoRA: Automatically Tuning Matrix Ranks in Low-Rank Adaptation Based on Meta Learning
par: Zhang, Ruiyi, et autres
Publié: (2024)

LoRe: Personalizing LLMs via Low-Rank Reward Modeling
par: Bose, Avinandan, et autres
Publié: (2025)

LoRI: Reducing Cross-Task Interference in Multi-Task Low-Rank Adaptation
par: Zhang, Juzheng, et autres
Publié: (2025)

Beyond Components: Singular Vector-Based Interpretability of Transformer Circuits
par: Ahmad, Areeb, et autres
Publié: (2025)

Geometry of Decision Making in Language Models
par: Joshi, Abhinav, et autres
Publié: (2025)

IITK at SemEval-2024 Task 4: Hierarchical Embeddings for Detection of Persuasion Techniques in Memes
par: Chikoti, Shreenaga, et autres
Publié: (2024)

COLD: Causal reasOning in cLosed Daily activities
par: Joshi, Abhinav, et autres
Publié: (2024)

GaLore$+$: Boosting Low-Rank Adaptation for LLMs with Cross-Head Projection
par: Liao, Xutao, et autres
Publié: (2024)

RST-LoRA: A Discourse-Aware Low-Rank Adaptation for Long Document Abstractive Summarization
par: Liu, Dongqi, et autres
Publié: (2024)

LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models
par: Yang, Yifan, et autres
Publié: (2024)

The Expressive Power of Low-Rank Adaptation
par: Zeng, Yuchen, et autres
Publié: (2023)

Recover-LoRA: Data-Free Accuracy Recovery of Degraded Language Models via Low-Rank Adaptation
par: Das, Devleena, et autres
Publié: (2025)

MoR: Mixture of Ranks for Low-Rank Adaptation Tuning
par: Tang, Chuanyu, et autres
Publié: (2024)

Generation and De-Identification of Indian Clinical Discharge Summaries using LLMs
par: Singh, Sanjeet, et autres
Publié: (2024)

Batched Low-Rank Adaptation of Foundation Models
par: Wen, Yeming, et autres
Publié: (2023)

Variational Low-Rank Adaptation Using IVON
par: Cong, Bai, et autres
Publié: (2024)

Towards Quantifying Commonsense Reasoning with Mechanistic Insights
par: Joshi, Abhinav, et autres
Publié: (2025)

IITK at SemEval-2024 Task 1: Contrastive Learning and Autoencoders for Semantic Textual Relatedness in Multilingual Texts
par: Basak, Udvas, et autres
Publié: (2024)

LoRA-Pro: Are Low-Rank Adapters Properly Optimized?
par: Wang, Zhengbo, et autres
Publié: (2024)

LoLCATs: On Low-Rank Linearizing of Large Language Models
par: Zhang, Michael, et autres
Publié: (2024)

Low-Rank Adaptation for Multilingual Summarization: An Empirical Study
par: Whitehouse, Chenxi, et autres
Publié: (2023)

Multilingual Prompt Engineering in Large Language Models: A Survey Across NLP Tasks
par: Vatsal, Shubham, et autres
Publié: (2025)

Low-Rank Quantization-Aware Training for LLMs
par: Bondarenko, Yelysei, et autres
Publié: (2024)

GoRA: Gradient-driven Adaptive Low Rank Adaptation
par: He, Haonan, et autres
Publié: (2025)

Not How Many, But Which: Parameter Placement in Low-Rank Adaptation
par: Sehanobish, Arijit, et autres
Publié: (2026)

SBoRA: Low-Rank Adaptation with Regional Weight Updates
par: Po, Lai-Man, et autres
Publié: (2024)

LoRC: Low-Rank Compression for LLMs KV Cache with a Progressive Compression Strategy
par: Zhang, Rongzhi, et autres
Publié: (2024)

Multiple Choice Learning of Low-Rank Adapters for Language Modeling
par: Letzelter, Victor, et autres
Publié: (2025)

ElaLoRA: Elastic & Learnable Low-Rank Adaptation for Efficient Model Fine-Tuning
par: Chang, Huandong, et autres
Publié: (2025)