Image de couverture de livre

Orthogonal Low-rank Adaptation in Lie Groups for Continual Learning of Large Language Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Cao, Kefan, Wu, Shuaicheng
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Gated Integration of Low-Rank Adaptation for Continual Learning of Large Language Models
par: Liang, Yan-Shuo, et autres
Publié: (2025)

TableLoRA: Low-rank Adaptation on Table Structure Understanding for Large Language Models
par: He, Xinyi, et autres
Publié: (2025)

Expressive and Generalizable Low-rank Adaptation for Large Models via Slow Cascaded Learning
par: Li, Siwei, et autres
Publié: (2024)

PROPER: A Progressive Learning Framework for Personalized Large Language Models with Group-Level Adaptation
par: Zhang, Linhai, et autres
Publié: (2025)

Towards Large Language Models that Benefit for All: Benchmarking Group Fairness in Reward Models
par: Song, Kefan, et autres
Publié: (2025)

UORA: Uniform Orthogonal Reinitialization Adaptation in Parameter-Efficient Fine-Tuning of Large Models
par: Zhang, Xueyan, et autres
Publié: (2025)

NLoRA: Nyström-Initiated Low-Rank Adaptation for Large Language Models
par: Guo, Chenlu, et autres
Publié: (2025)

Controlled Low-Rank Adaptation with Subspace Regularization for Continued Training on Large Language Models
par: Lu, Yuheng, et autres
Publié: (2024)

Low-rank Adaptation of Large Language Model Rescoring for Parameter-Efficient Speech Recognition
par: Yu, Yu, et autres
Publié: (2023)

The Pragmatic Mind of Machines: Tracing the Emergence of Pragmatic Competence in Large Language Models
par: Yu, Kefan, et autres
Publié: (2025)

OLoRA: Orthonormal Low-Rank Adaptation of Large Language Models
par: Büyükakyüz, Kerim
Publié: (2024)

Derivative-Free Optimization for Low-Rank Adaptation in Large Language Models
par: Jin, Feihu, et autres
Publié: (2024)

A Group Fairness Lens for Large Language Models
par: Bi, Guanqun, et autres
Publié: (2023)

DenseLoRA: Dense Low-Rank Adaptation of Large Language Models
par: Mu, Lin, et autres
Publié: (2025)

O-Edit: Orthogonal Subspace Editing for Language Model Sequential Editing
par: Cai, Yuchen, et autres
Publié: (2024)

Flexora: Flexible Low Rank Adaptation for Large Language Models
par: Wei, Chenxing, et autres
Publié: (2024)

Orthogonal Hierarchical Decomposition for Structure-Aware Table Understanding with Large Language Models
par: Cao, Bin, et autres
Publié: (2026)

Emergent Abilities of Large Language Models under Continued Pretraining for Language Adaptation
par: Elhady, Ahmed, et autres
Publié: (2025)

FLAT-LLM: Fine-grained Low-rank Activation Space Transformation for Large Language Model Compression
par: Tian, Jiayi, et autres
Publié: (2025)

OMoE: Diversifying Mixture of Low-Rank Adaptation by Orthogonal Finetuning
par: Feng, Jinyuan, et autres
Publié: (2025)

Pruning Large Language Models to Intra-module Low-rank Architecture with Transitional Activations
par: Shen, Bowen, et autres
Publié: (2024)

Gaussian Stochastic Weight Averaging for Bayesian Low-Rank Adaptation of Large Language Models
par: Onal, Emre, et autres
Publié: (2024)

ALoRA: Allocating Low-Rank Adaptation for Fine-tuning Large Language Models
par: Liu, Zequan, et autres
Publié: (2024)

Astra: Activation-Space Tail-Eigenvector Low-Rank Adaptation of Large Language Models
par: Liu, Kainan, et autres
Publié: (2026)

LoRTA: Low Rank Tensor Adaptation of Large Language Models
par: Hounie, Ignacio, et autres
Publié: (2024)

Continual-learning for Modelling Low-Resource Languages from Large Language Models
par: K, Santosh Srinath, et autres
Publié: (2026)

Continual Learning for Large Language Models: A Survey
par: Wu, Tongtong, et autres
Publié: (2024)

Multi-Aspect Knowledge Distillation for Language Model with Low-rank Factorization
par: Liu, Zihe, et autres
Publié: (2026)

Can Large Language Models Keep Up? Benchmarking Online Adaptation to Continual Knowledge Streams
par: Kim, Jiyeon, et autres
Publié: (2026)

RoseLoRA: Row and Column-wise Sparse Low-rank Adaptation of Pre-trained Language Model for Knowledge Editing and Fine-tuning
par: Wang, Haoyu, et autres
Publié: (2024)

BA-LoRA: Bias-Alleviating Low-Rank Adaptation to Mitigate Catastrophic Inheritance in Large Language Models
par: Chang, Yupeng, et autres
Publié: (2024)

SCALE: Upscaled Continual Learning of Large Language Models
par: Lee, Jin-woo, et autres
Publié: (2025)

A Paradigm Shift: The Future of Machine Translation Lies with Large Language Models
par: Lyu, Chenyang, et autres
Publié: (2023)

TLoRA: Task-aware Low Rank Adaptation of Large Language Models
par: Lin, Weicheng, et autres
Publié: (2026)

Boosting Large Language Models with Continual Learning for Aspect-based Sentiment Analysis
par: Ding, Xuanwen, et autres
Publié: (2024)

SORSA: Singular Values and Orthonormal Regularized Singular Vectors Adaptation of Large Language Models
par: Cao, Yang, et autres
Publié: (2024)

Dynamic Skill Adaptation for Large Language Models
par: Chen, Jiaao, et autres
Publié: (2024)

MiLoRA: Efficient Mixture of Low-Rank Adaptation for Large Language Models Fine-tuning
par: Zhang, Jingfan, et autres
Publié: (2024)

Demystifying Language Model Forgetting with Low-rank Example Associations
par: Jin, Xisen, et autres
Publié: (2024)

LoRS: Efficient Low-Rank Adaptation for Sparse Large Language Model
par: Hu, Yuxuan, et autres
Publié: (2025)