Imagen de Portada

Dual Decomposition of Weights and Singular Value Low Rank Adaptation

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Han, Jialong, Zhang, Si, Zhang, Ke
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

OSoRA: Output-Dimension and Singular-Value Initialized Low-Rank Adaptation
por: Han, Jialong, et al.
Publicado: (2025)

EDoRA: Efficient Weight-Decomposed Low-Rank Adaptation via Singular Value Decomposition
por: Nasiri, Hamid, et al.
Publicado: (2025)

MAP: Revisiting Weight Decomposition for Low-Rank Adaptation
por: Si, Chongjie, et al.
Publicado: (2025)

SARA: Singular-Value Based Adaptive Low-Rank Adaption
por: Gu, Jihao, et al.
Publicado: (2024)

ID-LoRA: Efficient Low-Rank Adaptation Inspired by Matrix Interpolative Decomposition
por: Ma, Xindian, et al.
Publicado: (2026)

DoRA: Weight-Decomposed Low-Rank Adaptation
por: Liu, Shih-Yang, et al.
Publicado: (2024)

SBoRA: Low-Rank Adaptation with Regional Weight Updates
por: Po, Lai-Man, et al.
Publicado: (2024)

BoRA: Bi-dimensional Weight-Decomposed Low-Rank Adaptation
por: Wang, Qiushi, et al.
Publicado: (2024)

Zero-Shot Cross-Domain Dialogue State Tracking via Dual Low-Rank Adaptation
por: Luo, Xiang, et al.
Publicado: (2024)

BiDoRA: Bi-level Optimization-Based Weight-Decomposed Low-Rank Adaptation
por: Qin, Peijia, et al.
Publicado: (2024)

LoTR: Low Tensor Rank Weight Adaptation
por: Bershatsky, Daniel, et al.
Publicado: (2024)

RaSA: Rank-Sharing Low-Rank Adaptation
por: He, Zhiwei, et al.
Publicado: (2025)

Weed Out, Then Harvest: Dual Low-Rank Adaptation is an Effective Noisy Label Detector for Noise-Robust Learning
por: Yuan, Bo, et al.
Publicado: (2025)

AdaSVD: Adaptive Singular Value Decomposition for Large Language Models
por: Li, Zhiteng, et al.
Publicado: (2025)

Gaussian Stochastic Weight Averaging for Bayesian Low-Rank Adaptation of Large Language Models
por: Onal, Emre, et al.
Publicado: (2024)

Dual-Pipeline with Low-Rank Adaptation for New Language Integration in Multilingual ASR
por: Khassanov, Yerbolat, et al.
Publicado: (2024)

SVD-LLM: Truncation-aware Singular Value Decomposition for Large Language Model Compression
por: Wang, Xin, et al.
Publicado: (2024)

MoR: Mixture of Ranks for Low-Rank Adaptation Tuning
por: Tang, Chuanyu, et al.
Publicado: (2024)

SECURA: Sigmoid-Enhanced CUR Decomposition with Uninterrupted Retention and Low-Rank Adaptation in Large Language Models
por: Zhang, Yuxuan
Publicado: (2025)

ASVD: Activation-aware Singular Value Decomposition for Compressing Large Language Models
por: Yuan, Zhihang, et al.
Publicado: (2023)

SORSA: Singular Values and Orthonormal Regularized Singular Vectors Adaptation of Large Language Models
por: Cao, Yang, et al.
Publicado: (2024)

Assigning Distinct Roles to Quantized and Low-Rank Matrices Toward Optimal Weight Decomposition
por: Cho, Yoonjun, et al.
Publicado: (2025)

BeamLoRA: Beam-Constraint Low-Rank Adaptation
por: Gu, Naibin, et al.
Publicado: (2025)

SSMLoRA: Enhancing Low-Rank Adaptation with State Space Model
por: Yu, Jiayang, et al.
Publicado: (2025)

Towards Understanding the Nature of Attention with Low-Rank Sparse Decomposition
por: He, Zhengfu, et al.
Publicado: (2025)

CoLA: Collaborative Low-Rank Adaptation
por: Zhou, Yiyun, et al.
Publicado: (2025)

ASLoRA: Adaptive Sharing Low-Rank Adaptation Across Layers
por: Hu, Junyan, et al.
Publicado: (2024)

TsqLoRA: Towards Sensitivity and Quality Low-Rank Adaptation for Efficient Fine-Tuning
por: Chen, Yu, et al.
Publicado: (2025)

TLoRA: Task-aware Low Rank Adaptation of Large Language Models
por: Lin, Weicheng, et al.
Publicado: (2026)

DropLoRA: Sparse Low-Rank Adaptation for Parameter-Efficient Fine-Tuning
por: Zhang, Haojie
Publicado: (2025)

PRILoRA: Pruned and Rank-Increasing Low-Rank Adaptation
por: Benedek, Nadav, et al.
Publicado: (2024)

Astra: Activation-Space Tail-Eigenvector Low-Rank Adaptation of Large Language Models
por: Liu, Kainan, et al.
Publicado: (2026)

NeuronMLP: Efficient LLM Inference via Singular Value Decomposition Compression and Tiling on AWS Trainium
por: Song, Dinghong, et al.
Publicado: (2025)

FAAST: Forward-Only Associative Learning via Closed-Form Fast Weights for Test-Time Supervised Adaptation
por: Bao, Guangsheng, et al.
Publicado: (2026)

CLIP-SVD: Efficient and Interpretable Vision-Language Adaptation via Singular Values
por: Koleilat, Taha, et al.
Publicado: (2025)

PROPER: A Progressive Learning Framework for Personalized Large Language Models with Group-Level Adaptation
por: Zhang, Linhai, et al.
Publicado: (2025)

The Expressive Power of Low-Rank Adaptation
por: Zeng, Yuchen, et al.
Publicado: (2023)

RankLLM: Weighted Ranking of LLMs by Quantifying Question Difficulty
por: Zhang, Ziqian, et al.
Publicado: (2026)

DenseLoRA: Dense Low-Rank Adaptation of Large Language Models
por: Mu, Lin, et al.
Publicado: (2025)

MiLoRA: Efficient Mixture of Low-Rank Adaptation for Large Language Models Fine-tuning
por: Zhang, Jingfan, et al.
Publicado: (2024)