Imagen de Portada

DoRA: Weight-Decomposed Low-Rank Adaptation

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Liu, Shih-Yang, Wang, Chien-Yi, Yin, Hongxu, Molchanov, Pavlo, Wang, Yu-Chiang Frank, Cheng, Kwang-Ting, Chen, Min-Hung
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language Computer Vision and Pattern Recognition
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

EoRA: Fine-tuning-free Compensation for Compressed LLM with Eigenspace Low-Rank Approximation
por: Liu, Shih-Yang, et al.
Publicado: (2024)

BoRA: Bi-dimensional Weight-Decomposed Low-Rank Adaptation
por: Wang, Qiushi, et al.
Publicado: (2024)

DLER: Doing Length pEnalty Right - Incentivizing More Intelligence per Token via Reinforcement Learning
por: Liu, Shih-Yang, et al.
Publicado: (2025)

BiDoRA: Bi-level Optimization-Based Weight-Decomposed Low-Rank Adaptation
por: Qin, Peijia, et al.
Publicado: (2024)

DoRA: Enhancing Parameter-Efficient Fine-Tuning with Dynamic Rank Distribution
por: Mao, Yulong, et al.
Publicado: (2024)

SBoRA: Low-Rank Adaptation with Regional Weight Updates
por: Po, Lai-Man, et al.
Publicado: (2024)

GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimization
por: Liu, Shih-Yang, et al.
Publicado: (2026)

EDoRA: Efficient Weight-Decomposed Low-Rank Adaptation via Singular Value Decomposition
por: Nasiri, Hamid, et al.
Publicado: (2025)

Hallucinations and Truth: A Comprehensive Accuracy Evaluation of RAG, LoRA and DoRA
por: Baqar, Mohammad, et al.
Publicado: (2025)

Advancing Weight and Channel Sparsification with Enhanced Saliency
por: Sun, Xinglong, et al.
Publicado: (2025)

Adaptive Sharpness-Aware Pruning for Robust Sparse Networks
por: Bair, Anna, et al.
Publicado: (2023)

DoRAN: Stabilizing Weight-Decomposed Low-Rank Adaptation via Noise Injection and Auxiliary Networks
por: Diep, Nghiem T., et al.
Publicado: (2025)

RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization
por: Huang, Xijie, et al.
Publicado: (2024)

DoTA: Weight-Decomposed Tensor Adaptation for Large Language Models
por: Hu, Xiaolin, et al.
Publicado: (2024)

Step Out and Seek Around: On Warm-Start Training with Incremental Data
por: Shen, Maying, et al.
Publicado: (2024)

BeamLoRA: Beam-Constraint Low-Rank Adaptation
por: Gu, Naibin, et al.
Publicado: (2025)

LoRA-GA: Low-Rank Adaptation with Gradient Approximation
por: Wang, Shaowen, et al.
Publicado: (2024)

Scaling DoRA: High-Rank Adaptation via Factored Norms and Fused Kernels
por: Zelenin, Alexandra, et al.
Publicado: (2026)

CeRA: Overcoming the Linear Ceiling of Low-Rank Adaptation via Capacity Expansion
por: Chen, Hung-Hsuan
Publicado: (2026)

SSMLoRA: Enhancing Low-Rank Adaptation with State Space Model
por: Yu, Jiayang, et al.
Publicado: (2025)

Semantic Prompt Learning for Weakly-Supervised Semantic Segmentation
por: Lin, Ci-Siang, et al.
Publicado: (2024)

Flextron: Many-in-One Flexible Large Language Model
por: Cai, Ruisi, et al.
Publicado: (2024)

GroPrompt: Efficient Grounded Prompting and Adaptation for Referring Video Object Segmentation
por: Lin, Ci-Siang, et al.
Publicado: (2024)

DiffLoRA: Generating Personalized Low-Rank Adaptation Weights with Diffusion
por: Wu, Yujia, et al.
Publicado: (2024)

Null-LoRA: Low-Rank Adaptation on Null Space
por: Zhang, Yi, et al.
Publicado: (2025)

LITA: Language Instructed Temporal-Localization Assistant
por: Huang, De-An, et al.
Publicado: (2024)

PepDoRA: A Unified Peptide Language Model via Weight-Decomposed Low-Rank Adaptation
por: Wang, Leyao, et al.
Publicado: (2024)

NLoRA: Nyström-Initiated Low-Rank Adaptation for Large Language Models
por: Guo, Chenlu, et al.
Publicado: (2025)

FouRA: Fourier Low Rank Adaptation
por: Borse, Shubhankar, et al.
Publicado: (2024)

PRILoRA: Pruned and Rank-Increasing Low-Rank Adaptation
por: Benedek, Nadav, et al.
Publicado: (2024)

HOLa: Zero-Shot HOI Detection with Low-Rank Decomposed VLM Feature Adaptation
por: Lei, Qinqian, et al.
Publicado: (2025)

LoRA+: Efficient Low Rank Adaptation of Large Models
por: Hayou, Soufiane, et al.
Publicado: (2024)

WaRA: Wavelet Low Rank Adaptation
por: Heidari, Moein, et al.
Publicado: (2025)

TLoRA: Task-aware Low Rank Adaptation of Large Language Models
por: Lin, Weicheng, et al.
Publicado: (2026)

MoRA: Missing Modality Low-Rank Adaptation for Visual Recognition
por: Zhao, Shu, et al.
Publicado: (2025)

MaskLLM: Learnable Semi-Structured Sparsity for Large Language Models
por: Fang, Gongfan, et al.
Publicado: (2024)

SwitchLoRA: Switched Low-Rank Adaptation Can Learn Full-Rank Information
por: Zhou, Kaiye, et al.
Publicado: (2024)

TriAdaptLoRA: Brain-Inspired Triangular Adaptive Low-Rank Adaptation for Parameter-Efficient Fine-Tuning
por: Liang, Yao, et al.
Publicado: (2025)

MAP: Revisiting Weight Decomposition for Low-Rank Adaptation
por: Si, Chongjie, et al.
Publicado: (2025)

UIR-LoRA: Achieving Universal Image Restoration through Multiple Low-Rank Adaptation
por: Zhang, Cheng, et al.
Publicado: (2024)