Cover Image

DoRAN: Stabilizing Weight-Decomposed Low-Rank Adaptation via Noise Injection and Auxiliary Networks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Diep, Nghiem T., Dang, Hien, Truong, Tuan, Dinh, Tan, Nguyen, Huy, Ho, Nhat
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Hypernetwork-Driven Low-Rank Adaptation Across Attention Heads
by: Diep, Nghiem T., et al.
Published: (2025)

RepLoRA: Reparameterizing Low-Rank Adaptation via the Perspective of Mixture of Experts
by: Truong, Tuan, et al.
Published: (2025)

DoRA: Weight-Decomposed Low-Rank Adaptation
by: Liu, Shih-Yang, et al.
Published: (2024)

Link prediction Graph Neural Networks for structure recognition of Handwritten Mathematical Expressions
by: Nguyen, Cuong Tuan, et al.
Published: (2025)

Neural Collapse for Cross-entropy Class-Imbalanced Learning with Unconstrained ReLU Feature Model
by: Dang, Hien, et al.
Published: (2024)

Beyond Vanilla Variational Autoencoders: Detecting Posterior Collapse in Conditional and Hierarchical Variational Autoencoders
by: Dang, Hien, et al.
Published: (2023)

Synthesis of 1 H ‐pyrazole frameworks from chalcones using p ‐toluenesulfonic acid as an efficient catalyst
by: Nhat Minh Nguyen, et al.
Published: (2025)

On Zero-Initialized Attention: Optimal Prompt and Gating Factor Estimation
by: Diep, Nghiem T., et al.
Published: (2025)

BiDoRA: Bi-level Optimization-Based Weight-Decomposed Low-Rank Adaptation
by: Qin, Peijia, et al.
Published: (2024)

A Statistical Theory of Gated Attention through the Lens of Hierarchical Mixture of Experts
by: Nguyen, Viet, et al.
Published: (2026)

BoRA: Bi-dimensional Weight-Decomposed Low-Rank Adaptation
by: Wang, Qiushi, et al.
Published: (2024)

Fourier-Attentive Representation Learning: A Fourier-Guided Framework for Few-Shot Generalization in Vision-Language Models
by: Pham, Hieu Dinh Trung, et al.
Published: (2025)

Structure- and Stability-Preserving Learning of Port-Hamiltonian Systems
by: Nguyen, Binh, et al.
Published: (2026)

Quantum Algorithms for Computing Maximal Quantum $f$-divergence and Kubo-Ando means
by: Dinh, Trung Hoa, et al.
Published: (2025)

PepDoRA: A Unified Peptide Language Model via Weight-Decomposed Low-Rank Adaptation
by: Wang, Leyao, et al.
Published: (2024)

On Parameter Estimation in Deviated Gaussian Mixture of Experts
by: Nguyen, Huy, et al.
Published: (2024)

EDoRA: Efficient Weight-Decomposed Low-Rank Adaptation via Singular Value Decomposition
by: Nasiri, Hamid, et al.
Published: (2025)

HOLa: Zero-Shot HOI Detection with Low-Rank Decomposed VLM Feature Adaptation
by: Lei, Qinqian, et al.
Published: (2025)

(Nearly) Optimal Time-dependent Hamiltonian Simulation
by: Nghiem, Nhat A.
Published: (2024)

Alternative Method for Estimating Betti Numbers
by: Nghiem, Nhat A.
Published: (2024)

Quantum Algorithm for Computing Distances Between Subspaces
by: Nghiem, Nhat A.
Published: (2023)

New aspects of quantum topological data analysis: Betti number estimation, and testing and tracking of homology and cohomology classes
by: Nghiem, Nhat A.
Published: (2025)

Quantum Algorithms Without Coherent Quantum Access
by: Nghiem, Nhat A.
Published: (2025)

A Framework For Estimating Amplitudes of Quantum State With Single-Qubit Measurement
by: Nghiem, Nhat A.
Published: (2024)

Quantum Speedup in Dissecting Roots and Solving Nonlinear Algebraic Equations
by: Nghiem, Nhat A.
Published: (2025)

Toward speedup without quantum coherent access
by: Nghiem, Nhat A.
Published: (2026)

Refined Quantum Algorithms for Principal Component Analysis and Solving Linear System
by: Nghiem, Nhat A.
Published: (2025)

Towards quantum topological data analysis: torsion detection
by: Nghiem, Nhat A.
Published: (2025)

Quantum Advantage in Testing (Local) Convexity and Monotonicity of Function
by: Nghiem, Nhat A.
Published: (2025)

Simulating Time-dependent Hamiltonian Based On High Order Runge-Kutta and Forward Euler Method
by: Nghiem, Nhat A.
Published: (2024)

Improved Time-independent Hamiltonian Simulation
by: Nghiem, Nhat A.
Published: (2024)

Simple Quantum Gradient Descent Without Coherent Oracle Access
by: Nghiem, Nhat A.
Published: (2024)

Quantum topological data analysis algorithm for dynamical systems
by: Nghiem, Nhat A.
Published: (2025)

New Quantum Algorithm For Solving Linear System of Equations
by: Nghiem, Nhat A.
Published: (2025)

New Quantum Algorithm for Principal Component Analysis
by: Nghiem, Nhat A.
Published: (2025)

Joint Service Placement and Resource Optimization in Hierarchical Edge-Cloud Networks
by: Son, Vo Phi, et al.
Published: (2026)

On Least Square Estimation in Softmax Gating Mixture of Experts
by: Nguyen, Huy, et al.
Published: (2024)

Convergence Rates for Softmax Gating Mixture of Experts
by: Nguyen, Huy, et al.
Published: (2025)

Is Temperature Sample Efficient for Softmax Gaussian Mixture of Experts?
by: Nguyen, Huy, et al.
Published: (2024)

Sigmoid Gating is More Sample Efficient than Softmax Gating in Mixture of Experts
by: Nguyen, Huy, et al.
Published: (2024)