Cover Image

AdaRank: Disagreement Based Module Rank Prediction for Low-rank Adaptation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Dong, Yihe
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

AdaRank: Adaptive Rank Pruning for Enhanced Model Merging
by: Lee, Chanhyuk, et al.
Published: (2025)

AdaPreLoRA: Adafactor Preconditioned Low-Rank Adaptation
by: Liu, Ziyun, et al.
Published: (2026)

Online Minimization of Polarization and Disagreement via Low-Rank Matrix Bandits
by: Cinus, Federico, et al.
Published: (2025)

Mitigating Forgetting in Low Rank Adaptation
by: Sliwa, Joanna, et al.
Published: (2025)

Norm-Bounded Low-Rank Adaptation
by: Wang, Ruigang, et al.
Published: (2025)

Low-Rank Adaptation of Neural Fields
by: Truong, Anh, et al.
Published: (2025)

Provable Meta-Learning with Low-Rank Adaptations
by: Block, Jacob L., et al.
Published: (2024)

Mixture-of-Subspaces in Low-Rank Adaptation
by: Wu, Taiqiang, et al.
Published: (2024)

Low Rank Adaptation for Adversarial Perturbation
by: Liu, Han, et al.
Published: (2026)

The Primacy of Magnitude in Low-Rank Adaptation
by: Zhang, Zicheng, et al.
Published: (2025)

MoR: Mixture of Ranks for Low-Rank Adaptation Tuning
by: Tang, Chuanyu, et al.
Published: (2024)

MoS: Unleashing Parameter Efficiency of Low-Rank Adaptation with Mixture of Shards
by: Wang, Sheng, et al.
Published: (2024)

AdaRankGrad: Adaptive Gradient-Rank and Moments for Memory-Efficient LLMs Training and Fine-Tuning
by: Refael, Yehonathan, et al.
Published: (2024)

Selective Aggregation for Low-Rank Adaptation in Federated Learning
by: Guo, Pengxin, et al.
Published: (2024)

Scalable Multi-Task Low-Rank Model Adaptation
by: Tian, Zichen, et al.
Published: (2026)

Towards Federated Low-Rank Adaptation of Language Models with Rank Heterogeneity
by: Byun, Yuji, et al.
Published: (2024)

The Expressive Power of Low-Rank Adaptation
by: Zeng, Yuchen, et al.
Published: (2023)

Low-Rank Adaptation Redux for Large Models
by: Li, Bingcong, et al.
Published: (2026)

ScaLoRA: Optimally Scaled Low-Rank Adaptation for Efficient High-Rank Fine-Tuning
by: Zhang, Yilang, et al.
Published: (2025)

AutoLoRA: Automatically Tuning Matrix Ranks in Low-Rank Adaptation Based on Meta Learning
by: Zhang, Ruiyi, et al.
Published: (2024)

Channel-Aware Low-Rank Adaptation in Time Series Forecasting
by: Nie, Tong, et al.
Published: (2024)

Spectral Imbalance Causes Forgetting in Low-Rank Continual Adaptation
by: Gu, Hao, et al.
Published: (2026)

Dynamic Low-Rank Sparse Adaptation for Large Language Models
by: Huang, Weizhong, et al.
Published: (2025)

Hypernetwork-Driven Low-Rank Adaptation Across Attention Heads
by: Diep, Nghiem T., et al.
Published: (2025)

Federated Low-Rank Adaptation for Foundation Models: A Survey
by: Yang, Yiyuan, et al.
Published: (2025)

Preventing Rank Collapse in Federated Low-Rank Adaptation with Client Heterogeneity
by: Wu, Fei, et al.
Published: (2026)

Polynomial Expansion Rank Adaptation: Enhancing Low-Rank Fine-Tuning with High-Order Interactions
by: Zhang, Wenhao, et al.
Published: (2026)

Beyond Higher Rank: Token-wise Input-Output Projections for Efficient Low-Rank Adaptation
by: Li, Shiwei, et al.
Published: (2025)

A Bayesian Interpretation of Adaptive Low-Rank Adaptation
by: Chen, Haolin, et al.
Published: (2024)

Strategic Over-Parameterization for Generalizable Low-Rank Adaptation
by: Gao, Jing, et al.
Published: (2026)

Few-Shot Concept Unlearning with Low Rank Adaptation
by: Shreyas, Udaya, et al.
Published: (2025)

Energy-Structured Low-Rank Adaptation for Continual Learning
by: Li, Longhua, et al.
Published: (2026)

Low Tensor-Rank Adaptation of Kolmogorov--Arnold Networks
by: Gao, Yihang, et al.
Published: (2025)

MAP: Revisiting Weight Decomposition for Low-Rank Adaptation
by: Si, Chongjie, et al.
Published: (2025)

Contextually Guided Transformers via Low-Rank Adaptation
by: Zhmoginov, Andrey, et al.
Published: (2025)

On Fairness of Low-Rank Adaptation of Large Models
by: Ding, Zhoujie, et al.
Published: (2024)

Low-Rank Approximation, Adaptation, and Other Tales
by: Lu, Jun
Published: (2024)

Variational Low-Rank Adaptation Using IVON
by: Cong, Bai, et al.
Published: (2024)

Batched Low-Rank Adaptation of Foundation Models
by: Wen, Yeming, et al.
Published: (2023)

InRank: Incremental Low-Rank Learning
by: Zhao, Jiawei, et al.
Published: (2023)