Cover Image

Low-Rank Adaptation for Foundation Models: A Comprehensive Review

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yang, Menglin, Chen, Jialin, Tao, Jinkai, Zhang, Yifei, Liu, Jiahong, Zhang, Jiasheng, Ma, Qiyao, Verma, Harshit, Zhang, Regina, Zhou, Min, King, Irwin, Ying, Rex
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence I.2
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Hypformer: Exploring Efficient Transformer Fully in Hyperbolic Space
by: Yang, Menglin, et al.
Published: (2024)

Understanding and Mitigating Hyperbolic Dimensional Collapse in Graph Contrastive Learning
by: Zhang, Yifei, et al.
Published: (2023)

Towards Non-Euclidean Foundation Models: Advancing AI Beyond Euclidean Frameworks
by: Yang, Menglin, et al.
Published: (2025)

SECURA: Sigmoid-Enhanced CUR Decomposition with Uninterrupted Retention and Low-Rank Adaptation in Large Language Models
by: Zhang, Yuxuan
Published: (2025)

DTGB: A Comprehensive Benchmark for Dynamic Text-Attributed Graphs
by: Zhang, Jiasheng, et al.
Published: (2024)

Position: Beyond Euclidean -- Foundation Models Should Embrace Non-Euclidean Geometries
by: He, Neil, et al.
Published: (2025)

Counterfactual Evaluation of Ads Ranking Models through Domain Adaptation
by: Radwan, Mohamed A., et al.
Published: (2024)

TensLoRA: Tensor Alternatives for Low-Rank Adaptation
by: Marmoret, Axel, et al.
Published: (2025)

Subspace Geometry Governs Catastrophic Forgetting in Low-Rank Adaptation
by: Steele, Brady
Published: (2026)

LoRS: Efficient Low-Rank Adaptation for Sparse Large Language Model
by: Hu, Yuxuan, et al.
Published: (2025)

CLIP-Powered Domain Generalization and Domain Adaptation: A Comprehensive Survey
by: Li, Jindong, et al.
Published: (2025)

Quantization-Robust LLM Unlearning via Low-Rank Adaptation
by: Abitante, João Vitor Boer, et al.
Published: (2026)

Implicit Reasoning in Large Language Models: A Comprehensive Survey
by: Li, Jindong, et al.
Published: (2025)

HyperCore: The Core Framework for Building Hyperbolic Foundation Models with Comprehensive Modules
by: He, Neil, et al.
Published: (2025)

Beyond Benchmark Islands: Toward Representative Trustworthiness Evaluation for Agentic AI
by: Qi, Jinhu, et al.
Published: (2026)

A Survey on Vision-Language-Action Models for Embodied AI
by: Ma, Yueen, et al.
Published: (2024)

TRACE: Trajectory-Aware Comprehensive Evaluation for Deep Research Agents
by: Chen, Yanyu, et al.
Published: (2026)

Communication-Efficient and Accurate Approach for Aggregation in Federated Low-Rank Adaptation
by: Nguyen, Le-Tuan, et al.
Published: (2025)

JotlasNet: Joint Tensor Low-Rank and Attention-based Sparse Unrolling Network for Accelerating Dynamic MRI
by: Zhang, Yinghao, et al.
Published: (2025)

Hyperbolic Graph Neural Networks: A Review of Methods and Applications
by: Yang, Menglin, et al.
Published: (2022)

Fed-DLoRA: Efficient Wireless Federated Learning with Dynamic Low-Rank Adaptation
by: Li, Huaicheng, et al.
Published: (2026)

Tool-RoCo: An Agent-as-Tool Self-organization Large Language Model Benchmark in Multi-robot Cooperation
by: Zhang, Ke, et al.
Published: (2025)

Rapid Adaptation of Earth Observation Foundation Models for Segmentation
by: Selvam, Karthick Panner, et al.
Published: (2024)

LRCP: Low-Rank Compressibility Guided Visual Token Pruning for Efficient LVLMs
by: Lu, Hongyu, et al.
Published: (2026)

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews
by: Li, Bowen, et al.
Published: (2026)

Parameter-Efficient Fine-Tuning of LLMs with Mixture of Space Experts
by: Zhang, Buze, et al.
Published: (2026)

MALoRA: Mixture of Asymmetric Low-Rank Adaptation for Enhanced Multi-Task Learning
by: Wang, Xujia, et al.
Published: (2024)

SRPL-SFDA: SAM-Guided Reliable Pseudo-Labels for Source-Free Domain Adaptation in Medical Image Segmentation
by: Liu, Xinya, et al.
Published: (2025)

Optimal Transport-Guided Source-Free Adaptation for Face Anti-Spoofing
by: Li, Zhuowei, et al.
Published: (2025)

A Comprehensive Review of Fish Feeding Behavior Analysis in Aquaculture: Tasks, Techniques, and Applications
by: Zhang, Shulong, et al.
Published: (2025)

Sensitivity Uncertainty Alignment in Large Language Models
by: Hiremath, Prakul Sunil, et al.
Published: (2026)

Event-based Solutions for Human-centered Applications: A Comprehensive Review
by: Adra, Mira, et al.
Published: (2025)

Progress and Opportunities of Foundation Models in Bioinformatics
by: Li, Qing, et al.
Published: (2024)

Decoupling Vision and Language: Codebook Anchored Visual Adaptation
by: Wu, Jason, et al.
Published: (2026)

LoRC: Low-Rank Compression for LLMs KV Cache with a Progressive Compression Strategy
by: Zhang, Rongzhi, et al.
Published: (2024)

Meta-Learning at Scale for Large Language Models via Low-Rank Amortized Bayesian Meta-Learning
by: Zhang, Liyi, et al.
Published: (2025)

Online Detection of Anomalies in Temporal Knowledge Graphs with Interpretability
by: Zhang, Jiasheng, et al.
Published: (2024)

Adapting Multimodal Foundation Models for Few-Shot Learning: A Comprehensive Study on Contrastive Captioners
by: Narasinghe, N. K. B. M. P. K. B., et al.
Published: (2025)

Active Context Compression: Autonomous Memory Management in LLM Agents
by: Verma, Nikhil
Published: (2026)

D-SMART: Enhancing LLM Dialogue Consistency via Dynamic Structured Memory And Reasoning Tree
by: Lei, Xiang, et al.
Published: (2025)