Cover Image

Dynamic Context-oriented Decomposition for Task-aware Low-rank Adaptation with Less Forgetting and Faster Convergence

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yang, Yibo, Liu, Sihao, Rao, Chuan, An, Bang, Shen, Tiancheng, Torr, Philip H. S., Yang, Ming-Hsuan, Ghanem, Bernard
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence Computation and Language Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Purifying Task Vectors in Knowledge-Aware Subspace for Model Merging
by: An, Bang, et al.
Published: (2025)

Enhancing Online Continual Learning with Plug-and-Play State Space Model and Class-Conditional Mixture of Discretization
by: Liu, Sihao, et al.
Published: (2024)

Towards Interpretable Deep Local Learning with Successive Gradient Reconciliation
by: Yang, Yibo, et al.
Published: (2024)

Optimizing Singular Spectrum for Large Language Model Compression
by: Li, Dengjie, et al.
Published: (2025)

Forget Less, Retain More: A Lightweight Regularizer for Rehearsal-Based Continual Learning
by: Alssum, Lama, et al.
Published: (2025)

DeGMix: Efficient Multi-Task Dense Prediction with Deformable and Gating Mixer
by: Xu, Yangyang, et al.
Published: (2023)

Converge Faster, Talk Less: Hessian-Informed Federated Zeroth-Order Optimization
by: Li, Zhe, et al.
Published: (2025)

FedSmoothLoRA: Toward Smoother and Faster Convergence in Federated Low-Rank Adaptation
by: Wang, Zehao, et al.
Published: (2026)

ABS: Adaptive Bounded Staleness Converges Faster and Communicates Less
by: Tan, Qiao, et al.
Published: (2023)

CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for Task-Aware Parameter-Efficient Fine-tuning
by: Yang, Yibo, et al.
Published: (2024)

LoRA Learns Less and Forgets Less
by: Biderman, Dan, et al.
Published: (2024)

CoLA: Cross-Modal Low-rank Adaptation for Multimodal Downstream Tasks
by: Suharitdamrong, Wish, et al.
Published: (2026)

Ruling Out Low-rank Matrix Multiplication Tensor Decompositions with Symmetries via SAT
by: Yang, Jason
Published: (2024)

Continual Learning on a Diet: Learning from Sparsely Labeled Streams Under Constrained Computation
by: Zhang, Wenxuan, et al.
Published: (2024)

Expressive and Generalizable Low-rank Adaptation for Large Models via Slow Cascaded Learning
by: Li, Siwei, et al.
Published: (2024)

Rethinking Low-Rank Adaptation in Vision: Exploring Head-Level Responsiveness across Diverse Tasks
by: Zhong, Yibo, et al.
Published: (2024)

When Less is More: Achieving Faster Convergence in Distributed Edge Machine Learning
by: Basani, Advik Raj, et al.
Published: (2024)

Demystifying Language Model Forgetting with Low-rank Example Associations
by: Jin, Xisen, et al.
Published: (2024)

OmAgent: A Multi-modal Agent Framework for Complex Video Understanding with Task Divide-and-Conquer
by: Zhang, Lu, et al.
Published: (2024)

Less Data, Faster Convergence: Goal-Driven Data Optimization for Multimodal Instruction Tuning
by: Wu, Rujie, et al.
Published: (2026)

Test-Time Adaptation for Combating Missing Modalities in Egocentric Videos
by: Ramazanova, Merey, et al.
Published: (2024)

Unforgotten Safety: Preserving Safety Alignment of Large Language Models with Continual Learning
by: Alssum, Lama, et al.
Published: (2025)

MAP: Revisiting Weight Decomposition for Low-Rank Adaptation
by: Si, Chongjie, et al.
Published: (2025)

Less is More: Token Context-aware Learning for Object Tracking
by: Xu, Chenlong, et al.
Published: (2025)

ProjGuard: Safety Monitoring for Computer-Use Agents via Low-Dimensional Projections
by: Contreras, Kebin, et al.
Published: (2026)

Distribution Backtracking Builds A Faster Convergence Trajectory for Diffusion Distillation
by: Zhang, Shengyuan, et al.
Published: (2024)

Reasoning Vectors: Transferring Chain-of-Thought Capabilities via Task Arithmetic
by: Zbeeb, Mohammad, et al.
Published: (2025)

TLoRA: Task-aware Low Rank Adaptation of Large Language Models
by: Lin, Weicheng, et al.
Published: (2026)

Less is More: Resource-Efficient Low-Rank Adaptation
by: Tian, Chunlin, et al.
Published: (2025)

More is Less: Adding Polynomials for Faster Explanations in NLSAT
by: Promies, Valentin, et al.
Published: (2025)

GenView: Enhancing View Quality with Pretrained Generative Model for Self-Supervised Learning
by: Li, Xiaojie, et al.
Published: (2024)

On Pretraining Data Diversity for Self-Supervised Learning
by: Hammoud, Hasan Abed Al Kader, et al.
Published: (2024)

MatchDiffusion: Training-free Generation of Match-cuts
by: Pardo, Alejandro, et al.
Published: (2024)

SynthCLIP: Are We Ready for a Fully Synthetic CLIP Training?
by: Hammoud, Hasan Abed Al Kader, et al.
Published: (2024)

GoTTA be Diverse: Rethinking Memory Policies for Test-Time Adaptation
by: Alhuwaider, Shyma, et al.
Published: (2026)

Low-Rank Interconnected Adaptation across Layers
by: Zhong, Yibo, et al.
Published: (2024)

Chain of Draft: Thinking Faster by Writing Less
by: Xu, Silei, et al.
Published: (2025)

Less is More: Empowering GUI Agent with Context-Aware Simplification
by: Chen, Gongwei, et al.
Published: (2025)

Mamba-FSCIL: Dynamic Adaptation with Selective State Space Model for Few-Shot Class-Incremental Learning
by: Li, Xiaojie, et al.
Published: (2024)

LQ-LoRA: Low-rank Plus Quantized Matrix Decomposition for Efficient Language Model Finetuning
by: Guo, Han, et al.
Published: (2023)