Imagen de Portada

CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for Task-Aware Parameter-Efficient Fine-tuning

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Yang, Yibo, Li, Xiaojie, Zhou, Zhongzhu, Song, Shuaiwen Leon, Wu, Jianlong, Nie, Liqiang, Ghanem, Bernard
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

CARE: Covariance-Aware and Rank-Enhanced Decomposition for Enabling Multi-Head Latent Attention
por: Zhou, Zhongzhu, et al.
Publicado: (2026)

Continuous Knowledge-Preserving Decomposition with Adaptive Layer Selection for Few-Shot Class-Incremental Learning
por: Li, Xiaojie, et al.
Publicado: (2025)

Imitate Optimal Policy: Prevail and Induce Action Collapse in Policy Gradient
por: Zhou, Zhongzhu, et al.
Publicado: (2025)

Dynamic Context-oriented Decomposition for Task-aware Low-rank Adaptation with Less Forgetting and Faster Convergence
por: Yang, Yibo, et al.
Publicado: (2025)

Purifying Task Vectors in Knowledge-Aware Subspace for Model Merging
por: An, Bang, et al.
Publicado: (2025)

Mamba-FSCIL: Dynamic Adaptation with Selective State Space Model for Few-Shot Class-Incremental Learning
por: Li, Xiaojie, et al.
Publicado: (2024)

GenView: Enhancing View Quality with Pretrained Generative Model for Self-Supervised Learning
por: Li, Xiaojie, et al.
Publicado: (2024)

OSCAR: Offline Spectral Covariance-Aware Rotation for 2-bit KV Cache Quantization
por: Zhou, Zhongzhu, et al.
Publicado: (2026)

Parameter Efficient Fine-tuning via Explained Variance Adaptation
por: Paischer, Fabian, et al.
Publicado: (2024)

See Further for Parameter Efficient Fine-tuning by Standing on the Shoulders of Decomposition
por: Si, Chongjie, et al.
Publicado: (2024)

UORA: Uniform Orthogonal Reinitialization Adaptation in Parameter-Efficient Fine-Tuning of Large Models
por: Zhang, Xueyan, et al.
Publicado: (2025)

NeuroLoRA: Context-Aware Neuromodulation for Parameter-Efficient Multi-Task Adaptation
por: Yang, Yuxin, et al.
Publicado: (2026)

ShareLoRA: Parameter Efficient and Robust Large Language Model Fine-tuning via Shared Low-Rank Adaptation
por: Song, Yurun, et al.
Publicado: (2024)

DeGMix: Efficient Multi-Task Dense Prediction with Deformable and Gating Mixer
por: Xu, Yangyang, et al.
Publicado: (2023)

Enhancing Complex Instruction Following for Large Language Models with Mixture-of-Contexts Fine-tuning
por: Lu, Yuheng, et al.
Publicado: (2025)

Enhancing Online Continual Learning with Plug-and-Play State Space Model and Class-Conditional Mixture of Discretization
por: Liu, Sihao, et al.
Publicado: (2024)

PARA: Parameter-Efficient Fine-tuning with Prompt Aware Representation Adjustment
por: Liu, Zequan, et al.
Publicado: (2025)

Differentially Private Parameter-Efficient Fine-tuning for Large ASR Models
por: Liu, Hongbin, et al.
Publicado: (2024)

LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models
por: Chen, Yukang, et al.
Publicado: (2023)

Task-Aware Parameter-Efficient Fine-Tuning of Large Pre-Trained Models at the Edge
por: Hu, Senkang, et al.
Publicado: (2025)

Obliviate: Neutralizing Task-agnostic Backdoors within the Parameter-efficient Fine-tuning Paradigm
por: Kim, Jaehan, et al.
Publicado: (2024)

MoDA: Modulation Adapter for Fine-Grained Visual Grounding in Instructional MLLMs
por: Barrios, Wayner, et al.
Publicado: (2025)

Fine-tuning with Very Large Dropout
por: Zhang, Jianyu, et al.
Publicado: (2024)

Rethinking Safety in LLM Fine-tuning: An Optimization Perspective
por: Kim, Minseon, et al.
Publicado: (2025)

Preview-based Category Contrastive Learning for Knowledge Distillation
por: Ding, Muhe, et al.
Publicado: (2024)

GenView++: Unifying Adaptive Generative Augmentation and Quality-Driven Supervision for Contrastive Representation Learning
por: Li, Xiaojie, et al.
Publicado: (2025)

Democratizing Large Language Models via Personalized Parameter-Efficient Fine-tuning
por: Tan, Zhaoxuan, et al.
Publicado: (2024)

Step-by-Step Unmasking for Parameter-Efficient Fine-tuning of Large Language Models
por: Agarwal, Aradhye, et al.
Publicado: (2024)

QWHA: Quantization-Aware Walsh-Hadamard Adaptation for Parameter-Efficient Fine-Tuning on Large Language Models
por: Jeon, Hyesung, et al.
Publicado: (2025)

Pear: Pruning and Sharing Adapters in Visual Parameter-Efficient Fine-Tuning
por: Zhong, Yibo, et al.
Publicado: (2024)

Maintaining Structural Integrity in Parameter Spaces for Parameter Efficient Fine-tuning
por: Si, Chongjie, et al.
Publicado: (2024)

Parameter-Efficient Fine-Tuning with Differential Privacy for Robust Instruction Adaptation in Large Language Models
por: Huang, Yulin, et al.
Publicado: (2025)

LoCA: Location-Aware Cosine Adaptation for Parameter-Efficient Fine-Tuning
por: Du, Zhekai, et al.
Publicado: (2025)

Towards Interpretable Deep Local Learning with Successive Gradient Reconciliation
por: Yang, Yibo, et al.
Publicado: (2024)

Increasing Model Capacity for Free: A Simple Strategy for Parameter Efficient Fine-tuning
por: Song, Haobo, et al.
Publicado: (2024)

TRACE: Discovering Task-Specific Parameter via Adaptation-Aware Probing for Continual Fine-Tuning
por: Han, Xiaosong, et al.
Publicado: (2026)

Efficient Long Context Fine-tuning with Chunk Flow
por: Yuan, Xiulong, et al.
Publicado: (2025)

FP6-LLM: Efficiently Serving Large Language Models Through FP6-Centric Algorithm-System Co-Design
por: Xia, Haojun, et al.
Publicado: (2024)

SAW-INT4: System-Aware 4-Bit KV-Cache Quantization for Real-World LLM Serving
por: Jia, Jinda, et al.
Publicado: (2026)

AMAQ: Adaptive Mixed-bit Activation Quantization for Collaborative Parameter Efficient Fine-tuning
por: Song, Yurun, et al.
Publicado: (2025)