Cover Image

Sparse Adapter Fusion for Continual Learning in NLP

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zeng, Min, Chen, Xi, Yang, Haiqin, Guo, Yike
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Sparse High Rank Adapters
by: Bhardwaj, Kartikeya, et al.
Published: (2024)

JumpLoRA: Sparse Adapters for Continual Learning in Large Language Models
by: Dragomir, Alexandra, et al.
Published: (2026)

PLATE: Plasticity-Tunable Efficient Adapters for Geometry-Aware Continual Learning
by: Cosentino, Romain
Published: (2026)

Random Initialization of Gated Sparse Adapters
by: Retault, Vi, et al.
Published: (2025)

Adaptive Budget Allocation for Orthogonal-Subspace Adapter Tuning in LLMs Continual Learning
by: Wan, Zhiyi, et al.
Published: (2025)

HOP to the Next Tasks and Domains for Continual Learning in NLP
by: Michieli, Umberto, et al.
Published: (2024)

WARP: Guaranteed Inner-Layer Repair of NLP Transformers
by: Hsu, Hsin-Ling, et al.
Published: (2026)

Learning to Route for Dynamic Adapter Composition in Continual Learning with Language Models
by: Araujo, Vladimir, et al.
Published: (2024)

Sparsely Multimodal Data Fusion
by: Bjorgaard, Josiah
Published: (2024)

Federated Continual Learning via Knowledge Fusion: A Survey
by: Yang, Xin, et al.
Published: (2023)

SLoPe: Double-Pruned Sparse Plus Lazy Low-Rank Adapter Pretraining of LLMs
by: Mozaffari, Mohammad, et al.
Published: (2024)

EsaCL: Efficient Continual Learning of Sparse Models
by: Ren, Weijieying, et al.
Published: (2024)

Adapting Feature Attenuation to NLP
by: Yang, Tianshuo, et al.
Published: (2026)

Group and Exclusive Sparse Regularization-based Continual Learning of CNNs
by: Tousside, Basile, et al.
Published: (2026)

Scaling-Aware Adapter for Structure-Grounded LLM Reasoning
by: Jing, Zihao, et al.
Published: (2026)

FLUID: Continuous-Time Hyperconnected Sparse Transformer for Sink-Free Learning
by: Razzaq, Waleed, et al.
Published: (2026)

DESIRE: Dynamic Knowledge Consolidation for Rehearsal-Free Continual Learning
by: Guo, Haiyang, et al.
Published: (2024)

CoRA: Boosting Time Series Foundation Models for Multivariate Forecasting through Correlation-aware Adapter
by: Cheng, Hanyin, et al.
Published: (2026)

Sparse Variational Student-t Processes
by: Xu, Jian, et al.
Published: (2023)

Locality Sensitive Sparse Encoding for Learning World Models Online
by: Liu, Zichen, et al.
Published: (2024)

ASPECT: Node-Level Adaptive Spectral Fusion for Graph Contrastive Learning
by: Li, Zhuolong, et al.
Published: (2026)

Continual Adapter Tuning with Semantic Shift Compensation for Class-Incremental Learning
by: Zhou, Qinhao, et al.
Published: (2024)

AhaRobot: A Low-Cost Open-Source Bimanual Mobile Manipulator for Embodied AI
by: Cui, Haiqin, et al.
Published: (2025)

Self-Indexing KVCache: Predicting Sparse Attention from Compressed Keys
by: Yang, Xu, et al.
Published: (2026)

Continual Learning for Multimodal Data Fusion of a Soft Gripper
by: Kushawaha, Nilay, et al.
Published: (2024)

STAMP: Spatial-Temporal Adapter with Multi-Head Pooling
by: Shook, Brad, et al.
Published: (2025)

CuMA: Aligning LLMs with Sparse Cultural Values via Demographic-Aware Mixture of Adapters
by: Sun, Ao, et al.
Published: (2026)

Conditional Equivalence of DPO and RLHF: Implicit Assumption, Failure Modes, and Provable Alignment
by: Yang, Zhiqin, et al.
Published: (2026)

FL-TAC: Enhanced Fine-Tuning in Federated Learning via Low-Rank, Task-Specific Adapter Clustering
by: Ping, Siqi, et al.
Published: (2024)

Context-Aware Adapter Tuning for Few-Shot Relation Learning in Knowledge Graphs
by: Liu, Ran, et al.
Published: (2024)

NLP Sampling: Combining MCMC and NLP Methods for Diverse Constrained Sampling
by: Toussaint, Marc, et al.
Published: (2024)

LibContinual: A Comprehensive Library towards Realistic Continual Learning
by: Li, Wenbin, et al.
Published: (2025)

Towards Symmetric Low-Rank Adapters
by: Panoutsos, Tales, et al.
Published: (2025)

Filter-then-Generate: Large Language Models with Structure-Text Adapter for Knowledge Graph Completion
by: Liu, Ben, et al.
Published: (2024)

Conservation-informed Graph Learning for Spatiotemporal Dynamics Prediction
by: Mi, Yuan, et al.
Published: (2024)

Fusion of Multiscale Features Via Centralized Sparse-attention Network for EEG Decoding
by: Cai, Xiangrui, et al.
Published: (2025)

SketchOGD: Memory-Efficient Continual Learning
by: Min, Youngjae, et al.
Published: (2023)

On the Implicit Adversariality of Catastrophic Forgetting in Deep Continual Learning
by: Peng, Ze, et al.
Published: (2025)

Learning Adapter Rank via Symmetry Breaking
by: Doyle, Cooper, et al.
Published: (2025)

POLAR: Online Learning for LoRA Adapter Caching and Routing in Edge LLM Serving
by: Li, Shaoang, et al.
Published: (2026)