Copertina

Little by Little: Continual Learning via Incremental Mixture of Rank-1 Associative Memory Experts

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Lu, Haodong, Zhao, Chongyang, Xue, Minhui, Yao, Lina, Moore, Kristen, Gong, Dong
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Learning with Mixture of Prototypes for Out-of-Distribution Detection
di: Lu, Haodong, et al.
Pubblicazione: (2024)

Take Only What You Need: Rank Minimization as an Implicit Forgetting Regularizer in Continual Learning
di: Lu, Haodong, et al.
Pubblicazione: (2024)

Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual Learning
di: Wang, Huiyi, et al.
Pubblicazione: (2024)

On Token's Dilemma: Dynamic MoE with Drift-Aware Token Assignment for Continual Learning of Large Vision Language Models
di: Zhao, Chongyang, et al.
Pubblicazione: (2026)

Learning Mamba as a Continual Learner: Meta-learning Selective State Space Models for Efficient Continual Learning
di: Zhao, Chongyang, et al.
Pubblicazione: (2024)

Continual Learning on CLIP via Incremental Prompt Tuning with Intrinsic Textual Anchors
di: Lu, Haodong, et al.
Pubblicazione: (2025)

Dynamic Mixture-of-Experts for Incremental Graph Learning
di: Kong, Lecheng, et al.
Pubblicazione: (2025)

Model Inversion with Layer-Specific Modeling and Alignment for Data-Free Continual Learning
di: Tong, Ruilin, et al.
Pubblicazione: (2025)

InRank: Incremental Low-Rank Learning
di: Zhao, Jiawei, et al.
Pubblicazione: (2023)

Stable Routing for Mixture-of-Experts in Class-Incremental Learning
di: Guo, Zirui, et al.
Pubblicazione: (2026)

Each Rank Could be an Expert: Single-Ranked Mixture of Experts LoRA for Multi-Task Learning
di: Zhao, Ziyu, et al.
Pubblicazione: (2025)

Continual Traffic Forecasting via Mixture of Experts
di: Lee, Sanghyun, et al.
Pubblicazione: (2024)

Few Batches or Little Memory, But Not Both: Simultaneous Space and Adaptivity Constraints in Stochastic Bandits
di: Huang, Ruiyuan, et al.
Pubblicazione: (2026)

Unified Class and Domain Incremental Learning with Mixture of Experts for Indoor Localization
di: Singampalli, Akhil, et al.
Pubblicazione: (2025)

Theory on Mixture-of-Experts in Continual Learning
di: Li, Hongbo, et al.
Pubblicazione: (2024)

Bandwidth-Efficient Adaptive Mixture-of-Experts via Low-Rank Compensation
di: Liu, Zhenyu, et al.
Pubblicazione: (2025)

Mixture of Experts Meets Prompt-Based Continual Learning
di: Le, Minh, et al.
Pubblicazione: (2024)

VA-MoE: Variables-Adaptive Mixture of Experts for Incremental Weather Forecasting
di: Chen, Hao, et al.
Pubblicazione: (2024)

Improving Forecasts of Suicide Attempts for Patients with Little Data
di: Hang, Genesis, et al.
Pubblicazione: (2025)

Similarity-Aware Mixture-of-Experts for Data-Efficient Continual Learning
di: Mclaughlin, Connor, et al.
Pubblicazione: (2026)

RepLoRA: Reparameterizing Low-Rank Adaptation via the Perspective of Mixture of Experts
di: Truong, Tuan, et al.
Pubblicazione: (2025)

MoRE: A Mixture of Low-Rank Experts for Adaptive Multi-Task Learning
di: Zhang, Dacao, et al.
Pubblicazione: (2025)

On the Peril of (Even a Little) Nonstationarity in Satisficing Regret Minimization
di: Zhang, Yixuan, et al.
Pubblicazione: (2026)

Split-on-Share: Mixture of Sparse Experts for Task-Agnostic Continual Learning
di: Siddika, Fatema, et al.
Pubblicazione: (2026)

FLAME: Adaptive Mixture-of-Experts for Continual Multimodal Multi-Task Learning
di: Han, Xing, et al.
Pubblicazione: (2026)

SAME: Learning Generic Language-Guided Visual Navigation with State-Adaptive Mixture of Experts
di: Zhou, Gengze, et al.
Pubblicazione: (2024)

EEG-Based Multimodal Learning via Hyperbolic Mixture-of-Curvature Experts
di: Zhou, Runhe, et al.
Pubblicazione: (2026)

MoE-I$^2$: Compressing Mixture of Experts Models through Inter-Expert Pruning and Intra-Expert Low-Rank Decomposition
di: Yang, Cheng, et al.
Pubblicazione: (2024)

Landscape-Aware Growing: The Power of a Little LAG
di: Karp, Stefani, et al.
Pubblicazione: (2024)

Dynamic Expert Sharing: Decoupling Memory from Parallelism in Mixture-of-Experts Diffusion LLMs
di: Chen, Hao Mark, et al.
Pubblicazione: (2026)

Learning More Generalized Experts by Merging Experts in Mixture-of-Experts
di: Park, Sejik
Pubblicazione: (2024)

Escaping Stability-Plasticity Dilemma in Online Continual Learning for Motion Forecasting via Synergetic Memory Rehearsal
di: Lin, Yunlong, et al.
Pubblicazione: (2025)

OrdMoE: Preference Alignment via Hierarchical Expert Group Ranking in Multimodal Mixture-of-Experts LLMs
di: Gao, Yuting, et al.
Pubblicazione: (2025)

Little is Enough: Boosting Privacy by Sharing Only Hard Labels in Federated Semi-Supervised Learning
di: Abourayya, Amr, et al.
Pubblicazione: (2023)

LittleBit: Ultra Low-Bit Quantization via Latent Factorization
di: Lee, Banseok, et al.
Pubblicazione: (2025)

Robustness of Mixtures of Experts to Feature Noise
di: Sun, Dong, et al.
Pubblicazione: (2026)

Mixtures of SubExperts for Large Language Continual Learning
di: Kang, Haeyong
Pubblicazione: (2025)

Towards Principled Design of Mixture-of-Experts Language Models under Memory and Inference Constraints
di: Liew, Seng Pei, et al.
Pubblicazione: (2026)

Hierarchical Gaussian Mixture Normalizing Flow Modeling for Unified Anomaly Detection
di: Yao, Xincheng, et al.
Pubblicazione: (2024)

FlyLoRA: Boosting Task Decoupling and Parameter Efficiency via Implicit Rank-Wise Mixture-of-Experts
di: Zou, Heming, et al.
Pubblicazione: (2025)