Cover Image

Spurious Forgetting in Continual Learning of Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zheng, Junhao, Cai, Xidi, Qiu, Shengjie, Ma, Qianli
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Can LLMs Learn New Concepts Incrementally without Forgetting?
by: Zheng, Junhao, et al.
Published: (2024)

Learn or Recall? Revisiting Incremental Learning with Pre-trained Language Models
by: Zheng, Junhao, et al.
Published: (2023)

Towards Lifelong Learning of Large Language Models: A Survey
by: Zheng, Junhao, et al.
Published: (2024)

Beyond Anti-Forgetting: Multimodal Continual Instruction Tuning with Positive Forward Transfer
by: Zheng, Junhao, et al.
Published: (2024)

Incremental Sequence Labeling: A Tale of Two Shifts
by: Qiu, Shengjie, et al.
Published: (2024)

Real Time Detection and Quantitative Analysis of Spurious Forgetting in Continual Learning
by: Wang, Weiwei
Published: (2025)

Balancing the Causal Effects in Class-Incremental Learning
by: Zheng, Junhao, et al.
Published: (2024)

Path Integral Solution for Dissipative Generative Dynamics
by: Wang, Xidi
Published: (2025)

Self-Adaptive Reconstruction with Contrastive Learning for Unsupervised Sentence Embeddings
by: Liu, Junlong, et al.
Published: (2024)

Neural-Symbolic Message Passing with Dynamic Pruning
by: Zhang, Chongzhi, et al.
Published: (2025)

Conditional Logical Message Passing Transformer for Complex Query Answering
by: Zhang, Chongzhi, et al.
Published: (2024)

Lifelong Learning of Large Language Model based Agents: A Roadmap
by: Zheng, Junhao, et al.
Published: (2025)

A Unified Shape-Aware Foundation Model for Time Series Classification
by: Liu, Zhen, et al.
Published: (2026)

Complexity Matters: Dynamics of Feature Learning in the Presence of Spurious Correlations
by: Qiu, GuanWen, et al.
Published: (2024)

HyperIMTS: Hypergraph Neural Network for Irregular Multivariate Time Series Forecasting
by: Li, Boyuan, et al.
Published: (2025)

Forget Forgetting: Continual Learning in a World of Abundant Memory
by: Cho, Dongkyu, et al.
Published: (2025)

Understanding Forgetting in Continual Learning with Linear Regression
by: Ding, Meng, et al.
Published: (2024)

Understanding Generalization and Forgetting in In-Context Continual Learning
by: Li, Guangyu, et al.
Published: (2026)

From Order to Distribution: A Spectral Characterization of Forgetting in Continual Learning
by: Xu, Zonghuan, et al.
Published: (2026)

Pretrained Vision-Language-Action Models are Surprisingly Resistant to Forgetting in Continual Learning
by: Liu, Huihan, et al.
Published: (2026)

No Forgetting Learning: Buffer-free Continual Learning Classification
by: Vahedifar, Mohammad Ali, et al.
Published: (2025)

Forgetting in Language Models: Capacity, Optimization, and Self-Generated Replay
by: Marek, Martin, et al.
Published: (2026)

A Forget-and-Grow Strategy for Deep Reinforcement Learning Scaling in Continuous Control
by: Kang, Zilin, et al.
Published: (2025)

FOREVER: Forgetting Curve-Inspired Memory Replay for Language Model Continual Learning
by: Feng, Yujie, et al.
Published: (2026)

Holographic Knowledge Manifolds: A Novel Pipeline for Continual Learning Without Catastrophic Forgetting in Large Language Models
by: Arndt, Justin
Published: (2025)

Data-dependent and Oracle Bounds on Forgetting in Continual Learning
by: Friedman, Lior, et al.
Published: (2024)

Mitigating Catastrophic Forgetting in Large Language Models with Forgetting-aware Pruning
by: Huang, Wei, et al.
Published: (2025)

Graceful Forgetting in Generative Language Models
by: Jiang, Chunyang, et al.
Published: (2025)

Pathformer: Recursive Path Query Encoding for Complex Logical Query Answering
by: Zhang, Chongzhi, et al.
Published: (2024)

Sequencing to Mitigate Catastrophic Forgetting in Continual Learning
by: Moussa, Hesham G., et al.
Published: (2025)

Accurate Forgetting for Heterogeneous Federated Continual Learning
by: Wuerkaixi, Abudukelimu, et al.
Published: (2025)

Retrofit: Continual Learning with Controlled Forgetting for Binary Security Detection and Analysis
by: He, Yiling, et al.
Published: (2025)

Learning and Forgetting Unsafe Examples in Large Language Models
by: Zhao, Jiachen, et al.
Published: (2023)

Combating Spurious Correlations in Graph Interpretability via Self-Reflection
by: Cai, Kecheng, et al.
Published: (2026)

Unifying Invariance and Spuriousity for Graph Out-of-Distribution via Probability of Necessity and Sufficiency
by: Chen, Xuexin, et al.
Published: (2024)

Learning without Forgetting for Vision-Language Models
by: Zhou, Da-Wei, et al.
Published: (2023)

Learning to Forget: Continual Learning with Adaptive Weight Decay
by: Ramesh, Aditya A., et al.
Published: (2026)

On the Implicit Adversariality of Catastrophic Forgetting in Deep Continual Learning
by: Peng, Ze, et al.
Published: (2025)

Addressing Loss of Plasticity and Catastrophic Forgetting in Continual Learning
by: Elsayed, Mohamed, et al.
Published: (2024)

Mitigating Forgetting in Continual Learning with Selective Gradient Projection
by: Singh, Anika, et al.
Published: (2026)