Saved in:
Bibliographic Details
Main Authors: Liu, Tianhui, Mou, Lili
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2602.09234
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • Continual learning has become a trending topic in machine learning. Recent studies have discovered an interesting phenomenon called loss of plasticity, referring to neural networks gradually losing the ability to learn new tasks. However, existing plasticity research largely relies on contrived settings with abrupt task transitions, which often do not reflect real-world environments. In this paper, we propose to investigate a gradually changing environment, and we simulate this by input/output interpolation and task sampling. We perform theoretical and empirical analysis, showing that the loss of plasticity is an artifact of abrupt tasks changes in the environment and can be largely mitigated if the world changes gradually.