Cover Image

Provable Effects of Data Replay in Continual Learning: A Feature Learning Perspective

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ding, Meng, Xu, Jinhui, Ji, Kaiyi
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Understanding Forgetting in Continual Learning with Linear Regression
by: Ding, Meng, et al.
Published: (2024)

GRID: Scalable Task-Agnostic Prompt-Based Continual Learning for Language Models
by: Tiwari, Anushka, et al.
Published: (2025)

Better Generative Replay for Continual Federated Learning
by: Qi, Daiqing, et al.
Published: (2023)

Prioritized Trajectory Replay: A Replay Memory for Data-driven Reinforcement Learning
by: Liu, Jinyi, et al.
Published: (2023)

Feature Aggregation with Latent Generative Replay for Federated Continual Learning of Socially Appropriate Robot Behaviours
by: Churamani, Nikhil, et al.
Published: (2024)

Provable Benefit of Cutout and CutMix for Feature Learning
by: Oh, Junsoo, et al.
Published: (2024)

CORE: Mitigating Catastrophic Forgetting in Continual Learning through Cognitive Replay
by: Zhang, Jianshu, et al.
Published: (2024)

Data-Free Generative Replay for Class-Incremental Learning on Imbalanced Data
by: Younis, Sohaib, et al.
Published: (2024)

AL-GNN: Privacy-Preserving and Replay-Free Continual Graph Learning via Analytic Learning
by: Zhang, Xuling, et al.
Published: (2025)

Teaching AI to Remember: Insights from Brain-Inspired Replay in Continual Learning
by: Kim, Jina
Published: (2025)

Continual Offline Reinforcement Learning via Diffusion-based Dual Generative Replay
by: Liu, Jinmei, et al.
Published: (2024)

Scalable Strategies for Continual Learning with Replay
by: Hickok, Truman
Published: (2025)

Provable Scaling Laws of Feature Emergence from Learning Dynamics of Grokking
by: Tian, Yuandong
Published: (2025)

Understanding Fine-tuning in Approximate Unlearning: A Theoretical Perspective
by: Ding, Meng, et al.
Published: (2024)

Dual-LoRA and Quality-Enhanced Pseudo Replay for Multimodal Continual Food Learning
by: Wu, Xinlan, et al.
Published: (2025)

Revisiting Softmax Masking: Stop Gradient for Enhancing Stability in Replay-based Continual Learning
by: Kim, Hoyong, et al.
Published: (2023)

Provably Efficient Action-Manipulation Attack Against Continuous Reinforcement Learning
by: Luo, Zhi, et al.
Published: (2024)

Towards User-level Private Reinforcement Learning with Human Feedback
by: Zhang, Jiaming, et al.
Published: (2025)

FOREVER: Forgetting Curve-Inspired Memory Replay for Language Model Continual Learning
by: Feng, Yujie, et al.
Published: (2026)

Experience Replay Addresses Loss of Plasticity in Continual Learning
by: Wang, Jiuqi, et al.
Published: (2025)

Task-Aware Adaptive Modulation: A Replay-Free and Resource-Efficient Approach For Continual Graph Learning
by: Liu, Jingtao, et al.
Published: (2025)

Human-Aware Robot Navigation via Reinforcement Learning with Hindsight Experience Replay and Curriculum Learning
by: Li, Keyu, et al.
Published: (2021)

CUER: Corrected Uniform Experience Replay for Off-Policy Continuous Deep Reinforcement Learning Algorithms
by: Yenicesu, Arda Sarp, et al.
Published: (2024)

Dyn-D$^2$P: Dynamic Differentially Private Decentralized Learning with Provable Utility Guarantee
by: Zhu, Zehan, et al.
Published: (2025)

Deciphering Raw Data in Neuro-Symbolic Learning with Provable Guarantees
by: Tao, Lue, et al.
Published: (2023)

SuRe: Surprise-Driven Prioritised Replay for Continual LLM Learning
by: Hazard, Hugo, et al.
Published: (2025)

Neuroscience-Inspired Memory Replay for Continual Learning: A Comparative Study of Predictive Coding and Backpropagation-Based Strategies
by: Nalagatla, Goutham, et al.
Published: (2025)

Provable Contrastive Continual Learning
by: Wen, Yichen, et al.
Published: (2024)

Reinforcement Learning-based Feature Generation Algorithm for Scientific Data
by: Xiao, Meng, et al.
Published: (2025)

Online Curvature-Aware Replay: Leveraging $\mathbf{2^{nd}}$ Order Information for Online Continual Learning
by: Urettini, Edoardo, et al.
Published: (2025)

IDER: IDempotent Experience Replay for Reliable Continual Learning
by: Liu, Zhanwang, et al.
Published: (2026)

R^3: Replay, Reflection, and Ranking Rewards for LLM Reinforcement Learning
by: Jiang, Zhizheng, et al.
Published: (2026)

Replay4NCL: An Efficient Memory Replay-based Methodology for Neuromorphic Continual Learning in Embedded AI Systems
by: Minhas, Mishal Fatima, et al.
Published: (2025)

Adaptive Replay Buffer for Offline-to-Online Reinforcement Learning
by: Song, Chihyeon, et al.
Published: (2025)

Rethinking Parameter Sharing for LLM Fine-Tuning with Multiple LoRAs
by: Ban, Hao, et al.
Published: (2025)

Parameter-Efficient Fine-Tuning for Continual Learning: A Neural Tangent Kernel Perspective
by: Liu, Jingren, et al.
Published: (2024)

When Does Non-Uniform Replay Matter in Reinforcement Learning?
by: Korniak, Michal, et al.
Published: (2026)

Finite-Time Analysis of Temporal Difference Learning with Experience Replay
by: Lim, Han-Dong, et al.
Published: (2023)

Efficient Diversity-based Experience Replay for Deep Reinforcement Learning
by: Zhao, Kaiyan, et al.
Published: (2024)

An Efficient Replay for Class-Incremental Learning with Pre-trained Models
by: Yin, Weimin, et al.
Published: (2024)