Cover Image

FOREVER: Forgetting Curve-Inspired Memory Replay for Language Model Continual Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Feng, Yujie, Wang, Hao, Li, Jian, Chu, Xu, Kang, Zhaolu, Liu, Yiran, Wang, Yasha, Yu, Philip S., Wu, Xiao-Ming
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Recurrent Knowledge Identification and Fusion for Language Model Continual Learning
by: Feng, Yujie, et al.
Published: (2025)

AIMMerging: Adaptive Iterative Model Merging Using Training Trajectories for Language Model Continual Learning
by: Feng, Yujie, et al.
Published: (2025)

KIF: Knowledge Identification and Fusion for Language Model Continual Learning
by: Feng, Yujie, et al.
Published: (2024)

GeoEdit: Geometric Knowledge Editing for Large Language Models
by: Feng, Yujie, et al.
Published: (2025)

FadeMem: Biologically-Inspired Forgetting for Efficient Agent Memory
by: Wei, Lei, et al.
Published: (2026)

IntelliCare: Improving Healthcare Analysis with Variance-Controlled Patient-Level Knowledge from Large Language Models
by: Yu, Zhihao, et al.
Published: (2024)

SMART: Towards Pre-trained Missing-Aware Model for Patient Health Status Prediction
by: Yu, Zhihao, et al.
Published: (2024)

TPO: Aligning Large Language Models with Multi-branch & Multi-step Preference Trees
by: Liao, Weibin, et al.
Published: (2024)

NOW AND FOREVER
by: SAPPAYANI, ARSANIAL E.
Published: (2026)

Adaptive Memory Replay for Continual Learning
by: Smith, James Seale, et al.
Published: (2024)

CORE: Mitigating Catastrophic Forgetting in Continual Learning through Cognitive Replay
by: Zhang, Jianshu, et al.
Published: (2024)

Forget Forgetting: Continual Learning in a World of Abundant Memory
by: Cho, Dongkyu, et al.
Published: (2025)

Continual Learning: Less Forgetting, More OOD Generalization via Adaptive Contrastive Replay
by: Rezaei, Hossein, et al.
Published: (2024)

Neuroscience-Inspired Memory Replay for Continual Learning: A Comparative Study of Predictive Coding and Backpropagation-Based Strategies
by: Nalagatla, Goutham, et al.
Published: (2025)

GeRe: Towards Efficient Anti-Forgetting in Continual Learning of LLM via General Samples Replay
by: Zhang, Yunan, et al.
Published: (2025)

TaSL: Continual Dialog State Tracking via Task Skill Localization and Consolidation
by: Feng, Yujie, et al.
Published: (2024)

Graph Continual Learning with Debiased Lossless Memory Replay
by: Niu, Chaoxi, et al.
Published: (2024)

Parenting: Optimizing Knowledge Selection of Retrieval-Augmented Language Models with Parameter Decoupling and Tailored Tuning
by: Xu, Yongxin, et al.
Published: (2024)

Learning to Forget: Sleep-Inspired Memory Consolidation for Resolving Proactive Interference in Large Language Models
by: Xie, Ying
Published: (2026)

Forgetting in Language Models: Capacity, Optimization, and Self-Generated Replay
by: Marek, Martin, et al.
Published: (2026)

More Than Memory Savings: Zeroth-Order Optimization Mitigates Forgetting in Continual Learning
by: Yu, Wanhao, et al.
Published: (2025)

Replay Can Provably Increase Forgetting
by: Mahdaviyeh, Yasaman, et al.
Published: (2025)

Advancing Prompt-Based Methods for Replay-Independent General Continual Learning
by: Kang, Zhiqi, et al.
Published: (2025)

Defense without Forgetting: Continual Adversarial Defense with Anisotropic & Isotropic Pseudo Replay
by: Zhou, Yuhang, et al.
Published: (2024)

Teaching AI to Remember: Insights from Brain-Inspired Replay in Continual Learning
by: Kim, Jina
Published: (2025)

Prioritized Trajectory Replay: A Replay Memory for Data-driven Reinforcement Learning
by: Liu, Jinyi, et al.
Published: (2023)

Live-Evo: Online Evolution of Agentic Memory from Continuous Feedback
by: Zhang, Yaolun, et al.
Published: (2026)

May the Forgetting Be with You: Alternate Replay for Learning with Noisy Labels
by: Millunzi, Monica, et al.
Published: (2024)

FSFM: A Biologically-Inspired Framework for Selective Forgetting of Agent Memory
by: Gu, Yingjie, et al.
Published: (2026)

Diffusion-Driven Data Replay: A Novel Approach to Combat Forgetting in Federated Class Continual Learning
by: Liang, Jinglin, et al.
Published: (2024)

Understanding Forgetting in Continual Learning with Linear Regression
by: Ding, Meng, et al.
Published: (2024)

Catastrophic Forgetting Mitigation via Discrepancy-Weighted Experience Replay
by: Xu, Xinrun, et al.
Published: (2025)

Continual Learning for non-stationary regression via Memory-Efficient Replay
by: García-Santaclara, Pablo, et al.
Published: (2026)

Replay4NCL: An Efficient Memory Replay-based Methodology for Neuromorphic Continual Learning in Embedded AI Systems
by: Minhas, Mishal Fatima, et al.
Published: (2025)

MSSR: Memory-Aware Adaptive Replay for Continual LLM Fine-Tuning
by: Lu, Yiyang, et al.
Published: (2026)

RMAAT: Astrocyte-Inspired Memory Compression and Replay for Efficient Long-Context Transformers
by: Mia, Md Zesun Ahmed, et al.
Published: (2026)

On the Limitation and Experience Replay for GNNs in Continual Learning
by: Su, Junwei, et al.
Published: (2023)

KoReA-SFL: Knowledge Replay-based Split Federated Learning Against Catastrophic Forgetting
by: Xia, Zeke, et al.
Published: (2024)

A Forget-and-Grow Strategy for Deep Reinforcement Learning Scaling in Continuous Control
by: Kang, Zilin, et al.
Published: (2025)

Penny Wise, Pixel Foolish: Bypassing Price Constraints in Multimodal Agents via Visual Adversarial Perturbations
by: Qian, Jiachen, et al.
Published: (2026)