Cover Image

TFGN: Task-Free, Replay-Free Continual Pre-Training Without Catastrophic Forgetting at LLM Scale

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Ganguli, Anurup
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

CORE: Mitigating Catastrophic Forgetting in Continual Learning through Cognitive Replay
by: Zhang, Jianshu, et al.
Published: (2024)

Sequencing to Mitigate Catastrophic Forgetting in Continual Learning
by: Moussa, Hesham G., et al.
Published: (2025)

Catastrophic Forgetting Mitigation via Discrepancy-Weighted Experience Replay
by: Xu, Xinrun, et al.
Published: (2025)

Revisiting Catastrophic Forgetting in Continual Knowledge Graph Embedding
by: Pons, Gerard, et al.
Published: (2026)

Addressing Loss of Plasticity and Catastrophic Forgetting in Continual Learning
by: Elsayed, Mohamed, et al.
Published: (2024)

On the Implicit Adversariality of Catastrophic Forgetting in Deep Continual Learning
by: Peng, Ze, et al.
Published: (2025)

Enhancing Continual Learning for Software Vulnerability Prediction: Addressing Catastrophic Forgetting via Hybrid-Confidence-Aware Selective Replay for Temporal LLM Fine-Tuning
by: Dou, Xuhui, et al.
Published: (2026)

Task-Aware Adaptive Modulation: A Replay-Free and Resource-Efficient Approach For Continual Graph Learning
by: Liu, Jingtao, et al.
Published: (2025)

Overcoming Catastrophic Forgetting by Exemplar Selection in Task-oriented Dialogue System
by: Chen, Chen, et al.
Published: (2024)

CURLoRA: Stable LLM Continual Fine-Tuning and Catastrophic Forgetting Mitigation
by: Fawi, Muhammad
Published: (2024)

Mitigating Catastrophic Forgetting and Mode Collapse in Text-to-Image Diffusion via Latent Replay
by: Otani, Aoi
Published: (2025)

Continual Learning and Catastrophic Forgetting
by: van de Ven, Gido M., et al.
Published: (2024)

Catastrophic Forgetting in Kolmogorov-Arnold Networks
by: Rahman, Mohammad Marufur, et al.
Published: (2025)

Dynamic Expert Specialization: Towards Catastrophic Forgetting-Free Multi-Domain MoE Adaptation
by: Li, Junzhuo, et al.
Published: (2025)

Defense without Forgetting: Continual Adversarial Defense with Anisotropic & Isotropic Pseudo Replay
by: Zhou, Yuhang, et al.
Published: (2024)

Unlocking the Power of Function Vectors for Characterizing and Mitigating Catastrophic Forgetting in Continual Instruction Tuning
by: Jiang, Gangwei, et al.
Published: (2025)

How to Leverage Predictive Uncertainty Estimates for Reducing Catastrophic Forgetting in Online Continual Learning
by: Serra, Giuseppe, et al.
Published: (2024)

Can LLMs Alleviate Catastrophic Forgetting in Graph Continual Learning? A Systematic Study
by: Cheng, Ziyang, et al.
Published: (2025)

GeRe: Towards Efficient Anti-Forgetting in Continual Learning of LLM via General Samples Replay
by: Zhang, Yunan, et al.
Published: (2025)

Revisiting Replay and Gradient Alignment for Continual Pre-Training of Large Language Models
by: Abbes, Istabrak, et al.
Published: (2025)

Quantifying Catastrophic Forgetting in IoT Intrusion Detection Systems
by: Banerjee, Sourasekhar, et al.
Published: (2026)

A Conformal Predictive Measure for Assessing Catastrophic Forgetting
by: Pitsiorlas, Ioannis, et al.
Published: (2025)

AL-GNN: Privacy-Preserving and Replay-Free Continual Graph Learning via Analytic Learning
by: Zhang, Xuling, et al.
Published: (2025)

FOREVER: Forgetting Curve-Inspired Memory Replay for Language Model Continual Learning
by: Feng, Yujie, et al.
Published: (2026)

Incremental Concept Formation over Visual Images Without Catastrophic Forgetting
by: Barari, Nicki, et al.
Published: (2024)

Continual Deep Reinforcement Learning to Prevent Catastrophic Forgetting in Jamming Mitigation
by: Davaslioglu, Kemal, et al.
Published: (2024)

Explaining Robustness to Catastrophic Forgetting Through Incremental Concept Formation
by: Barari, Nicki, et al.
Published: (2025)

Catastrophic Forgetting Mitigation Through Plateau Phase Activity Profiling
by: Mashiach, Idan, et al.
Published: (2025)

Evolutionary Strategies lead to Catastrophic Forgetting in LLMs
by: Abdi, Immanuel, et al.
Published: (2026)

Data-Free Generative Replay for Class-Incremental Learning on Imbalanced Data
by: Younis, Sohaib, et al.
Published: (2024)

Overcoming Growth-Induced Forgetting in Task-Agnostic Continual Learning
by: Zhao, Yuqing, et al.
Published: (2024)

Analyzing and Reducing Catastrophic Forgetting in Parameter Efficient Tuning
by: Ren, Weijieying, et al.
Published: (2024)

A Methodology-Oriented Study of Catastrophic Forgetting in Incremental Deep Neural Networks
by: Kumar, Ashutosh, et al.
Published: (2024)

Overcoming Catastrophic Forgetting in Tabular Data Classification: A Pseudorehearsal-based approach
by: García-Santaclara, Pablo, et al.
Published: (2024)

Is Prompt Selection Necessary for Task-Free Online Continual Learning?
by: Park, Seoyoung, et al.
Published: (2026)

Robust and Resource-Efficient Data-Free Knowledge Distillation by Generative Pseudo Replay
by: Binici, Kuluhan, et al.
Published: (2022)

From Offline to Online Memory-Free and Task-Free Continual Learning via Fine-Grained Hypergradients
by: Michel, Nicolas, et al.
Published: (2025)

Dynamic Orthogonal Continual Fine-tuning for Mitigating Catastrophic Forgettings
by: Zhang, Zhixin, et al.
Published: (2025)

Intelligent Learning Rate Distribution to reduce Catastrophic Forgetting in Transformers
by: Kenneweg, Philip, et al.
Published: (2024)

Context Channel Capacity: An Information-Theoretic Framework for Understanding Catastrophic Forgetting
by: Cheng, Ran
Published: (2026)