Image de couverture de livre

Mitigating Catastrophic Forgetting in Large Language Models with Forgetting-aware Pruning

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Huang, Wei, Cheng, Anda, Wang, Yinggui
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Mitigating Catastrophic Forgetting in Language Transfer via Model Merging
par: Alexandrov, Anton, et autres
Publié: (2024)

Sequencing to Mitigate Catastrophic Forgetting in Continual Learning
par: Moussa, Hesham G., et autres
Publié: (2025)

Sharpness-Aware Pretraining Mitigates Catastrophic Forgetting
par: Watts, Ishaan, et autres
Publié: (2026)

Information Leakage from Embedding in Large Language Models
par: Wan, Zhipeng, et autres
Publié: (2024)

A Fast, Performant, Secure Distributed Training Framework For Large Language Model
par: Huang, Wei, et autres
Publié: (2024)

Catastrophic Forgetting Mitigation Through Plateau Phase Activity Profiling
par: Mashiach, Idan, et autres
Publié: (2025)

MEGA: Second-Order Gradient Alignment for Catastrophic Forgetting Mitigation in GFSCIL
par: Pang, Jinhui, et autres
Publié: (2025)

Analyzing Mitigation Strategies for Catastrophic Forgetting in End-to-End Training of Spoken Language Models
par: Hsiao, Chi-Yuan, et autres
Publié: (2025)

Dynamic Orthogonal Continual Fine-tuning for Mitigating Catastrophic Forgettings
par: Zhang, Zhixin, et autres
Publié: (2025)

Predicting the Susceptibility of Examples to Catastrophic Forgetting
par: Hacohen, Guy, et autres
Publié: (2024)

Catastrophic Forgetting in Kolmogorov-Arnold Networks
par: Rahman, Mohammad Marufur, et autres
Publié: (2025)

Mitigating Catastrophic Forgetting with Adaptive Transformer Block Expansion in Federated Fine-Tuning
par: Huo, Yujia, et autres
Publié: (2025)

Understanding Catastrophic Forgetting in Language Models via Implicit Inference
par: Kotha, Suhas, et autres
Publié: (2023)

Are Time Series Foundation Models Susceptible to Catastrophic Forgetting?
par: Karaouli, Nouha, et autres
Publié: (2025)

Mitigating Catastrophic Forgetting in Mathematical Reasoning Finetuning through Mixed Training
par: Reynolds, John Graham
Publié: (2025)

Fine-Grained Gradient Restriction: A Simple Approach for Mitigating Catastrophic Forgetting
par: Liu, Bo, et autres
Publié: (2024)

CORE: Mitigating Catastrophic Forgetting in Continual Learning through Cognitive Replay
par: Zhang, Jianshu, et autres
Publié: (2024)

DPF-CM: A Data Processing Framework with Privacy-Preserving Vector Databases for Chinese Medical LLMs Training and Deployment
par: Huang, Wei, et autres
Publié: (2025)

Robust Policy Optimization to Prevent Catastrophic Forgetting
par: Sabbaghi, Mahdi, et autres
Publié: (2026)

Catastrophic Forgetting Mitigation via Discrepancy-Weighted Experience Replay
par: Xu, Xinrun, et autres
Publié: (2025)

Unlocking the Power of Function Vectors for Characterizing and Mitigating Catastrophic Forgetting in Continual Instruction Tuning
par: Jiang, Gangwei, et autres
Publié: (2025)

Analyzing and Reducing Catastrophic Forgetting in Parameter Efficient Tuning
par: Ren, Weijieying, et autres
Publié: (2024)

FlexFed: Mitigating Catastrophic Forgetting in Heterogeneous Federated Learning in Pervasive Computing Environments
par: Alosaime, Sara, et autres
Publié: (2025)

An Efficient Rehearsal Scheme for Catastrophic Forgetting Mitigation during Multi-stage Fine-tuning
par: Bai, Andrew, et autres
Publié: (2024)

Avoid Catastrophic Forgetting with Rank-1 Fisher from Diffusion Models
par: Wang, Zekun, et autres
Publié: (2025)

Continual Deep Reinforcement Learning to Prevent Catastrophic Forgetting in Jamming Mitigation
par: Davaslioglu, Kemal, et autres
Publié: (2024)

Continual Learning and Catastrophic Forgetting
par: van de Ven, Gido M., et autres
Publié: (2024)

LLM-AutoDP: Automatic Data Processing via LLM Agents for Model Fine-tuning
par: Huang, Wei, et autres
Publié: (2026)

Eidetic Learning: an Efficient and Provable Solution to Catastrophic Forgetting
par: Dronen, Nicholas, et autres
Publié: (2025)

Multi-Head Attention as a Source of Catastrophic Forgetting in MoE Transformers
par: Chen, Anrui, et autres
Publié: (2026)

CURLoRA: Stable LLM Continual Fine-Tuning and Catastrophic Forgetting Mitigation
par: Fawi, Muhammad
Publié: (2024)

Holographic Knowledge Manifolds: A Novel Pipeline for Continual Learning Without Catastrophic Forgetting in Large Language Models
par: Arndt, Justin
Publié: (2025)

The Joint Effect of Task Similarity and Overparameterization on Catastrophic Forgetting -- An Analytical Model
par: Goldfarb, Daniel, et autres
Publié: (2024)

Context Channel Capacity: An Information-Theoretic Framework for Understanding Catastrophic Forgetting
par: Cheng, Ran
Publié: (2026)

Evolutionary Strategies lead to Catastrophic Forgetting in LLMs
par: Abdi, Immanuel, et autres
Publié: (2026)

A Conformal Predictive Measure for Assessing Catastrophic Forgetting
par: Pitsiorlas, Ioannis, et autres
Publié: (2025)

On the Implicit Adversariality of Catastrophic Forgetting in Deep Continual Learning
par: Peng, Ze, et autres
Publié: (2025)

Addressing Loss of Plasticity and Catastrophic Forgetting in Continual Learning
par: Elsayed, Mohamed, et autres
Publié: (2024)

Revisiting Catastrophic Forgetting in Continual Knowledge Graph Embedding
par: Pons, Gerard, et autres
Publié: (2026)

Quantifying Catastrophic Forgetting in IoT Intrusion Detection Systems
par: Banerjee, Sourasekhar, et autres
Publié: (2026)