Imagen de Portada

Balancing Speciality and Versatility: A Coarse to Fine Framework for Mitigating Catastrophic Forgetting in Large Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Zhang, Hengyuan, Wu, Yanru, Li, Dawei, Yang, Sak, Zhao, Rui, Jiang, Yong, Tan, Fei
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Improved Supervised Fine-Tuning for Large Language Models to Mitigate Catastrophic Forgetting
por: Ding, Fei, et al.
Publicado: (2025)

Model Tailor: Mitigating Catastrophic Forgetting in Multi-modal Large Language Models
por: Zhu, Didi, et al.
Publicado: (2024)

Mitigating Catastrophic Forgetting in Large Language Models with Self-Synthesized Rehearsal
por: Huang, Jianheng, et al.
Publicado: (2024)

An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuning
por: Luo, Yun, et al.
Publicado: (2023)

Parameter Alignment Mitigates Catastrophic Forgetting in Multilingual Expert Language Models
por: Ahuja, Sanchit, et al.
Publicado: (2026)

Model-Dowser: Data-Free Importance Probing to Mitigate Catastrophic Forgetting in Multimodal Large Language Models
por: Hwang, Hyeontaek, et al.
Publicado: (2026)

Revisiting Catastrophic Forgetting in Large Language Model Tuning
por: Li, Hongyu, et al.
Publicado: (2024)

Dynamic Orthogonal Continual Fine-tuning for Mitigating Catastrophic Forgettings
por: Zhang, Zhixin, et al.
Publicado: (2025)

Mitigating Catastrophic Forgetting in Continual Learning through Model Growth
por: Süalp, Ege, et al.
Publicado: (2025)

Sharpness-Aware Pretraining Mitigates Catastrophic Forgetting
por: Watts, Ishaan, et al.
Publicado: (2026)

CURLoRA: Stable LLM Continual Fine-Tuning and Catastrophic Forgetting Mitigation
por: Fawi, Muhammad
Publicado: (2024)

Preventing Catastrophic Forgetting: Behavior-Aware Sampling for Safer Language Model Fine-Tuning
por: Pham, Anh, et al.
Publicado: (2025)

Mitigating Catastrophic Forgetting in Multi-domain Chinese Spelling Correction by Multi-stage Knowledge Transfer Framework
por: Xing, Peng, et al.
Publicado: (2024)

Analyzing Mitigation Strategies for Catastrophic Forgetting in End-to-End Training of Spoken Language Models
por: Hsiao, Chi-Yuan, et al.
Publicado: (2025)

Mechanistic Analysis of Catastrophic Forgetting in Large Language Models During Continual Fine-tuning
por: Imanov, Olaf Yunus Laitinen
Publicado: (2026)

Mitigating Catastrophic Forgetting in Target Language Adaptation of LLMs via Source-Shielded Updates
por: Yamaguchi, Atsuki, et al.
Publicado: (2025)

More Than Catastrophic Forgetting: Integrating General Capabilities For Domain-Specific LLMs
por: Liu, Chengyuan, et al.
Publicado: (2024)

MoE-CT: A Novel Approach For Large Language Models Training With Resistance To Catastrophic Forgetting
por: Li, Tianhao, et al.
Publicado: (2024)

Understanding Catastrophic Forgetting in Language Models via Implicit Inference
por: Kotha, Suhas, et al.
Publicado: (2023)

Countering Catastrophic Forgetting of Large Language Models for Better Instruction Following via Weight-Space Model Merging
por: Lyu, Mengxian, et al.
Publicado: (2026)

Mitigating Catastrophic Forgetting in Mathematical Reasoning Finetuning through Mixed Training
por: Reynolds, John Graham
Publicado: (2025)

EFUF: Efficient Fine-grained Unlearning Framework for Mitigating Hallucinations in Multimodal Large Language Models
por: Xing, Shangyu, et al.
Publicado: (2024)

Mitigating Catastrophic Forgetting in Large Language Models with Forgetting-aware Pruning
por: Huang, Wei, et al.
Publicado: (2025)

Survey of Specialized Large Language Model
por: Yang, Chenghan, et al.
Publicado: (2025)

Locate-then-Merge: Neuron-Level Parameter Fusion for Mitigating Catastrophic Forgetting in Multimodal LLMs
por: Yu, Zeping, et al.
Publicado: (2025)

Conditions for Catastrophic Forgetting in Multilingual Translation
por: Liu, Danni, et al.
Publicado: (2025)

Mitigating Forgetting in LLM Fine-Tuning via Low-Perplexity Token Learning
por: Wu, Chao-Chung, et al.
Publicado: (2025)

SelfAug: Mitigating Catastrophic Forgetting in Retrieval-Augmented Generation via Distribution Self-Alignment
por: Huang, Yuqing, et al.
Publicado: (2025)

A Comparative Empirical Study of Catastrophic Forgetting Mitigation in Sequential Task Adaptation for Continual Natural Language Processing Systems
por: Abrahamyan, Aram, et al.
Publicado: (2026)

Coarse-to-Fine Highlighting: Reducing Knowledge Hallucination in Large Language Models
por: Lv, Qitan, et al.
Publicado: (2024)

Reinforcement Fine-Tuning Naturally Mitigates Forgetting in Continual Post-Training
por: Lai, Song, et al.
Publicado: (2025)

Towards Coarse-to-Fine Evaluation of Inference Efficiency for Large Language Models
por: Chen, Yushuo, et al.
Publicado: (2024)

Catastrophic Forgetting in LLMs: A Comparative Analysis Across Language Tasks
por: Haque, Naimul
Publicado: (2025)

Dynamic Expert Specialization: Towards Catastrophic Forgetting-Free Multi-Domain MoE Adaptation
por: Li, Junzhuo, et al.
Publicado: (2025)

Model Editing at Scale leads to Gradual and Catastrophic Forgetting
por: Gupta, Akshat, et al.
Publicado: (2024)

Analyzing and Reducing Catastrophic Forgetting in Parameter Efficient Tuning
por: Ren, Weijieying, et al.
Publicado: (2024)

BA-LoRA: Bias-Alleviating Low-Rank Adaptation to Mitigate Catastrophic Inheritance in Large Language Models
por: Chang, Yupeng, et al.
Publicado: (2024)

HBO: Hierarchical Balancing Optimization for Fine-Tuning Large Language Models
por: Wang, Weixuan, et al.
Publicado: (2025)

OPLoRA: Orthogonal Projection LoRA Prevents Catastrophic Forgetting during Parameter-Efficient Fine-Tuning
por: Xiong, Yifeng, et al.
Publicado: (2025)

Mitigating Reversal Curse in Large Language Models via Semantic-aware Permutation Training
por: Guo, Qingyan, et al.
Publicado: (2024)