Copertina

Improved Supervised Fine-Tuning for Large Language Models to Mitigate Catastrophic Forgetting

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Ding, Fei, Wang, Baiqiao
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computation and Language Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Revisiting Catastrophic Forgetting in Large Language Model Tuning
di: Li, Hongyu, et al.
Pubblicazione: (2024)

Mitigating Catastrophic Forgetting in Large Language Models with Self-Synthesized Rehearsal
di: Huang, Jianheng, et al.
Pubblicazione: (2024)

Preventing Catastrophic Forgetting: Behavior-Aware Sampling for Safer Language Model Fine-Tuning
di: Pham, Anh, et al.
Pubblicazione: (2025)

CURLoRA: Stable LLM Continual Fine-Tuning and Catastrophic Forgetting Mitigation
di: Fawi, Muhammad
Pubblicazione: (2024)

Keep the General, Inject the Specific: Structured Dialogue Fine-Tuning for Knowledge Injection without Catastrophic Forgetting
di: Hong, Yijie, et al.
Pubblicazione: (2025)

Mitigating Catastrophic Forgetting in Target Language Adaptation of LLMs via Source-Shielded Updates
di: Yamaguchi, Atsuki, et al.
Pubblicazione: (2025)

Analyzing and Reducing Catastrophic Forgetting in Parameter Efficient Tuning
di: Ren, Weijieying, et al.
Pubblicazione: (2024)

Dynamic Orthogonal Continual Fine-tuning for Mitigating Catastrophic Forgettings
di: Zhang, Zhixin, et al.
Pubblicazione: (2025)

Reinforcement Fine-Tuning Naturally Mitigates Forgetting in Continual Post-Training
di: Lai, Song, et al.
Pubblicazione: (2025)

LFTF: Locating First and Then Fine-Tuning for Mitigating Gender Bias in Large Language Models
di: Qin, Zhanyue, et al.
Pubblicazione: (2025)

Noise Augmented Fine Tuning for Mitigating Hallucinations in Large Language Models
di: Khadangi, Afshin, et al.
Pubblicazione: (2025)

MoE-CT: A Novel Approach For Large Language Models Training With Resistance To Catastrophic Forgetting
di: Li, Tianhao, et al.
Pubblicazione: (2024)

SelfAug: Mitigating Catastrophic Forgetting in Retrieval-Augmented Generation via Distribution Self-Alignment
di: Huang, Yuqing, et al.
Pubblicazione: (2025)

Countering Catastrophic Forgetting of Large Language Models for Better Instruction Following via Weight-Space Model Merging
di: Lyu, Mengxian, et al.
Pubblicazione: (2026)

Assessing and Mitigating Data Memorization Risks in Fine-Tuned Large Language Models
di: Ramakrishnan, Badrinath, et al.
Pubblicazione: (2025)

Entropy-Adaptive Fine-Tuning: Resolving Confident Conflicts to Mitigate Forgetting
di: Diao, Muxi, et al.
Pubblicazione: (2026)

Improving Linguistic Diversity of Large Language Models with Possibility Exploration Fine-Tuning
di: Mai, Long, et al.
Pubblicazione: (2024)

Beyond Fine-Tuning: Effective Strategies for Mitigating Hallucinations in Large Language Models for Data Analytics
di: Rumiantsau, Mikhail, et al.
Pubblicazione: (2024)

Analyzing Mitigation Strategies for Catastrophic Forgetting in End-to-End Training of Spoken Language Models
di: Hsiao, Chi-Yuan, et al.
Pubblicazione: (2025)

Phased Instruction Fine-Tuning for Large Language Models
di: Pang, Wei, et al.
Pubblicazione: (2024)

Supervised Fine-Tuning versus Reinforcement Learning: A Study of Post-Training Methods for Large Language Models
di: Jiang, Haitao, et al.
Pubblicazione: (2026)

Improving Large Language Models with Concept-Aware Fine-Tuning
di: Chen, Michael K., et al.
Pubblicazione: (2025)

Memorization in Fine-Tuned Large Language Models
di: Savine, Danil
Pubblicazione: (2025)

Model Editing at Scale leads to Gradual and Catastrophic Forgetting
di: Gupta, Akshat, et al.
Pubblicazione: (2024)

Safety-Aware Fine-Tuning of Large Language Models
di: Choi, Hyeong Kyu, et al.
Pubblicazione: (2024)

Dynamic Adaptive Optimization for Effective Sentiment Analysis Fine-Tuning on Large Language Models
di: Ding, Hongcheng, et al.
Pubblicazione: (2024)

Evolutionary Strategies lead to Catastrophic Forgetting in LLMs
di: Abdi, Immanuel, et al.
Pubblicazione: (2026)

Balancing Speciality and Versatility: A Coarse to Fine Framework for Mitigating Catastrophic Forgetting in Large Language Models
di: Zhang, Hengyuan, et al.
Pubblicazione: (2024)

RobustFT: Robust Supervised Fine-tuning for Large Language Models under Noisy Response
di: Luo, Junyu, et al.
Pubblicazione: (2024)

Fine-Tuning or Fine-Failing? Debunking Performance Myths in Large Language Models
di: Barnett, Scott, et al.
Pubblicazione: (2024)

LexInstructEval: Lexical Instruction Following Evaluation for Large Language Models
di: Ren, Huimin, et al.
Pubblicazione: (2025)

Scaling Data Diversity for Fine-Tuning Language Models in Human Alignment
di: Song, Feifan, et al.
Pubblicazione: (2024)

KnowTuning: Knowledge-aware Fine-tuning for Large Language Models
di: Lyu, Yougang, et al.
Pubblicazione: (2024)

Taiyi: A Bilingual Fine-Tuned Large Language Model for Diverse Biomedical Tasks
di: Luo, Ling, et al.
Pubblicazione: (2023)

Large Language Models for Anomaly Detection in Computational Workflows: from Supervised Fine-Tuning to In-Context Learning
di: Jin, Hongwei, et al.
Pubblicazione: (2024)

Reversing Large Language Models for Efficient Training and Fine-Tuning
di: Gal, Eshed, et al.
Pubblicazione: (2025)

Impact of Fine-Tuning Methods on Memorization in Large Language Models
di: Hou, Jie, et al.
Pubblicazione: (2025)

Supervised Fine Tuning of Large Language Models for Domain Specific Knowledge Graph Construction:A Case Study on Hunan's Historical Celebrities
di: Hao, Junjie, et al.
Pubblicazione: (2025)

Proximal Supervised Fine-Tuning
di: Zhu, Wenhong, et al.
Pubblicazione: (2025)

Boosting Large Language Models with Mask Fine-Tuning
di: Zhang, Mingyuan, et al.
Pubblicazione: (2025)