Model Tailor: Mitigating Catastrophic Forgetting in Multi-modal Large Language Models
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | Zhu, Didi, Sun, Zhongyi, Li, Zexi, Shen, Tao, Yan, Ke, Ding, Shouhong, Kuang, Kun, Wu, Chao |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
Documents similaires
Revisiting Catastrophic Forgetting in Large Language Model Tuning
par: Li, Hongyu, et autres
Publié: (2024)
par: Li, Hongyu, et autres
Publié: (2024)
Improved Supervised Fine-Tuning for Large Language Models to Mitigate Catastrophic Forgetting
par: Ding, Fei, et autres
Publié: (2025)
par: Ding, Fei, et autres
Publié: (2025)
Mitigating Catastrophic Forgetting in Large Language Models with Self-Synthesized Rehearsal
par: Huang, Jianheng, et autres
Publié: (2024)
par: Huang, Jianheng, et autres
Publié: (2024)
Balancing Speciality and Versatility: A Coarse to Fine Framework for Mitigating Catastrophic Forgetting in Large Language Models
par: Zhang, Hengyuan, et autres
Publié: (2024)
par: Zhang, Hengyuan, et autres
Publié: (2024)
Parameter Alignment Mitigates Catastrophic Forgetting in Multilingual Expert Language Models
par: Ahuja, Sanchit, et autres
Publié: (2026)
par: Ahuja, Sanchit, et autres
Publié: (2026)
Model-Dowser: Data-Free Importance Probing to Mitigate Catastrophic Forgetting in Multimodal Large Language Models
par: Hwang, Hyeontaek, et autres
Publié: (2026)
par: Hwang, Hyeontaek, et autres
Publié: (2026)
Mitigating Catastrophic Forgetting in Continual Learning through Model Growth
par: Süalp, Ege, et autres
Publié: (2025)
par: Süalp, Ege, et autres
Publié: (2025)
Merging LoRAs like Playing LEGO: Pushing the Modularity of LoRA to Extremes Through Rank-Wise Clustering
par: Zhao, Ziyu, et autres
Publié: (2024)
par: Zhao, Ziyu, et autres
Publié: (2024)
More Than Catastrophic Forgetting: Integrating General Capabilities For Domain-Specific LLMs
par: Liu, Chengyuan, et autres
Publié: (2024)
par: Liu, Chengyuan, et autres
Publié: (2024)
Mitigating Catastrophic Forgetting in Multi-domain Chinese Spelling Correction by Multi-stage Knowledge Transfer Framework
par: Xing, Peng, et autres
Publié: (2024)
par: Xing, Peng, et autres
Publié: (2024)
Analyzing Mitigation Strategies for Catastrophic Forgetting in End-to-End Training of Spoken Language Models
par: Hsiao, Chi-Yuan, et autres
Publié: (2025)
par: Hsiao, Chi-Yuan, et autres
Publié: (2025)
Sharpness-Aware Pretraining Mitigates Catastrophic Forgetting
par: Watts, Ishaan, et autres
Publié: (2026)
par: Watts, Ishaan, et autres
Publié: (2026)
An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuning
par: Luo, Yun, et autres
Publié: (2023)
par: Luo, Yun, et autres
Publié: (2023)
Countering Catastrophic Forgetting of Large Language Models for Better Instruction Following via Weight-Space Model Merging
par: Lyu, Mengxian, et autres
Publié: (2026)
par: Lyu, Mengxian, et autres
Publié: (2026)
Understanding Catastrophic Forgetting in Language Models via Implicit Inference
par: Kotha, Suhas, et autres
Publié: (2023)
par: Kotha, Suhas, et autres
Publié: (2023)
Speech-IFEval: Evaluating Instruction-Following and Quantifying Catastrophic Forgetting in Speech-Aware Language Models
par: Lu, Ke-Han, et autres
Publié: (2025)
par: Lu, Ke-Han, et autres
Publié: (2025)
Dynamic Orthogonal Continual Fine-tuning for Mitigating Catastrophic Forgettings
par: Zhang, Zhixin, et autres
Publié: (2025)
par: Zhang, Zhixin, et autres
Publié: (2025)
Mitigating Catastrophic Forgetting in Large Language Models with Forgetting-aware Pruning
par: Huang, Wei, et autres
Publié: (2025)
par: Huang, Wei, et autres
Publié: (2025)
OmniEduBench: A Comprehensive Chinese Benchmark for Evaluating Large Language Models in Education
par: Zhang, Min, et autres
Publié: (2025)
par: Zhang, Min, et autres
Publié: (2025)
Talking to Yourself: Defying Forgetting in Large Language Models
par: Sun, Yutao, et autres
Publié: (2026)
par: Sun, Yutao, et autres
Publié: (2026)
Mitigating Catastrophic Forgetting in Target Language Adaptation of LLMs via Source-Shielded Updates
par: Yamaguchi, Atsuki, et autres
Publié: (2025)
par: Yamaguchi, Atsuki, et autres
Publié: (2025)
Preventing Catastrophic Forgetting: Behavior-Aware Sampling for Safer Language Model Fine-Tuning
par: Pham, Anh, et autres
Publié: (2025)
par: Pham, Anh, et autres
Publié: (2025)
MoE-CT: A Novel Approach For Large Language Models Training With Resistance To Catastrophic Forgetting
par: Li, Tianhao, et autres
Publié: (2024)
par: Li, Tianhao, et autres
Publié: (2024)
Mitigating Catastrophic Forgetting in Mathematical Reasoning Finetuning through Mixed Training
par: Reynolds, John Graham
Publié: (2025)
par: Reynolds, John Graham
Publié: (2025)
Mix Data or Merge Models? Balancing the Helpfulness, Honesty, and Harmlessness of Large Language Model via Model Merging
par: Yang, Jinluan, et autres
Publié: (2025)
par: Yang, Jinluan, et autres
Publié: (2025)
SelfAug: Mitigating Catastrophic Forgetting in Retrieval-Augmented Generation via Distribution Self-Alignment
par: Huang, Yuqing, et autres
Publié: (2025)
par: Huang, Yuqing, et autres
Publié: (2025)
Exploring Forgetting in Large Language Model Pre-Training
par: Liao, Chonghua, et autres
Publié: (2024)
par: Liao, Chonghua, et autres
Publié: (2024)
Model Editing at Scale leads to Gradual and Catastrophic Forgetting
par: Gupta, Akshat, et autres
Publié: (2024)
par: Gupta, Akshat, et autres
Publié: (2024)
Locate-then-Merge: Neuron-Level Parameter Fusion for Mitigating Catastrophic Forgetting in Multimodal LLMs
par: Yu, Zeping, et autres
Publié: (2025)
par: Yu, Zeping, et autres
Publié: (2025)
Conditions for Catastrophic Forgetting in Multilingual Translation
par: Liu, Danni, et autres
Publié: (2025)
par: Liu, Danni, et autres
Publié: (2025)
BA-LoRA: Bias-Alleviating Low-Rank Adaptation to Mitigate Catastrophic Inheritance in Large Language Models
par: Chang, Yupeng, et autres
Publié: (2024)
par: Chang, Yupeng, et autres
Publié: (2024)
ModelGPT: Unleashing LLM's Capabilities for Tailored Model Generation
par: Tang, Zihao, et autres
Publié: (2024)
par: Tang, Zihao, et autres
Publié: (2024)
Large Multi-modal Models Can Interpret Features in Large Multi-modal Models
par: Zhang, Kaichen, et autres
Publié: (2024)
par: Zhang, Kaichen, et autres
Publié: (2024)
Leveraging Print Debugging to Improve Code Generation in Large Language Models
par: Hu, Xueyu, et autres
Publié: (2024)
par: Hu, Xueyu, et autres
Publié: (2024)
Mechanistic Analysis of Catastrophic Forgetting in Large Language Models During Continual Fine-tuning
par: Imanov, Olaf Yunus Laitinen
Publié: (2026)
par: Imanov, Olaf Yunus Laitinen
Publié: (2026)
A Comparative Empirical Study of Catastrophic Forgetting Mitigation in Sequential Task Adaptation for Continual Natural Language Processing Systems
par: Abrahamyan, Aram, et autres
Publié: (2026)
par: Abrahamyan, Aram, et autres
Publié: (2026)
CURLoRA: Stable LLM Continual Fine-Tuning and Catastrophic Forgetting Mitigation
par: Fawi, Muhammad
Publié: (2024)
par: Fawi, Muhammad
Publié: (2024)
Erasing Without Remembering: Implicit Knowledge Forgetting in Large Language Models
par: Wang, Huazheng, et autres
Publié: (2025)
par: Wang, Huazheng, et autres
Publié: (2025)
Causality for Large Language Models
par: Wu, Anpeng, et autres
Publié: (2024)
par: Wu, Anpeng, et autres
Publié: (2024)
Catastrophic Forgetting in LLMs: A Comparative Analysis Across Language Tasks
par: Haque, Naimul
Publié: (2025)
par: Haque, Naimul
Publié: (2025)
Documents similaires
-
Revisiting Catastrophic Forgetting in Large Language Model Tuning
par: Li, Hongyu, et autres
Publié: (2024) -
Improved Supervised Fine-Tuning for Large Language Models to Mitigate Catastrophic Forgetting
par: Ding, Fei, et autres
Publié: (2025) -
Mitigating Catastrophic Forgetting in Large Language Models with Self-Synthesized Rehearsal
par: Huang, Jianheng, et autres
Publié: (2024) -
Balancing Speciality and Versatility: A Coarse to Fine Framework for Mitigating Catastrophic Forgetting in Large Language Models
par: Zhang, Hengyuan, et autres
Publié: (2024) -
Parameter Alignment Mitigates Catastrophic Forgetting in Multilingual Expert Language Models
par: Ahuja, Sanchit, et autres
Publié: (2026)