Copertina

Keep the General, Inject the Specific: Structured Dialogue Fine-Tuning for Knowledge Injection without Catastrophic Forgetting

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Hong, Yijie, Yin, Xiaofei, Wang, Xinzhong, Tu, Yi, Guo, Ya, Duan, Sufeng, Wang, Weiqiang, Fang, Lingyong, Wang, Depeng, Zhu, Huijia
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computation and Language Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

InsightVision: A Comprehensive, Multi-Level Chinese-based Benchmark for Evaluating Implicit Visual Semantics in Large Vision Language Models
di: Yin, Xiaofei, et al.
Pubblicazione: (2025)

Fine Tuning without Catastrophic Forgetting via Selective Low Rank Adaptation
di: Bafghi, Reza Akbarian, et al.
Pubblicazione: (2025)

Improved Supervised Fine-Tuning for Large Language Models to Mitigate Catastrophic Forgetting
di: Ding, Fei, et al.
Pubblicazione: (2025)

Up to 36x Speedup: Mask-based Parallel Inference Paradigm for Key Information Extraction in MLLMs
di: Wang, Xinzhong, et al.
Pubblicazione: (2026)

Judge Before Answer: Can MLLM Discern the False Premise in Question?
di: Li, Jidong, et al.
Pubblicazione: (2025)

Mitigating Catastrophic Forgetting with Adaptive Transformer Block Expansion in Federated Fine-Tuning
di: Huo, Yujia, et al.
Pubblicazione: (2025)

Bayesian Parameter-Efficient Fine-Tuning for Overcoming Catastrophic Forgetting
di: Chen, Haolin, et al.
Pubblicazione: (2024)

Joint Flashback Adaptation for Forgetting-Resistant Instruction Tuning
di: Zhao, Yukun, et al.
Pubblicazione: (2025)

Analyzing and Reducing Catastrophic Forgetting in Parameter Efficient Tuning
di: Ren, Weijieying, et al.
Pubblicazione: (2024)

Revisiting Catastrophic Forgetting in Large Language Model Tuning
di: Li, Hongyu, et al.
Pubblicazione: (2024)

Actions as Language: Fine-Tuning VLMs into VLAs Without Catastrophic Forgetting
di: Hancock, Asher J., et al.
Pubblicazione: (2025)

Overcoming Catastrophic Forgetting in Visual Continual Learning with Reinforcement Fine-Tuning
di: Lou, Meng, et al.
Pubblicazione: (2026)

CURLoRA: Stable LLM Continual Fine-Tuning and Catastrophic Forgetting Mitigation
di: Fawi, Muhammad
Pubblicazione: (2024)

On Catastrophic Forgetting in Low-Rank Decomposition-Based Parameter-Efficient Fine-Tuning
di: Ahmad, Muhammad, et al.
Pubblicazione: (2026)

Parameter Efficient Fine-tuning of Self-supervised ViTs without Catastrophic Forgetting
di: Bafghi, Reza Akbarian, et al.
Pubblicazione: (2024)

Don't Forget the Nonlinearity: Unlocking Activation Functions in Efficient Fine-Tuning
di: Yin, Bo, et al.
Pubblicazione: (2025)

Preventing Catastrophic Forgetting: Behavior-Aware Sampling for Safer Language Model Fine-Tuning
di: Pham, Anh, et al.
Pubblicazione: (2025)

SMoLoRA: Exploring and Defying Dual Catastrophic Forgetting in Continual Visual Instruction Tuning
di: Wang, Ziqi, et al.
Pubblicazione: (2024)

KnowTuning: Knowledge-aware Fine-tuning for Large Language Models
di: Lyu, Yougang, et al.
Pubblicazione: (2024)

Overcoming Catastrophic Forgetting by Exemplar Selection in Task-oriented Dialogue System
di: Chen, Chen, et al.
Pubblicazione: (2024)

More Than Catastrophic Forgetting: Integrating General Capabilities For Domain-Specific LLMs
di: Liu, Chengyuan, et al.
Pubblicazione: (2024)

Mitigating Catastrophic Forgetting in Large Language Models with Forgetting-aware Pruning
di: Huang, Wei, et al.
Pubblicazione: (2025)

EchoingPixels: Cross-Modal Adaptive Token Reduction for Efficient Audio-Visual LLMs
di: Gong, Chao, et al.
Pubblicazione: (2025)

Catastrophic Forgetting in Kolmogorov-Arnold Networks
di: Rahman, Mohammad Marufur, et al.
Pubblicazione: (2025)

MuseumMaker: Continual Style Customization without Catastrophic Forgetting
di: Liu, Chenxi, et al.
Pubblicazione: (2024)

KoReA-SFL: Knowledge Replay-based Split Federated Learning Against Catastrophic Forgetting
di: Xia, Zeke, et al.
Pubblicazione: (2024)

Revisiting Catastrophic Forgetting in Continual Knowledge Graph Embedding
di: Pons, Gerard, et al.
Pubblicazione: (2026)

Dynamic Orthogonal Continual Fine-tuning for Mitigating Catastrophic Forgettings
di: Zhang, Zhixin, et al.
Pubblicazione: (2025)

Injecting New Knowledge into Large Language Models via Supervised Fine-Tuning
di: Mecklenburg, Nick, et al.
Pubblicazione: (2024)

MetaGDPO: Alleviating Catastrophic Forgetting with Metacognitive Knowledge through Group Direct Preference Optimization
di: Zhang, Lanxue, et al.
Pubblicazione: (2025)

Zooming without Zooming: Region-to-Image Distillation for Fine-Grained Multimodal Perception
di: Wei, Lai, et al.
Pubblicazione: (2026)

OPLoRA: Orthogonal Projection LoRA Prevents Catastrophic Forgetting during Parameter-Efficient Fine-Tuning
di: Xiong, Yifeng, et al.
Pubblicazione: (2025)

When Machine Unlearning Meets Retrieval-Augmented Generation (RAG): Keep Secret or Forget Knowledge?
di: Wang, Shang, et al.
Pubblicazione: (2024)

Cyclical Weight Consolidation: Towards Solving Catastrophic Forgetting in Serial Federated Learning
di: Song, Haoyue, et al.
Pubblicazione: (2024)

Fine-Tuning or Retrieval? Comparing Knowledge Injection in LLMs
di: Ovadia, Oded, et al.
Pubblicazione: (2023)

Forget the Data and Fine-Tuning! Just Fold the Network to Compress
di: Wang, Dong, et al.
Pubblicazione: (2025)

FedRef: Bayesian Fine-Tuning using a Reference Model to Mitigate Catastrophic Forgetting for Heterogeneous Federated Learning
di: Yoon, Taehwan, et al.
Pubblicazione: (2025)

Continual Learning and Catastrophic Forgetting
di: van de Ven, Gido M., et al.
Pubblicazione: (2024)

Measuring Catastrophic Forgetting in Cross-Lingual Transfer Paradigms: Exploring Tuning Strategies
di: Koloski, Boshko, et al.
Pubblicazione: (2023)

PanAdapter: Two-Stage Fine-Tuning with Spatial-Spectral Priors Injecting for Pansharpening
di: Wu, RuoCheng, et al.
Pubblicazione: (2024)