GenKnowSub: Improving Modularity and Reusability of LLMs through General Knowledge Subtraction

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Bagherifard, Mohammadtaha, Rajabi, Sahar, Edalat, Ali, Yaghoobzadeh, Yadollah
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913973930033152
author Bagherifard, Mohammadtaha
Rajabi, Sahar
Edalat, Ali
Yaghoobzadeh, Yadollah
author_facet Bagherifard, Mohammadtaha
Rajabi, Sahar
Edalat, Ali
Yaghoobzadeh, Yadollah
contents Large language models often struggle with zero-shot generalization, and several modular approaches have been proposed to address this challenge. Yet, we hypothesize that a key limitation remains: the entanglement of general knowledge and task-specific adaptations. To overcome this, we propose a modular framework that disentangles these components by constructing a library of task-specific LoRA modules alongside a general-domain LoRA. By subtracting this general knowledge component from each task-specific module, we obtain residual modules that focus more exclusively on task-relevant information, a method we call general knowledge subtraction (GenKnowSub). Leveraging the refined task-specific modules and the Arrow routing algorithm \citep{ostapenko2024towards}, we dynamically select and combine modules for new inputs without additional training. Our studies on the Phi-3 model and standard Arrow as baselines reveal that using general knowledge LoRAs derived from diverse languages, including English, French, and German, yields consistent performance gains in both monolingual and cross-lingual settings across a wide set of benchmarks. Further experiments on Phi-2 demonstrate how GenKnowSub generalizes to weaker LLMs. The complete code and data are available at https://github.com/saharsamr/Modular-LLM.
format Preprint
id arxiv_https___arxiv_org_abs_2505_10939
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle GenKnowSub: Improving Modularity and Reusability of LLMs through General Knowledge Subtraction
Bagherifard, Mohammadtaha
Rajabi, Sahar
Edalat, Ali
Yaghoobzadeh, Yadollah
Computation and Language
Artificial Intelligence
Large language models often struggle with zero-shot generalization, and several modular approaches have been proposed to address this challenge. Yet, we hypothesize that a key limitation remains: the entanglement of general knowledge and task-specific adaptations. To overcome this, we propose a modular framework that disentangles these components by constructing a library of task-specific LoRA modules alongside a general-domain LoRA. By subtracting this general knowledge component from each task-specific module, we obtain residual modules that focus more exclusively on task-relevant information, a method we call general knowledge subtraction (GenKnowSub). Leveraging the refined task-specific modules and the Arrow routing algorithm \citep{ostapenko2024towards}, we dynamically select and combine modules for new inputs without additional training. Our studies on the Phi-3 model and standard Arrow as baselines reveal that using general knowledge LoRAs derived from diverse languages, including English, French, and German, yields consistent performance gains in both monolingual and cross-lingual settings across a wide set of benchmarks. Further experiments on Phi-2 demonstrate how GenKnowSub generalizes to weaker LLMs. The complete code and data are available at https://github.com/saharsamr/Modular-LLM.
title GenKnowSub: Improving Modularity and Reusability of LLMs through General Knowledge Subtraction
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2505.10939