Training-Free Adaptation of New-Generation LLMs using Legacy Clinical Models
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915965072048128 |
|---|---|
| author | Ronaghi, Sasha Stanwyck, Chloe Aali, Asad Ronaghi, Amir Fuentes, Miguel Hernandez-Boussard, Tina Alsentzer, Emily |
| author_facet | Ronaghi, Sasha Stanwyck, Chloe Aali, Asad Ronaghi, Amir Fuentes, Miguel Hernandez-Boussard, Tina Alsentzer, Emily |
| contents | Adapting language models to the clinical domain through continued pretraining and instruction tuning requires costly retraining for each new model generation. We propose Cross-Architecture Proxy Tuning (CAPT), a model-ensembling approach that enables training-free adaptation of state-of-the-art general-domain models using existing clinical models. CAPT supports models with disjoint vocabularies, leveraging contrastive decoding to selectively inject clinically relevant signals while preserving the general-domain model's reasoning and fluency. On six clinical classification and text-generation tasks, CAPT with a new-generation general-domain model and an older-generation clinical model consistently outperforms both models individually and state-of-the-art ensembling approaches (average +17.6\% over UniTE, +41.4\% over proxy tuning across tasks). Through token-level analysis and physician case studies, we demonstrate that CAPT amplifies clinically actionable language, reduces context errors, and increases clinical specificity. This technique especially benefits healthcare institutions with constrained computational capacity that cannot support iterative clinical training and want to adopt emerging general-domain model advances. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_03423 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Training-Free Adaptation of New-Generation LLMs using Legacy Clinical Models Ronaghi, Sasha Stanwyck, Chloe Aali, Asad Ronaghi, Amir Fuentes, Miguel Hernandez-Boussard, Tina Alsentzer, Emily Computation and Language Artificial Intelligence Adapting language models to the clinical domain through continued pretraining and instruction tuning requires costly retraining for each new model generation. We propose Cross-Architecture Proxy Tuning (CAPT), a model-ensembling approach that enables training-free adaptation of state-of-the-art general-domain models using existing clinical models. CAPT supports models with disjoint vocabularies, leveraging contrastive decoding to selectively inject clinically relevant signals while preserving the general-domain model's reasoning and fluency. On six clinical classification and text-generation tasks, CAPT with a new-generation general-domain model and an older-generation clinical model consistently outperforms both models individually and state-of-the-art ensembling approaches (average +17.6\% over UniTE, +41.4\% over proxy tuning across tasks). Through token-level analysis and physician case studies, we demonstrate that CAPT amplifies clinically actionable language, reduces context errors, and increases clinical specificity. This technique especially benefits healthcare institutions with constrained computational capacity that cannot support iterative clinical training and want to adopt emerging general-domain model advances. |
| title | Training-Free Adaptation of New-Generation LLMs using Legacy Clinical Models |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2601.03423 |