Dual-Kernel Adapter: Expanding Spatial Horizons for Data-Constrained Medical Image Analysis
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912917533753344 |
|---|---|
| author | Zhu, Ziquan Zhu, Hanruo Lu, Siyuan Li, Xiang Meng, Yanda Jin, Gaojie Yin, Lu Hu, Lijie Wang, Di Liu, Lu Huang, Tianjin |
| author_facet | Zhu, Ziquan Zhu, Hanruo Lu, Siyuan Li, Xiang Meng, Yanda Jin, Gaojie Yin, Lu Hu, Lijie Wang, Di Liu, Lu Huang, Tianjin |
| contents | Adapters have become a widely adopted strategy for efficient fine-tuning of large pretrained models, particularly in resource-constrained settings. However, their performance under extreme data scarcity, common in medical imaging due to high annotation costs, privacy regulations, and fragmented datasets, remains underexplored. In this work, we present the first comprehensive study of adapter-based fine-tuning for large pretrained models in low-data medical imaging scenarios. We find that, contrary to their promise, conventional adapters can degrade performance under severe data constraints, performing even worse than simple linear probing when trained on less than 1% of the corresponding training data. Through systematic analysis, we identify a sharp reduction in Effective Receptive Field (ERF) as a key factor behind this degradation. Motivated by these findings, we propose the Dual-Kernel Adapter (DKA), a lightweight module that expands spatial context via large-kernel convolutions while preserving local detail with small-kernel counterparts. Extensive experiments across diverse classification and segmentation benchmarks show that DKA significantly outperforms existing adapter methods, establishing new leading results in both data-constrained and data-rich regimes. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_18888 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Dual-Kernel Adapter: Expanding Spatial Horizons for Data-Constrained Medical Image Analysis Zhu, Ziquan Zhu, Hanruo Lu, Siyuan Li, Xiang Meng, Yanda Jin, Gaojie Yin, Lu Hu, Lijie Wang, Di Liu, Lu Huang, Tianjin Computational Engineering, Finance, and Science Adapters have become a widely adopted strategy for efficient fine-tuning of large pretrained models, particularly in resource-constrained settings. However, their performance under extreme data scarcity, common in medical imaging due to high annotation costs, privacy regulations, and fragmented datasets, remains underexplored. In this work, we present the first comprehensive study of adapter-based fine-tuning for large pretrained models in low-data medical imaging scenarios. We find that, contrary to their promise, conventional adapters can degrade performance under severe data constraints, performing even worse than simple linear probing when trained on less than 1% of the corresponding training data. Through systematic analysis, we identify a sharp reduction in Effective Receptive Field (ERF) as a key factor behind this degradation. Motivated by these findings, we propose the Dual-Kernel Adapter (DKA), a lightweight module that expands spatial context via large-kernel convolutions while preserving local detail with small-kernel counterparts. Extensive experiments across diverse classification and segmentation benchmarks show that DKA significantly outperforms existing adapter methods, establishing new leading results in both data-constrained and data-rich regimes. |
| title | Dual-Kernel Adapter: Expanding Spatial Horizons for Data-Constrained Medical Image Analysis |
| topic | Computational Engineering, Finance, and Science |
| url | https://arxiv.org/abs/2602.18888 |