MedMerge: Merging Models for Effective Transfer Learning to Medical Imaging Tasks
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908319192449024 |
|---|---|
| author | Almakky, Ibrahim Sanjeev, Santosh Hashmi, Anees Ur Rehman Qazi, Mohammad Areeb Wang, Hu Yaqub, Mohammad |
| author_facet | Almakky, Ibrahim Sanjeev, Santosh Hashmi, Anees Ur Rehman Qazi, Mohammad Areeb Wang, Hu Yaqub, Mohammad |
| contents | Transfer learning has become a powerful tool to initialize deep learning models to achieve faster convergence and higher performance. This is especially useful in the medical imaging analysis domain, where data scarcity limits possible performance gains for deep learning models. Some advancements have been made in boosting the transfer learning performance gain by merging models starting from the same initialization. However, in the medical imaging analysis domain, there is an opportunity to merge models starting from different initializations, thus combining the features learned from different tasks. In this work, we propose MedMerge, a method whereby the weights of different models can be merged, and their features can be effectively utilized to boost performance on a new task. With MedMerge, we learn kernel-level weights that can later be used to merge the models into a single model, even when starting from different initializations. Testing on various medical imaging analysis tasks, we show that our merged model can achieve significant performance gains, with up to 7% improvement on the F1 score. The code implementation of this work is available at github.com/BioMedIA-MBZUAI/MedMerge. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_11646 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | MedMerge: Merging Models for Effective Transfer Learning to Medical Imaging Tasks Almakky, Ibrahim Sanjeev, Santosh Hashmi, Anees Ur Rehman Qazi, Mohammad Areeb Wang, Hu Yaqub, Mohammad Computer Vision and Pattern Recognition Transfer learning has become a powerful tool to initialize deep learning models to achieve faster convergence and higher performance. This is especially useful in the medical imaging analysis domain, where data scarcity limits possible performance gains for deep learning models. Some advancements have been made in boosting the transfer learning performance gain by merging models starting from the same initialization. However, in the medical imaging analysis domain, there is an opportunity to merge models starting from different initializations, thus combining the features learned from different tasks. In this work, we propose MedMerge, a method whereby the weights of different models can be merged, and their features can be effectively utilized to boost performance on a new task. With MedMerge, we learn kernel-level weights that can later be used to merge the models into a single model, even when starting from different initializations. Testing on various medical imaging analysis tasks, we show that our merged model can achieve significant performance gains, with up to 7% improvement on the F1 score. The code implementation of this work is available at github.com/BioMedIA-MBZUAI/MedMerge. |
| title | MedMerge: Merging Models for Effective Transfer Learning to Medical Imaging Tasks |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2403.11646 |