Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2509.11406 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914036544700416 |
|---|---|
| author | Fürböck, Christoph Weiser, Paul Mitic, Branko Seeböck, Philipp Helbich, Thomas Langs, Georg |
| author_facet | Fürböck, Christoph Weiser, Paul Mitic, Branko Seeböck, Philipp Helbich, Thomas Langs, Georg |
| contents | In real world clinical environments, training and applying deep learning models on multi-modal medical imaging data often struggles with partially incomplete data. Standard approaches either discard missing samples, require imputation or repurpose dropout learning schemes, limiting robustness and generalizability. To address this, we propose a hypernetwork-based method that dynamically generates task-specific classification models conditioned on the set of available modalities. Instead of training a fixed model, a hypernetwork learns to predict the parameters of a task model adapted to available modalities, enabling training and inference on all samples, regardless of completeness. We compare this approach with (1) models trained only on complete data, (2) state of the art channel dropout methods, and (3) an imputation-based method, using artificially incomplete datasets to systematically analyze robustness to missing modalities. Results demonstrate superior adaptability of our method, outperforming state of the art approaches with an absolute increase in accuracy of up to 8% when trained on a dataset with 25% completeness (75% of training data with missing modalities). By enabling a single model to generalize across all modality configurations, our approach provides an efficient solution for real-world multi-modal medical data analysis. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_11406 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | No Modality Left Behind: Dynamic Model Generation for Incomplete Medical Data Fürböck, Christoph Weiser, Paul Mitic, Branko Seeböck, Philipp Helbich, Thomas Langs, Georg Computer Vision and Pattern Recognition In real world clinical environments, training and applying deep learning models on multi-modal medical imaging data often struggles with partially incomplete data. Standard approaches either discard missing samples, require imputation or repurpose dropout learning schemes, limiting robustness and generalizability. To address this, we propose a hypernetwork-based method that dynamically generates task-specific classification models conditioned on the set of available modalities. Instead of training a fixed model, a hypernetwork learns to predict the parameters of a task model adapted to available modalities, enabling training and inference on all samples, regardless of completeness. We compare this approach with (1) models trained only on complete data, (2) state of the art channel dropout methods, and (3) an imputation-based method, using artificially incomplete datasets to systematically analyze robustness to missing modalities. Results demonstrate superior adaptability of our method, outperforming state of the art approaches with an absolute increase in accuracy of up to 8% when trained on a dataset with 25% completeness (75% of training data with missing modalities). By enabling a single model to generalize across all modality configurations, our approach provides an efficient solution for real-world multi-modal medical data analysis. |
| title | No Modality Left Behind: Dynamic Model Generation for Incomplete Medical Data |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2509.11406 |