Handling Missing Modalities in Multimodal Survival Prediction for Non-Small Cell Lung Cancer
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913058755969024 |
|---|---|
| author | Ruffini, Filippo Caruso, Camillo Maria Tacconi, Claudia Nibid, Lorenzo Miccolis, Francesca Lovino, Marta Greco, Carlo Ippolito, Edy Fiore, Michele Cortellini, Alessio Zobel, Bruno Beomonte Perrone, Giuseppe Vincenzi, Bruno Marrocco, Claudio Bria, Alessandro Ficarra, Elisa Ramella, Sara Guarrasi, Valerio Soda, Paolo |
| author_facet | Ruffini, Filippo Caruso, Camillo Maria Tacconi, Claudia Nibid, Lorenzo Miccolis, Francesca Lovino, Marta Greco, Carlo Ippolito, Edy Fiore, Michele Cortellini, Alessio Zobel, Bruno Beomonte Perrone, Giuseppe Vincenzi, Bruno Marrocco, Claudio Bria, Alessandro Ficarra, Elisa Ramella, Sara Guarrasi, Valerio Soda, Paolo |
| contents | Accurate survival prediction in Non-Small Cell Lung Cancer (NSCLC) requires integrating clinical, radiological, and histopathological data. Multimodal Deep Learning (MDL) can improve precision prognosis, but small cohorts and missing modalities limit its clinical applicability, as conventional approaches enforce complete case filtering or imputation. We present a missing-aware multimodal survival framework that combines Computed Tomography (CT), Whole-Slide Histopathology Images (WSI), and structured clinical variables for overall survival modeling in unresectable stage II-III NSCLC. The framework uses Foundation Models (FMs) for modality-specific feature extraction and a missing-aware encoding strategy that enables intermediate multimodal fusion under naturally incomplete modality profiles. By design, the architecture processes all available data without dropping patients during training or inference. Intermediate fusion outperforms unimodal baselines and both early and late fusion strategies, with the trimodal configuration reaching a C-index of 74.42. Modality-importance analyses show that the fusion model adapts its reliance on each data stream according to representation informativeness, shaped by the alignment between FM pretraining objectives and the survival task. The learned risk scores produce clinically meaningful stratification of disease progression and metastatic risk, with statistically significant log-rank tests across all modality combinations, supporting the translational relevance of the proposed framework. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_10386 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Handling Missing Modalities in Multimodal Survival Prediction for Non-Small Cell Lung Cancer Ruffini, Filippo Caruso, Camillo Maria Tacconi, Claudia Nibid, Lorenzo Miccolis, Francesca Lovino, Marta Greco, Carlo Ippolito, Edy Fiore, Michele Cortellini, Alessio Zobel, Bruno Beomonte Perrone, Giuseppe Vincenzi, Bruno Marrocco, Claudio Bria, Alessandro Ficarra, Elisa Ramella, Sara Guarrasi, Valerio Soda, Paolo Computer Vision and Pattern Recognition Artificial Intelligence Multimedia Accurate survival prediction in Non-Small Cell Lung Cancer (NSCLC) requires integrating clinical, radiological, and histopathological data. Multimodal Deep Learning (MDL) can improve precision prognosis, but small cohorts and missing modalities limit its clinical applicability, as conventional approaches enforce complete case filtering or imputation. We present a missing-aware multimodal survival framework that combines Computed Tomography (CT), Whole-Slide Histopathology Images (WSI), and structured clinical variables for overall survival modeling in unresectable stage II-III NSCLC. The framework uses Foundation Models (FMs) for modality-specific feature extraction and a missing-aware encoding strategy that enables intermediate multimodal fusion under naturally incomplete modality profiles. By design, the architecture processes all available data without dropping patients during training or inference. Intermediate fusion outperforms unimodal baselines and both early and late fusion strategies, with the trimodal configuration reaching a C-index of 74.42. Modality-importance analyses show that the fusion model adapts its reliance on each data stream according to representation informativeness, shaped by the alignment between FM pretraining objectives and the survival task. The learned risk scores produce clinically meaningful stratification of disease progression and metastatic risk, with statistically significant log-rank tests across all modality combinations, supporting the translational relevance of the proposed framework. |
| title | Handling Missing Modalities in Multimodal Survival Prediction for Non-Small Cell Lung Cancer |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence Multimedia |
| url | https://arxiv.org/abs/2601.10386 |