Saved in:
Bibliographic Details
Main Authors: Chandy, Mathew, Johnson, Michael, Shen, Judong, Mehrotra, Devan V., Zhou, Hua, Zhou, Jin, Dai, Xiaowu
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2602.00171
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • Multimodal learning combines information from multiple data modalities to improve predictive performance. However, modalities often contribute unequally and in a data dependent way, making it unclear which data modalities are genuinely informative and to what extent their contributions can be trusted. Quantifying modality level importance together with uncertainty is therefore central to interpretable and reliable multimodal learning. We introduce conformal Shapley intervals, a framework that combines Shapley values with conformal inference to construct uncertainty-aware importance intervals for each modality. Building on these intervals, we propose a modality selection procedure with a provable optimality guarantee: conditional on the observed features, the selected subset of modalities achieves performance close to that of the optimal subset. We demonstrate the effectiveness of our approach on multiple datasets, showing that it provides meaningful uncertainty quantification and strong predictive performance while relying on only a small number of informative modalities.