Weakly-Supervised Multimodal Learning on MIMIC-CXR

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Agostini, Andrea, Chopard, Daphné, Meng, Yang, Fortin, Norbert, Shahbaba, Babak, Mandt, Stephan, Sutter, Thomas M., Vogt, Julia E.
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915022234451968
author Agostini, Andrea
Chopard, Daphné
Meng, Yang
Fortin, Norbert
Shahbaba, Babak
Mandt, Stephan
Sutter, Thomas M.
Vogt, Julia E.
author_facet Agostini, Andrea
Chopard, Daphné
Meng, Yang
Fortin, Norbert
Shahbaba, Babak
Mandt, Stephan
Sutter, Thomas M.
Vogt, Julia E.
contents Multimodal data integration and label scarcity pose significant challenges for machine learning in medical settings. To address these issues, we conduct an in-depth evaluation of the newly proposed Multimodal Variational Mixture-of-Experts (MMVM) VAE on the challenging MIMIC-CXR dataset. Our analysis demonstrates that the MMVM VAE consistently outperforms other multimodal VAEs and fully supervised approaches, highlighting its strong potential for real-world medical applications.
format Preprint
id arxiv_https___arxiv_org_abs_2411_10356
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Weakly-Supervised Multimodal Learning on MIMIC-CXR
Agostini, Andrea
Chopard, Daphné
Meng, Yang
Fortin, Norbert
Shahbaba, Babak
Mandt, Stephan
Sutter, Thomas M.
Vogt, Julia E.
Machine Learning
Multimodal data integration and label scarcity pose significant challenges for machine learning in medical settings. To address these issues, we conduct an in-depth evaluation of the newly proposed Multimodal Variational Mixture-of-Experts (MMVM) VAE on the challenging MIMIC-CXR dataset. Our analysis demonstrates that the MMVM VAE consistently outperforms other multimodal VAEs and fully supervised approaches, highlighting its strong potential for real-world medical applications.
title Weakly-Supervised Multimodal Learning on MIMIC-CXR
topic Machine Learning
url https://arxiv.org/abs/2411.10356