Causal Representation Learning from Multimodal Biomedical Observations

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Sun, Yuewen, Kong, Lingjing, Chen, Guangyi, Li, Loka, Luo, Gongxu, Li, Zijian, Zhang, Yixuan, Zheng, Yujia, Yang, Mengyue, Stojanov, Petar, Segal, Eran, Xing, Eric P., Zhang, Kun
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915199407095808
author Sun, Yuewen
Kong, Lingjing
Chen, Guangyi
Li, Loka
Luo, Gongxu
Li, Zijian
Zhang, Yixuan
Zheng, Yujia
Yang, Mengyue
Stojanov, Petar
Segal, Eran
Xing, Eric P.
Zhang, Kun
author_facet Sun, Yuewen
Kong, Lingjing
Chen, Guangyi
Li, Loka
Luo, Gongxu
Li, Zijian
Zhang, Yixuan
Zheng, Yujia
Yang, Mengyue
Stojanov, Petar
Segal, Eran
Xing, Eric P.
Zhang, Kun
contents Prevalent in biomedical applications (e.g., human phenotype research), multimodal datasets can provide valuable insights into the underlying physiological mechanisms. However, current machine learning (ML) models designed to analyze these datasets often lack interpretability and identifiability guarantees, which are essential for biomedical research. Recent advances in causal representation learning have shown promise in identifying interpretable latent causal variables with formal theoretical guarantees. Unfortunately, most current work on multimodal distributions either relies on restrictive parametric assumptions or yields only coarse identification results, limiting their applicability to biomedical research that favors a detailed understanding of the mechanisms. In this work, we aim to develop flexible identification conditions for multimodal data and principled methods to facilitate the understanding of biomedical datasets. Theoretically, we consider a nonparametric latent distribution (c.f., parametric assumptions in previous work) that allows for causal relationships across potentially different modalities. We establish identifiability guarantees for each latent component, extending the subspace identification results from previous work. Our key theoretical contribution is the structural sparsity of causal connections between modalities, which, as we will discuss, is natural for a large collection of biomedical systems. Empirically, we present a practical framework to instantiate our theoretical insights. We demonstrate the effectiveness of our approach through extensive experiments on both numerical and synthetic datasets. Results on a real-world human phenotype dataset are consistent with established biomedical research, validating our theoretical and methodological framework.
format Preprint
id arxiv_https___arxiv_org_abs_2411_06518
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Causal Representation Learning from Multimodal Biomedical Observations
Sun, Yuewen
Kong, Lingjing
Chen, Guangyi
Li, Loka
Luo, Gongxu
Li, Zijian
Zhang, Yixuan
Zheng, Yujia
Yang, Mengyue
Stojanov, Petar
Segal, Eran
Xing, Eric P.
Zhang, Kun
Machine Learning
Quantitative Methods
Methodology
Prevalent in biomedical applications (e.g., human phenotype research), multimodal datasets can provide valuable insights into the underlying physiological mechanisms. However, current machine learning (ML) models designed to analyze these datasets often lack interpretability and identifiability guarantees, which are essential for biomedical research. Recent advances in causal representation learning have shown promise in identifying interpretable latent causal variables with formal theoretical guarantees. Unfortunately, most current work on multimodal distributions either relies on restrictive parametric assumptions or yields only coarse identification results, limiting their applicability to biomedical research that favors a detailed understanding of the mechanisms. In this work, we aim to develop flexible identification conditions for multimodal data and principled methods to facilitate the understanding of biomedical datasets. Theoretically, we consider a nonparametric latent distribution (c.f., parametric assumptions in previous work) that allows for causal relationships across potentially different modalities. We establish identifiability guarantees for each latent component, extending the subspace identification results from previous work. Our key theoretical contribution is the structural sparsity of causal connections between modalities, which, as we will discuss, is natural for a large collection of biomedical systems. Empirically, we present a practical framework to instantiate our theoretical insights. We demonstrate the effectiveness of our approach through extensive experiments on both numerical and synthetic datasets. Results on a real-world human phenotype dataset are consistent with established biomedical research, validating our theoretical and methodological framework.
title Causal Representation Learning from Multimodal Biomedical Observations
topic Machine Learning
Quantitative Methods
Methodology
url https://arxiv.org/abs/2411.06518