Multi-View Causal Representation Learning with Partial Observability
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2023
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866914707816841216 |
|---|---|
| author | Yao, Dingling Xu, Danru Lachapelle, Sébastien Magliacane, Sara Taslakian, Perouz Martius, Georg von Kügelgen, Julius Locatello, Francesco |
| author_facet | Yao, Dingling Xu, Danru Lachapelle, Sébastien Magliacane, Sara Taslakian, Perouz Martius, Georg von Kügelgen, Julius Locatello, Francesco |
| contents | We present a unified framework for studying the identifiability of representations learned from simultaneously observed views, such as different data modalities. We allow a partially observed setting in which each view constitutes a nonlinear mixture of a subset of underlying latent variables, which can be causally related. We prove that the information shared across all subsets of any number of views can be learned up to a smooth bijection using contrastive learning and a single encoder per view. We also provide graphical criteria indicating which latent variables can be identified through a simple set of rules, which we refer to as identifiability algebra. Our general framework and theoretical results unify and extend several previous works on multi-view nonlinear ICA, disentanglement, and causal representation learning. We experimentally validate our claims on numerical, image, and multi-modal data sets. Further, we demonstrate that the performance of prior methods is recovered in different special cases of our setup. Overall, we find that access to multiple partial views enables us to identify a more fine-grained representation, under the generally milder assumption of partial observability. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2311_04056 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Multi-View Causal Representation Learning with Partial Observability Yao, Dingling Xu, Danru Lachapelle, Sébastien Magliacane, Sara Taslakian, Perouz Martius, Georg von Kügelgen, Julius Locatello, Francesco Machine Learning Artificial Intelligence We present a unified framework for studying the identifiability of representations learned from simultaneously observed views, such as different data modalities. We allow a partially observed setting in which each view constitutes a nonlinear mixture of a subset of underlying latent variables, which can be causally related. We prove that the information shared across all subsets of any number of views can be learned up to a smooth bijection using contrastive learning and a single encoder per view. We also provide graphical criteria indicating which latent variables can be identified through a simple set of rules, which we refer to as identifiability algebra. Our general framework and theoretical results unify and extend several previous works on multi-view nonlinear ICA, disentanglement, and causal representation learning. We experimentally validate our claims on numerical, image, and multi-modal data sets. Further, we demonstrate that the performance of prior methods is recovered in different special cases of our setup. Overall, we find that access to multiple partial views enables us to identify a more fine-grained representation, under the generally milder assumption of partial observability. |
| title | Multi-View Causal Representation Learning with Partial Observability |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2311.04056 |