Multi-view causal representation learning with partial observability

Yao D, Xu D, Lachapelle S, Magliacane S, Taslakian P, Martius G, Kügelgen J von, Locatello F. Multi-view causal representation learning with partial observability. arXiv, 2311.04056.

Download (ext.)

Preprint | Submitted | English
Author
Yao, DinglingISTA; Xu, Danru; Lachapelle, Sébastien; Magliacane, Sara; Taslakian, Perouz; Martius, Georg; Kügelgen, Julius von; Locatello, FrancescoISTA

Corresponding author has ISTA affiliation

Department
Abstract
We present a unified framework for studying the identifiability of representations learned from simultaneously observed views, such as different data modalities. We allow a partially observed setting in which each view constitutes a nonlinear mixture of a subset of underlying latent variables, which can be causally related. We prove that the information shared across all subsets of any number of views can be learned up to a smooth bijection using contrastive learning and a single encoder per view. We also provide graphical criteria indicating which latent variables can be identified through a simple set of rules, which we refer to as identifiability algebra. Our general framework and theoretical results unify and extend several previous works on multi-view nonlinear ICA, disentanglement, and causal representation learning. We experimentally validate our claims on numerical, image, and multi-modal data sets. Further, we demonstrate that the performance of prior methods is recovered in different special cases of our setup. Overall, we find that access to multiple partial views enables us to identify a more fine-grained representation, under the generally milder assumption of partial observability.
Publishing Year
Date Published
2023-11-07
Journal Title
arXiv
Acknowledgement
This work was initiated at the Second Bellairs Workshop on Causality held at the Bellairs Research Institute, January 6–13, 2022; we thank all workshop participants for providing a stimulating research environment. Further, we thank Cian Eastwood, Luigi Gresele, Stefano Soatto, Marco Bagatella, and A. René Geist for helpful discussion. GM is a member of the Machine Learning Cluster of Excellence, EXC number 2064/1 – Project number 390727645. JvK and GM acknowledge support from the German Federal Ministry of Education and Research (BMBF) through the Tübingen AI Center (FKZ: 01IS18039B). The research of DX and SM was supported by the Air Force Office of Scientific Research under award number FA8655-22-1-7155. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the United States Air Force. We also thank SURF for the support in using the Dutch National Supercomputer Snellius. DY was supported by an Amazon fellowship and the International Max Planck Research School for Intelligent Systems (IMPRS-IS). Work done outside of Amazon. SL was supported by an IVADO excellence PhD scholarship and by Samsung Electronics Co., Ldt.
Article Number
2311.04056
IST-REx-ID

Cite this

Yao D, Xu D, Lachapelle S, et al. Multi-view causal representation learning with partial observability. arXiv. doi:10.48550/arXiv.2311.04056
Yao, D., Xu, D., Lachapelle, S., Magliacane, S., Taslakian, P., Martius, G., … Locatello, F. (n.d.). Multi-view causal representation learning with partial observability. arXiv. https://doi.org/10.48550/arXiv.2311.04056
Yao, Dingling, Danru Xu, Sébastien Lachapelle, Sara Magliacane, Perouz Taslakian, Georg Martius, Julius von Kügelgen, and Francesco Locatello. “Multi-View Causal Representation Learning with Partial Observability.” ArXiv, n.d. https://doi.org/10.48550/arXiv.2311.04056.
D. Yao et al., “Multi-view causal representation learning with partial observability,” arXiv. .
Yao D, Xu D, Lachapelle S, Magliacane S, Taslakian P, Martius G, Kügelgen J von, Locatello F. Multi-view causal representation learning with partial observability. arXiv, 2311.04056.
Yao, Dingling, et al. “Multi-View Causal Representation Learning with Partial Observability.” ArXiv, 2311.04056, doi:10.48550/arXiv.2311.04056.
All files available under the following license(s):
Copyright Statement:
This Item is protected by copyright and/or related rights. [...]

Link(s) to Main File(s)
Access Level
OA Open Access

Export

Marked Publications

Open Data ISTA Research Explorer

Sources

arXiv 2311.04056

Search this title in

Google Scholar