Generalized Deep Multi-view Clustering via Causal Learning with Partially Aligned Cross-view Correspondence

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yang, Xihong, Wang, Siwei, Jin, Jiaqi, Wang, Fangdi, Liu, Tianrui, Jin, Yueming, Liu, Xinwang, Zhu, En, He, Kunlun
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916958000119808
author Yang, Xihong
Wang, Siwei
Jin, Jiaqi
Wang, Fangdi
Liu, Tianrui
Jin, Yueming
Liu, Xinwang
Zhu, En
He, Kunlun
author_facet Yang, Xihong
Wang, Siwei
Jin, Jiaqi
Wang, Fangdi
Liu, Tianrui
Jin, Yueming
Liu, Xinwang
Zhu, En
He, Kunlun
contents Multi-view clustering (MVC) aims to explore the common clustering structure across multiple views. Many existing MVC methods heavily rely on the assumption of view consistency, where alignments for corresponding samples across different views are ordered in advance. However, real-world scenarios often present a challenge as only partial data is consistently aligned across different views, restricting the overall clustering performance. In this work, we consider the model performance decreasing phenomenon caused by data order shift (i.e., from fully to partially aligned) as a generalized multi-view clustering problem. To tackle this problem, we design a causal multi-view clustering network, termed CauMVC. We adopt a causal modeling approach to understand multi-view clustering procedure. To be specific, we formulate the partially aligned data as an intervention and multi-view clustering with partially aligned data as an post-intervention inference. However, obtaining invariant features directly can be challenging. Thus, we design a Variational Auto-Encoder for causal learning by incorporating an encoder from existing information to estimate the invariant features. Moreover, a decoder is designed to perform the post-intervention inference. Lastly, we design a contrastive regularizer to capture sample correlations. To the best of our knowledge, this paper is the first work to deal generalized multi-view clustering via causal learning. Empirical experiments on both fully and partially aligned data illustrate the strong generalization and effectiveness of CauMVC.
format Preprint
id arxiv_https___arxiv_org_abs_2509_16022
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Generalized Deep Multi-view Clustering via Causal Learning with Partially Aligned Cross-view Correspondence
Yang, Xihong
Wang, Siwei
Jin, Jiaqi
Wang, Fangdi
Liu, Tianrui
Jin, Yueming
Liu, Xinwang
Zhu, En
He, Kunlun
Computer Vision and Pattern Recognition
Multi-view clustering (MVC) aims to explore the common clustering structure across multiple views. Many existing MVC methods heavily rely on the assumption of view consistency, where alignments for corresponding samples across different views are ordered in advance. However, real-world scenarios often present a challenge as only partial data is consistently aligned across different views, restricting the overall clustering performance. In this work, we consider the model performance decreasing phenomenon caused by data order shift (i.e., from fully to partially aligned) as a generalized multi-view clustering problem. To tackle this problem, we design a causal multi-view clustering network, termed CauMVC. We adopt a causal modeling approach to understand multi-view clustering procedure. To be specific, we formulate the partially aligned data as an intervention and multi-view clustering with partially aligned data as an post-intervention inference. However, obtaining invariant features directly can be challenging. Thus, we design a Variational Auto-Encoder for causal learning by incorporating an encoder from existing information to estimate the invariant features. Moreover, a decoder is designed to perform the post-intervention inference. Lastly, we design a contrastive regularizer to capture sample correlations. To the best of our knowledge, this paper is the first work to deal generalized multi-view clustering via causal learning. Empirical experiments on both fully and partially aligned data illustrate the strong generalization and effectiveness of CauMVC.
title Generalized Deep Multi-view Clustering via Causal Learning with Partially Aligned Cross-view Correspondence
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2509.16022