Self Supervised Correlation-based Permutations for Multi-View Clustering

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Eisenberg, Ran, Svirsky, Jonathan, Lindenbaum, Ofir
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910956064342016
author Eisenberg, Ran
Svirsky, Jonathan
Lindenbaum, Ofir
author_facet Eisenberg, Ran
Svirsky, Jonathan
Lindenbaum, Ofir
contents Combining data from different sources can improve data analysis tasks such as clustering. However, most of the current multi-view clustering methods are limited to specific domains or rely on a suboptimal and computationally intensive two-stage process of representation learning and clustering. We propose an end-to-end deep learning-based multi-view clustering framework for general data types (such as images and tables). Our approach involves generating meaningful fused representations using a novel permutation-based canonical correlation objective. We provide a theoretical analysis showing how the learned embeddings approximate those obtained by supervised linear discriminant analysis (LDA). Cluster assignments are learned by identifying consistent pseudo-labels across multiple views. Additionally, we establish a theoretical bound on the error caused by incorrect pseudo-labels in the unsupervised representations compared to LDA. Extensive experiments on ten multi-view clustering benchmark datasets provide empirical evidence for the effectiveness of the proposed model.
format Preprint
id arxiv_https___arxiv_org_abs_2402_16383
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Self Supervised Correlation-based Permutations for Multi-View Clustering
Eisenberg, Ran
Svirsky, Jonathan
Lindenbaum, Ofir
Machine Learning
Combining data from different sources can improve data analysis tasks such as clustering. However, most of the current multi-view clustering methods are limited to specific domains or rely on a suboptimal and computationally intensive two-stage process of representation learning and clustering. We propose an end-to-end deep learning-based multi-view clustering framework for general data types (such as images and tables). Our approach involves generating meaningful fused representations using a novel permutation-based canonical correlation objective. We provide a theoretical analysis showing how the learned embeddings approximate those obtained by supervised linear discriminant analysis (LDA). Cluster assignments are learned by identifying consistent pseudo-labels across multiple views. Additionally, we establish a theoretical bound on the error caused by incorrect pseudo-labels in the unsupervised representations compared to LDA. Extensive experiments on ten multi-view clustering benchmark datasets provide empirical evidence for the effectiveness of the proposed model.
title Self Supervised Correlation-based Permutations for Multi-View Clustering
topic Machine Learning
url https://arxiv.org/abs/2402.16383