SuperCM: Improving Semi-Supervised Learning and Domain Adaptation through differentiable clustering

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Singh, Durgesh, Boubekki, Ahcène, Jenssen, Robert, Kampffmeyer, Michael
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916849834262528
author Singh, Durgesh
Boubekki, Ahcène
Jenssen, Robert
Kampffmeyer, Michael
author_facet Singh, Durgesh
Boubekki, Ahcène
Jenssen, Robert
Kampffmeyer, Michael
contents Semi-Supervised Learning (SSL) and Unsupervised Domain Adaptation (UDA) enhance the model performance by exploiting information from labeled and unlabeled data. The clustering assumption has proven advantageous for learning with limited supervision and states that data points belonging to the same cluster in a high-dimensional space should be assigned to the same category. Recent works have utilized different training mechanisms to implicitly enforce this assumption for the SSL and UDA. In this work, we take a different approach by explicitly involving a differentiable clustering module which is extended to leverage the supervised data to compute its centroids. We demonstrate the effectiveness of our straightforward end-to-end training strategy for SSL and UDA over extensive experiments and highlight its benefits, especially in low supervision regimes, both as a standalone model and as a regularizer for existing approaches.
format Preprint
id arxiv_https___arxiv_org_abs_2507_13779
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle SuperCM: Improving Semi-Supervised Learning and Domain Adaptation through differentiable clustering
Singh, Durgesh
Boubekki, Ahcène
Jenssen, Robert
Kampffmeyer, Michael
Computer Vision and Pattern Recognition
Semi-Supervised Learning (SSL) and Unsupervised Domain Adaptation (UDA) enhance the model performance by exploiting information from labeled and unlabeled data. The clustering assumption has proven advantageous for learning with limited supervision and states that data points belonging to the same cluster in a high-dimensional space should be assigned to the same category. Recent works have utilized different training mechanisms to implicitly enforce this assumption for the SSL and UDA. In this work, we take a different approach by explicitly involving a differentiable clustering module which is extended to leverage the supervised data to compute its centroids. We demonstrate the effectiveness of our straightforward end-to-end training strategy for SSL and UDA over extensive experiments and highlight its benefits, especially in low supervision regimes, both as a standalone model and as a regularizer for existing approaches.
title SuperCM: Improving Semi-Supervised Learning and Domain Adaptation through differentiable clustering
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.13779