Self-Supervised Representation Learning via Hyperspherical Density Shaping
Fuente:
arXiv
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913065511944192 |
|---|---|
| author | Rodríguez-Betancourt, Esteban Casasola-Murillo, Edgar |
| author_facet | Rodríguez-Betancourt, Esteban Casasola-Murillo, Edgar |
| contents | Modern self-supervised representation learning methods often relies on empirical heuristics that are not theoretically grounded. In this study we propose HyDeS, a theoretically grounded method based on multi-view mutual information maximization within an hyperspherical space using Shannon differential entropy with a non-parametric von Mises-Fisher density estimator.
We show that HyDeS bias the trained model towards focusing on foreground features of the images and perform well on segmentation tasks such as VOC PASCAL, while it lags in fine-grained classification. We provide a detailed analysis of the induced latent space geometry and learning dynamics, that can be used for designing other theoretically grounded self-supervised learning methods. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_24498 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Self-Supervised Representation Learning via Hyperspherical Density Shaping Rodríguez-Betancourt, Esteban Casasola-Murillo, Edgar Computer Vision and Pattern Recognition Modern self-supervised representation learning methods often relies on empirical heuristics that are not theoretically grounded. In this study we propose HyDeS, a theoretically grounded method based on multi-view mutual information maximization within an hyperspherical space using Shannon differential entropy with a non-parametric von Mises-Fisher density estimator. We show that HyDeS bias the trained model towards focusing on foreground features of the images and perform well on segmentation tasks such as VOC PASCAL, while it lags in fine-grained classification. We provide a detailed analysis of the induced latent space geometry and learning dynamics, that can be used for designing other theoretically grounded self-supervised learning methods. |
| title | Self-Supervised Representation Learning via Hyperspherical Density Shaping |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2604.24498 |