Divergence-Based Similarity Function for Multi-View Contrastive Learning
Fuente:
arXiv
Salvato in:
| Autori principali: | , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866914255250391040 |
|---|---|
| author | Jeon, Jae Hyoung Lim, Cheolsu Kang, Myungjoo |
| author_facet | Jeon, Jae Hyoung Lim, Cheolsu Kang, Myungjoo |
| contents | Recent success in contrastive learning has sparked growing interest in more effectively leveraging multiple augmented views of data. While prior methods incorporate multiple views at the loss or feature level, they primarily capture pairwise relationships and fail to model the joint structure across all views. In this work, we propose a divergence-based similarity function (DSF) that explicitly captures the joint structure by representing each set of augmented views as a distribution and measuring similarity as the divergence between distributions. Extensive experiments demonstrate that DSF consistently improves performance across diverse tasks, including kNN classification, linear evaluation, transfer learning, and distribution shift, while also achieving greater efficiency than other multi-view methods. Furthermore, we establish a connection between DSF and cosine similarity, and demonstrate that, unlike cosine similarity, DSF operates effectively without the need for tuning a temperature hyperparameter. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_06560 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Divergence-Based Similarity Function for Multi-View Contrastive Learning Jeon, Jae Hyoung Lim, Cheolsu Kang, Myungjoo Computer Vision and Pattern Recognition Machine Learning 68T07, 62H12 I.2.6; I.4.8; I.5.1 Recent success in contrastive learning has sparked growing interest in more effectively leveraging multiple augmented views of data. While prior methods incorporate multiple views at the loss or feature level, they primarily capture pairwise relationships and fail to model the joint structure across all views. In this work, we propose a divergence-based similarity function (DSF) that explicitly captures the joint structure by representing each set of augmented views as a distribution and measuring similarity as the divergence between distributions. Extensive experiments demonstrate that DSF consistently improves performance across diverse tasks, including kNN classification, linear evaluation, transfer learning, and distribution shift, while also achieving greater efficiency than other multi-view methods. Furthermore, we establish a connection between DSF and cosine similarity, and demonstrate that, unlike cosine similarity, DSF operates effectively without the need for tuning a temperature hyperparameter. |
| title | Divergence-Based Similarity Function for Multi-View Contrastive Learning |
| topic | Computer Vision and Pattern Recognition Machine Learning 68T07, 62H12 I.2.6; I.4.8; I.5.1 |
| url | https://arxiv.org/abs/2507.06560 |