Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2406.00262 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929535033802752 |
|---|---|
| author | Song, Sifan Wang, Jinfeng Zhao, Qiaochu Li, Xiang Wu, Dufan Stefanidis, Angelos Su, Jionglong Zhou, S. Kevin Li, Quanzheng |
| author_facet | Song, Sifan Wang, Jinfeng Zhao, Qiaochu Li, Xiang Wu, Dufan Stefanidis, Angelos Su, Jionglong Zhou, S. Kevin Li, Quanzheng |
| contents | Invariant Contrastive Learning (ICL) methods have achieved impressive performance across various domains. However, the absence of latent space representation for distortion (augmentation)-related information in the latent space makes ICL sub-optimal regarding training efficiency and robustness in downstream tasks. Recent studies suggest that introducing equivariance into Contrastive Learning (CL) can improve overall performance. In this paper, we revisit the roles of augmentation strategies and equivariance in improving CL's efficacy. We propose CLeVER (Contrastive Learning Via Equivariant Representation), a novel equivariant contrastive learning framework compatible with augmentation strategies of arbitrary complexity for various mainstream CL backbone models. Experimental results demonstrate that CLeVER effectively extracts and incorporates equivariant information from practical natural images, thereby improving the training efficiency and robustness of baseline models in downstream tasks and achieving state-of-the-art (SOTA) performance. Moreover, we find that leveraging equivariant information extracted by CLeVER simultaneously enhances rotational invariance and sensitivity across experimental tasks, and helps stabilize the framework when handling complex augmentations, particularly for models with small-scale backbones. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_00262 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Contrastive Learning Via Equivariant Representation Song, Sifan Wang, Jinfeng Zhao, Qiaochu Li, Xiang Wu, Dufan Stefanidis, Angelos Su, Jionglong Zhou, S. Kevin Li, Quanzheng Machine Learning Artificial Intelligence Invariant Contrastive Learning (ICL) methods have achieved impressive performance across various domains. However, the absence of latent space representation for distortion (augmentation)-related information in the latent space makes ICL sub-optimal regarding training efficiency and robustness in downstream tasks. Recent studies suggest that introducing equivariance into Contrastive Learning (CL) can improve overall performance. In this paper, we revisit the roles of augmentation strategies and equivariance in improving CL's efficacy. We propose CLeVER (Contrastive Learning Via Equivariant Representation), a novel equivariant contrastive learning framework compatible with augmentation strategies of arbitrary complexity for various mainstream CL backbone models. Experimental results demonstrate that CLeVER effectively extracts and incorporates equivariant information from practical natural images, thereby improving the training efficiency and robustness of baseline models in downstream tasks and achieving state-of-the-art (SOTA) performance. Moreover, we find that leveraging equivariant information extracted by CLeVER simultaneously enhances rotational invariance and sensitivity across experimental tasks, and helps stabilize the framework when handling complex augmentations, particularly for models with small-scale backbones. |
| title | Contrastive Learning Via Equivariant Representation |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2406.00262 |