SeMi: When Imbalanced Semi-Supervised Learning Meets Mining Hard Examples
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866912183008362496 |
|---|---|
| author | Wang, Yin Wang, Zixuan Lu, Hao Qin, Zhen Zhao, Hailiang Cheng, Guanjie Su, Ge Kuang, Li Zhou, Mengchu Deng, Shuiguang |
| author_facet | Wang, Yin Wang, Zixuan Lu, Hao Qin, Zhen Zhao, Hailiang Cheng, Guanjie Su, Ge Kuang, Li Zhou, Mengchu Deng, Shuiguang |
| contents | Semi-Supervised Learning (SSL) can leverage abundant unlabeled data to boost model performance. However, the class-imbalanced data distribution in real-world scenarios poses great challenges to SSL, resulting in performance degradation. Existing class-imbalanced semi-supervised learning (CISSL) methods mainly focus on rebalancing datasets but ignore the potential of using hard examples to enhance performance, making it difficult to fully harness the power of unlabeled data even with sophisticated algorithms. To address this issue, we propose a method that enhances the performance of Imbalanced Semi-Supervised Learning by Mining Hard Examples (SeMi). This method distinguishes the entropy differences among logits of hard and easy examples, thereby identifying hard examples and increasing the utility of unlabeled data, better addressing the imbalance problem in CISSL. In addition, we maintain a class-balanced memory bank with confidence decay for storing high-confidence embeddings to enhance the pseudo-labels' reliability. Although our method is simple, it is effective and seamlessly integrates with existing approaches. We perform comprehensive experiments on standard CISSL benchmarks and experimentally demonstrate that our proposed SeMi outperforms existing state-of-the-art methods on multiple benchmarks, especially in reversed scenarios, where our best result shows approximately a 54.8\% improvement over the baseline methods. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_06004 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | SeMi: When Imbalanced Semi-Supervised Learning Meets Mining Hard Examples Wang, Yin Wang, Zixuan Lu, Hao Qin, Zhen Zhao, Hailiang Cheng, Guanjie Su, Ge Kuang, Li Zhou, Mengchu Deng, Shuiguang Computer Vision and Pattern Recognition 68T05 I.2.6; I.5.1; I.5.4 Semi-Supervised Learning (SSL) can leverage abundant unlabeled data to boost model performance. However, the class-imbalanced data distribution in real-world scenarios poses great challenges to SSL, resulting in performance degradation. Existing class-imbalanced semi-supervised learning (CISSL) methods mainly focus on rebalancing datasets but ignore the potential of using hard examples to enhance performance, making it difficult to fully harness the power of unlabeled data even with sophisticated algorithms. To address this issue, we propose a method that enhances the performance of Imbalanced Semi-Supervised Learning by Mining Hard Examples (SeMi). This method distinguishes the entropy differences among logits of hard and easy examples, thereby identifying hard examples and increasing the utility of unlabeled data, better addressing the imbalance problem in CISSL. In addition, we maintain a class-balanced memory bank with confidence decay for storing high-confidence embeddings to enhance the pseudo-labels' reliability. Although our method is simple, it is effective and seamlessly integrates with existing approaches. We perform comprehensive experiments on standard CISSL benchmarks and experimentally demonstrate that our proposed SeMi outperforms existing state-of-the-art methods on multiple benchmarks, especially in reversed scenarios, where our best result shows approximately a 54.8\% improvement over the baseline methods. |
| title | SeMi: When Imbalanced Semi-Supervised Learning Meets Mining Hard Examples |
| topic | Computer Vision and Pattern Recognition 68T05 I.2.6; I.5.1; I.5.4 |
| url | https://arxiv.org/abs/2501.06004 |