Understanding and Reducing the Class-Dependent Effects of Data Augmentation with A Two-Player Game Approach
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913917975920640 |
|---|---|
| author | Jiang, Yunpeng Ban, Yutong Weng, Paul |
| author_facet | Jiang, Yunpeng Ban, Yutong Weng, Paul |
| contents | Data augmentation is widely applied and has shown its benefits in different machine learning tasks. However, as recently observed, it may have an unfair effect in multi-class classification. While data augmentation generally improves the overall performance (and therefore is beneficial for many classes), it can actually be detrimental for other classes, which can be problematic in some application domains. In this paper, to counteract this phenomenon, we propose CLAM, a CLAss-dependent Multiplicative-weights method. To derive it, we first formulate the training of a classifier as a non-linear optimization problem that aims at simultaneously maximizing the individual class performances and balancing them. By rewriting this optimization problem as an adversarial two-player game, we propose a novel multiplicative weight algorithm, for which we prove the convergence. Interestingly, our formulation also reveals that the class-dependent effects of data augmentation is not due to data augmentation only, but is in fact a general phenomenon. Our empirical results over six datasets demonstrate that the performance of learned classifiers is indeed more fairly distributed over classes, with only limited impact on the average accuracy. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_03146 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Understanding and Reducing the Class-Dependent Effects of Data Augmentation with A Two-Player Game Approach Jiang, Yunpeng Ban, Yutong Weng, Paul Computers and Society Artificial Intelligence Computer Vision and Pattern Recognition Computer Science and Game Theory Machine Learning Data augmentation is widely applied and has shown its benefits in different machine learning tasks. However, as recently observed, it may have an unfair effect in multi-class classification. While data augmentation generally improves the overall performance (and therefore is beneficial for many classes), it can actually be detrimental for other classes, which can be problematic in some application domains. In this paper, to counteract this phenomenon, we propose CLAM, a CLAss-dependent Multiplicative-weights method. To derive it, we first formulate the training of a classifier as a non-linear optimization problem that aims at simultaneously maximizing the individual class performances and balancing them. By rewriting this optimization problem as an adversarial two-player game, we propose a novel multiplicative weight algorithm, for which we prove the convergence. Interestingly, our formulation also reveals that the class-dependent effects of data augmentation is not due to data augmentation only, but is in fact a general phenomenon. Our empirical results over six datasets demonstrate that the performance of learned classifiers is indeed more fairly distributed over classes, with only limited impact on the average accuracy. |
| title | Understanding and Reducing the Class-Dependent Effects of Data Augmentation with A Two-Player Game Approach |
| topic | Computers and Society Artificial Intelligence Computer Vision and Pattern Recognition Computer Science and Game Theory Machine Learning |
| url | https://arxiv.org/abs/2407.03146 |