Fast-Slow Co-advancing Optimizer: Toward Harmonious Adversarial Training of GAN
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910915523248128 |
|---|---|
| author | Wang, Lin Wang, Xiancheng Wang, Rui Zhang, Zhibo Zhao, Minghang |
| author_facet | Wang, Lin Wang, Xiancheng Wang, Rui Zhang, Zhibo Zhao, Minghang |
| contents | Up to now, the training processes of typical Generative Adversarial Networks (GANs) are still particularly sensitive to data properties and hyperparameters, which may lead to severe oscillations, difficulties in convergence, or even failures to converge, especially when the overall variances of the training sets are large. These phenomena are often attributed to the training characteristics of such networks. Aiming at the problem, this paper develops a new intelligent optimizer, Fast-Slow Co-advancing Optimizer (FSCO), which employs reinforcement learning in the training process of GANs to make training easier. Specifically, this paper allows the training step size to be controlled by an agent to improve training stability, and makes the training process more intelligent with variable learning rates, making GANs less sensitive to step size. Experiments have been conducted on three benchmark datasets to verify the effectiveness of the developed FSCO. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_15099 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Fast-Slow Co-advancing Optimizer: Toward Harmonious Adversarial Training of GAN Wang, Lin Wang, Xiancheng Wang, Rui Zhang, Zhibo Zhao, Minghang Machine Learning Artificial Intelligence Up to now, the training processes of typical Generative Adversarial Networks (GANs) are still particularly sensitive to data properties and hyperparameters, which may lead to severe oscillations, difficulties in convergence, or even failures to converge, especially when the overall variances of the training sets are large. These phenomena are often attributed to the training characteristics of such networks. Aiming at the problem, this paper develops a new intelligent optimizer, Fast-Slow Co-advancing Optimizer (FSCO), which employs reinforcement learning in the training process of GANs to make training easier. Specifically, this paper allows the training step size to be controlled by an agent to improve training stability, and makes the training process more intelligent with variable learning rates, making GANs less sensitive to step size. Experiments have been conducted on three benchmark datasets to verify the effectiveness of the developed FSCO. |
| title | Fast-Slow Co-advancing Optimizer: Toward Harmonious Adversarial Training of GAN |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2504.15099 |