Adaptive Stochastic Gradient Descent Ascent Algorithm for Nonconvex Minimax Problems with Decision-Dependent Distributions
Fuente:
arXiv
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915493818925056 |
|---|---|
| author | Gao, Yan Liu, Yongchao |
| author_facet | Gao, Yan Liu, Yongchao |
| contents | In this paper, we study stochastic minimax problems with decision-dependent distributions (SMDD), where the probability distribution of stochastic variable depends on decision variable. For SMDD with nonconvex-(strongly) concave objective function, we propose an adaptive stochastic gradient descent ascent algorithm (ASGDA) to find the stationary points of SMDD, which learns the unknown distribution map dynamically and optimizes the minimax problem simultaneously. When the distribution map follows a location-scale model, we show that ASGDA finds an $ε$-stationary point within $\mathcal{O}\left(ε^{-\left(4+δ\right)} \right)$ for $\forallδ>0$, and $\mathcal{O}(ε^{-8})$ stochastic gradient evaluations in nonconvex-strongly concave and nonconvex-concave settings respectively. When the objective function of SMDD is nonconvex in $x$ and satisfies Polyak-Łojasiewicz (PŁ) inequality in $y$, we propose an alternating adaptive stochastic gradient descent ascent algorithm (AASGDA) and show that AASGDA finds an $ε$-stationary point within $\mathcal{O}(κ_y^4ε^{-4})$ stochastic gradient evaluations, where $κ_y$ denotes the condition number. We verify the effectiveness of the proposed algorithms through numerical experiments on both synthetic and real-world data. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_11018 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Adaptive Stochastic Gradient Descent Ascent Algorithm for Nonconvex Minimax Problems with Decision-Dependent Distributions Gao, Yan Liu, Yongchao Optimization and Control 90C26, 90C15, 65K05 G.1.6; G.1.0 In this paper, we study stochastic minimax problems with decision-dependent distributions (SMDD), where the probability distribution of stochastic variable depends on decision variable. For SMDD with nonconvex-(strongly) concave objective function, we propose an adaptive stochastic gradient descent ascent algorithm (ASGDA) to find the stationary points of SMDD, which learns the unknown distribution map dynamically and optimizes the minimax problem simultaneously. When the distribution map follows a location-scale model, we show that ASGDA finds an $ε$-stationary point within $\mathcal{O}\left(ε^{-\left(4+δ\right)} \right)$ for $\forallδ>0$, and $\mathcal{O}(ε^{-8})$ stochastic gradient evaluations in nonconvex-strongly concave and nonconvex-concave settings respectively. When the objective function of SMDD is nonconvex in $x$ and satisfies Polyak-Łojasiewicz (PŁ) inequality in $y$, we propose an alternating adaptive stochastic gradient descent ascent algorithm (AASGDA) and show that AASGDA finds an $ε$-stationary point within $\mathcal{O}(κ_y^4ε^{-4})$ stochastic gradient evaluations, where $κ_y$ denotes the condition number. We verify the effectiveness of the proposed algorithms through numerical experiments on both synthetic and real-world data. |
| title | Adaptive Stochastic Gradient Descent Ascent Algorithm for Nonconvex Minimax Problems with Decision-Dependent Distributions |
| topic | Optimization and Control 90C26, 90C15, 65K05 G.1.6; G.1.0 |
| url | https://arxiv.org/abs/2509.11018 |