Guardado en:
| Autores principales: | , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2023
|
| Materias: | |
| Acceso en línea: | https://arxiv.org/abs/2307.09421 |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866911803962818560 |
|---|---|
| author | Zhang, Xuan Mancino-Ball, Gabriel Aybat, Necdet Serhat Xu, Yangyang |
| author_facet | Zhang, Xuan Mancino-Ball, Gabriel Aybat, Necdet Serhat Xu, Yangyang |
| contents | We propose a novel single-loop decentralized algorithm called DGDA-VR for solving the stochastic nonconvex strongly-concave minimax problem over a connected network of $M$ agents. By using stochastic first-order oracles to estimate the local gradients, we prove that our algorithm finds an $ε$-accurate solution with $\mathcal{O}(ε^{-3})$ sample complexity and $\mathcal{O}(ε^{-2})$ communication complexity, both of which are optimal and match the lower bounds for this class of problems. Unlike competitors, our algorithm does not require multiple communications for the convergence results to hold, making it applicable to a broader computational environment setting. To the best of our knowledge, this is the first such algorithm to jointly optimize the sample and communication complexities for the problem considered here. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2307_09421 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Jointly Improving the Sample and Communication Complexities in Decentralized Stochastic Minimax Optimization Zhang, Xuan Mancino-Ball, Gabriel Aybat, Necdet Serhat Xu, Yangyang Optimization and Control We propose a novel single-loop decentralized algorithm called DGDA-VR for solving the stochastic nonconvex strongly-concave minimax problem over a connected network of $M$ agents. By using stochastic first-order oracles to estimate the local gradients, we prove that our algorithm finds an $ε$-accurate solution with $\mathcal{O}(ε^{-3})$ sample complexity and $\mathcal{O}(ε^{-2})$ communication complexity, both of which are optimal and match the lower bounds for this class of problems. Unlike competitors, our algorithm does not require multiple communications for the convergence results to hold, making it applicable to a broader computational environment setting. To the best of our knowledge, this is the first such algorithm to jointly optimize the sample and communication complexities for the problem considered here. |
| title | Jointly Improving the Sample and Communication Complexities in Decentralized Stochastic Minimax Optimization |
| topic | Optimization and Control |
| url | https://arxiv.org/abs/2307.09421 |