Accelerated Stochastic Gradient Method with Applications to Consensus Problem in Markov-Varying Networks
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929499945304064 |
|---|---|
| author | Solodkin, Vladimir Chezhegov, Savelii Nazikov, Ruslan Beznosikov, Aleksandr Gasnikov, Alexander |
| author_facet | Solodkin, Vladimir Chezhegov, Savelii Nazikov, Ruslan Beznosikov, Aleksandr Gasnikov, Alexander |
| contents | Stochastic optimization is a vital field in the realm of mathematical optimization, finding applications in diverse areas ranging from operations research to machine learning. In this paper, we introduce a novel first-order optimization algorithm designed for scenarios where Markovian noise is present, incorporating Nesterov acceleration for enhanced efficiency. The convergence analysis is performed using an assumption on noise depending on the distance to the solution. We also delve into the consensus problem over Markov-varying networks, exploring how this algorithm can be applied to achieve agreement among multiple agents with differing objectives during changes in the communication system. To show the performance of our method on the problem above, we conduct experiments to demonstrate the superiority over the classic approach. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_05474 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Accelerated Stochastic Gradient Method with Applications to Consensus Problem in Markov-Varying Networks Solodkin, Vladimir Chezhegov, Savelii Nazikov, Ruslan Beznosikov, Aleksandr Gasnikov, Alexander Optimization and Control Stochastic optimization is a vital field in the realm of mathematical optimization, finding applications in diverse areas ranging from operations research to machine learning. In this paper, we introduce a novel first-order optimization algorithm designed for scenarios where Markovian noise is present, incorporating Nesterov acceleration for enhanced efficiency. The convergence analysis is performed using an assumption on noise depending on the distance to the solution. We also delve into the consensus problem over Markov-varying networks, exploring how this algorithm can be applied to achieve agreement among multiple agents with differing objectives during changes in the communication system. To show the performance of our method on the problem above, we conduct experiments to demonstrate the superiority over the classic approach. |
| title | Accelerated Stochastic Gradient Method with Applications to Consensus Problem in Markov-Varying Networks |
| topic | Optimization and Control |
| url | https://arxiv.org/abs/2406.05474 |