Towards Parameter-free Distributed Optimization: a Port-Hamiltonian Approach
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910417107812352 |
|---|---|
| author | Aldana-López, Rodrigo Macchelli, Alessandro Notarstefano, Giuseppe Aragüés, Rosario Sagüés, Carlos |
| author_facet | Aldana-López, Rodrigo Macchelli, Alessandro Notarstefano, Giuseppe Aragüés, Rosario Sagüés, Carlos |
| contents | This paper introduces a novel distributed optimization technique for networked systems, which removes the dependency on specific parameter choices, notably the learning rate. Traditional parameter selection strategies in distributed optimization often lead to conservative performance, characterized by slow convergence or even divergence if parameters are not properly chosen. In this work, we propose a systems theory tool based on the port-Hamiltonian formalism to design algorithms for consensus optimization programs. Moreover, we propose the Mixed Implicit Discretization (MID), which transforms the continuous-time port-Hamiltonian system into a discrete time one, maintaining the same convergence properties regardless of the step size parameter. The consensus optimization algorithm enhances the convergence speed without worrying about the relationship between parameters and stability. Numerical experiments demonstrate the method's superior performance in convergence speed, outperforming other methods, especially in scenarios where conventional methods fail due to step size parameter limitations. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_13529 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Towards Parameter-free Distributed Optimization: a Port-Hamiltonian Approach Aldana-López, Rodrigo Macchelli, Alessandro Notarstefano, Giuseppe Aragüés, Rosario Sagüés, Carlos Optimization and Control Systems and Control This paper introduces a novel distributed optimization technique for networked systems, which removes the dependency on specific parameter choices, notably the learning rate. Traditional parameter selection strategies in distributed optimization often lead to conservative performance, characterized by slow convergence or even divergence if parameters are not properly chosen. In this work, we propose a systems theory tool based on the port-Hamiltonian formalism to design algorithms for consensus optimization programs. Moreover, we propose the Mixed Implicit Discretization (MID), which transforms the continuous-time port-Hamiltonian system into a discrete time one, maintaining the same convergence properties regardless of the step size parameter. The consensus optimization algorithm enhances the convergence speed without worrying about the relationship between parameters and stability. Numerical experiments demonstrate the method's superior performance in convergence speed, outperforming other methods, especially in scenarios where conventional methods fail due to step size parameter limitations. |
| title | Towards Parameter-free Distributed Optimization: a Port-Hamiltonian Approach |
| topic | Optimization and Control Systems and Control |
| url | https://arxiv.org/abs/2404.13529 |