Tropical Gradient Descent
Fuente:
arXiv
Salvato in:
| Autori principali: | , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866918201744424960 |
|---|---|
| author | Talbut, Roan Monod, Anthea |
| author_facet | Talbut, Roan Monod, Anthea |
| contents | We propose a gradient descent method for solving optimization problems arising in settings of tropical geometry - a variant of algebraic geometry that has attracted growing interest in applications such as computational biology, economics, and computer science. Our approach takes advantage of the polyhedral and combinatorial structures arising in tropical geometry to propose a versatile method for approximating local minima in tropical statistical optimization problems - a rapidly growing body of work in recent years. Theoretical results establish global solvability for 1-sample problems and a convergence rate matching classical gradient descent. Numerical experiments demonstrate the method's superior performance compared to classical gradient descent for tropical optimization problems which exhibit tropical convexity but not classical convexity. We also demonstrate the seamless integration of tropical descent into advanced optimization methods, such as Adam, offering improved overall accuracy. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_19551 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Tropical Gradient Descent Talbut, Roan Monod, Anthea Optimization and Control Metric Geometry Statistics Theory We propose a gradient descent method for solving optimization problems arising in settings of tropical geometry - a variant of algebraic geometry that has attracted growing interest in applications such as computational biology, economics, and computer science. Our approach takes advantage of the polyhedral and combinatorial structures arising in tropical geometry to propose a versatile method for approximating local minima in tropical statistical optimization problems - a rapidly growing body of work in recent years. Theoretical results establish global solvability for 1-sample problems and a convergence rate matching classical gradient descent. Numerical experiments demonstrate the method's superior performance compared to classical gradient descent for tropical optimization problems which exhibit tropical convexity but not classical convexity. We also demonstrate the seamless integration of tropical descent into advanced optimization methods, such as Adam, offering improved overall accuracy. |
| title | Tropical Gradient Descent |
| topic | Optimization and Control Metric Geometry Statistics Theory |
| url | https://arxiv.org/abs/2405.19551 |