Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2409.04470 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912366968438784 |
|---|---|
| author | Asadi, Saeed Gharibzadeh, Sonia Naeini, Hajar Kazemi Reihanifar, Masoud Rahimi, Morteza Zangeneh, Shiva Smerat, Aseel Abdullah, Lazim |
| author_facet | Asadi, Saeed Gharibzadeh, Sonia Naeini, Hajar Kazemi Reihanifar, Masoud Rahimi, Morteza Zangeneh, Shiva Smerat, Aseel Abdullah, Lazim |
| contents | This study examines several renowned gradient-based optimization techniques and focuses on their computational efficiency and precision. In the study, the steepest descent, conjugate gradient (Fletcher-Reeves and Polak-Ribiere variants), Newton-Raphson, quasi-Newton (BFGS), and Levenberg-Marquardt techniques were evaluated. These methods were benchmarked using Rosenbrock's, Spring Force Vanderplaats', Ackley's, and Himmelblau's functions. We emphasize the critical role that initial point selection plays in optimizing optimization outcomes in our analysis. It is also important to distinguish between local and global optima since gradient-based methods may have difficulties dealing with nonlinearity and multimodality. We illustrate optimization trajectories using 3D surface visualizations in order to increase understanding. While gradient-based methods have been demonstrated to be effective, they may be limited by computational constraints and by the nature of the objective functions, necessitating the use of heuristic and metaheuristic algorithms in more complex situations. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_04470 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Comparative Analysis of Gradient-Based Optimization Techniques Using Multidimensional Surface 3D Visualizations and Initial Point Sensitivity Asadi, Saeed Gharibzadeh, Sonia Naeini, Hajar Kazemi Reihanifar, Masoud Rahimi, Morteza Zangeneh, Shiva Smerat, Aseel Abdullah, Lazim Optimization and Control This study examines several renowned gradient-based optimization techniques and focuses on their computational efficiency and precision. In the study, the steepest descent, conjugate gradient (Fletcher-Reeves and Polak-Ribiere variants), Newton-Raphson, quasi-Newton (BFGS), and Levenberg-Marquardt techniques were evaluated. These methods were benchmarked using Rosenbrock's, Spring Force Vanderplaats', Ackley's, and Himmelblau's functions. We emphasize the critical role that initial point selection plays in optimizing optimization outcomes in our analysis. It is also important to distinguish between local and global optima since gradient-based methods may have difficulties dealing with nonlinearity and multimodality. We illustrate optimization trajectories using 3D surface visualizations in order to increase understanding. While gradient-based methods have been demonstrated to be effective, they may be limited by computational constraints and by the nature of the objective functions, necessitating the use of heuristic and metaheuristic algorithms in more complex situations. |
| title | Comparative Analysis of Gradient-Based Optimization Techniques Using Multidimensional Surface 3D Visualizations and Initial Point Sensitivity |
| topic | Optimization and Control |
| url | https://arxiv.org/abs/2409.04470 |