Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2503.10384 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916731199422464 |
|---|---|
| author | Dimitrieski, Naum Cao, Jing Ebenbauer, Christian |
| author_facet | Dimitrieski, Naum Cao, Jing Ebenbauer, Christian |
| contents | This paper presents a novel stochastic gradient descent algorithm for constrained optimization. The proposed algorithm randomly samples constraints and components of the finite sum objective function and relies on a relaxed logarithmic barrier function that is appropriately adapted in each optimization iteration. For a strongly convex objective function and affine inequality constraints, step-size rules and barrier adaptation rules are established that guarantee asymptotic convergence with probability one. The theoretical results in the paper are complemented by numerical studies which highlight potential advantages of the proposed algorithm for optimization problems with a large number of constraints. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_10384 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Stochastic Gradient Descent for Constrained Optimization based on Adaptive Relaxed Barrier Functions Dimitrieski, Naum Cao, Jing Ebenbauer, Christian Optimization and Control This paper presents a novel stochastic gradient descent algorithm for constrained optimization. The proposed algorithm randomly samples constraints and components of the finite sum objective function and relies on a relaxed logarithmic barrier function that is appropriately adapted in each optimization iteration. For a strongly convex objective function and affine inequality constraints, step-size rules and barrier adaptation rules are established that guarantee asymptotic convergence with probability one. The theoretical results in the paper are complemented by numerical studies which highlight potential advantages of the proposed algorithm for optimization problems with a large number of constraints. |
| title | Stochastic Gradient Descent for Constrained Optimization based on Adaptive Relaxed Barrier Functions |
| topic | Optimization and Control |
| url | https://arxiv.org/abs/2503.10384 |