ASMOP: Additional sampling stochastic trust region method for multi-objective problems
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912962622521344 |
|---|---|
| author | Jerinkić, Nataša Krklec Rutešić, Luka Trombini, Ilaria |
| author_facet | Jerinkić, Nataša Krklec Rutešić, Luka Trombini, Ilaria |
| contents | We consider unconstrained multi-criteria optimization problems with finite sum objective functions. The proposed algorithm belongs to a non-monotone trust region framework where additional sampling approach is used to govern the sample size and the acceptance of a candidate point. Depending on the problem, the method can yield a mini-batch or an increasing sample size behavior. This work can be viewed as an extension of additional sampling trust region method for scalar finite sum function minimization presented in the literature, requiring nontrivial modifications both in construction and in convergence analysis of the algorithm. Under assumptions standard for this framework, we prove stochastic convergence for twice continuously-differentiable, but possibly non-convex objective functions. The experiments on machine learning binary classification datasets show the efficiency of the proposed scheme and its competitiveness with the relevant state-of-the-art methods in both convex and non-convex setup. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_10976 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | ASMOP: Additional sampling stochastic trust region method for multi-objective problems Jerinkić, Nataša Krklec Rutešić, Luka Trombini, Ilaria Optimization and Control 65K05, 90C15, 62L20 G.1.6 We consider unconstrained multi-criteria optimization problems with finite sum objective functions. The proposed algorithm belongs to a non-monotone trust region framework where additional sampling approach is used to govern the sample size and the acceptance of a candidate point. Depending on the problem, the method can yield a mini-batch or an increasing sample size behavior. This work can be viewed as an extension of additional sampling trust region method for scalar finite sum function minimization presented in the literature, requiring nontrivial modifications both in construction and in convergence analysis of the algorithm. Under assumptions standard for this framework, we prove stochastic convergence for twice continuously-differentiable, but possibly non-convex objective functions. The experiments on machine learning binary classification datasets show the efficiency of the proposed scheme and its competitiveness with the relevant state-of-the-art methods in both convex and non-convex setup. |
| title | ASMOP: Additional sampling stochastic trust region method for multi-objective problems |
| topic | Optimization and Control 65K05, 90C15, 62L20 G.1.6 |
| url | https://arxiv.org/abs/2506.10976 |