Saved in:
Bibliographic Details
Main Authors: Chayti, El Mahdi, Kadi, Taha El Bakkali El, Saadi, Omar, Jaggi, Martin
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2510.15610
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • We revisit random search for stochastic optimization, where only noisy function evaluations are available. We show that the method works under weaker smoothness assumptions than previously considered, and that stronger assumptions enable improved guarantees. In the finite-sum setting, we design a variance-reduced variant that leverages multiple samples to accelerate convergence. Our analysis relies on a simple translation invariance property, which provides a principled way to balance noise and reduce variance.