CLASP: An online learning algorithm for Convex Losses And Squared Penalties

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Ferreira, Ricardo N., Xavier, João, Soares, Cláudia
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866918303490899968
author Ferreira, Ricardo N.
Xavier, João
Soares, Cláudia
author_facet Ferreira, Ricardo N.
Xavier, João
Soares, Cláudia
contents We study Constrained Online Convex Optimization (COCO), where a learner chooses actions iteratively, observes both unanticipated convex loss and convex constraint, and accumulates loss while incurring penalties for constraint violations. We introduce CLASP (Convex Losses And Squared Penalties), an algorithm that minimizes cumulative loss together with squared constraint violations. Our analysis departs from prior work by fully leveraging the firm non-expansiveness of convex projectors, a proof strategy not previously applied in this setting. For convex losses, CLASP achieves regret $O\left(T^{\max\{β,1-β\}}\right)$ and cumulative squared penalty $O\left(T^{1-β}\right)$ for any $β\in (0,1)$. Most importantly, for strongly convex problems, CLASP provides the first logarithmic guarantees on both regret and cumulative squared penalty. In the strongly convex case, the regret is upper bounded by $O( \log T )$ and the cumulative squared penalty is also upper bounded by $O( \log T )$.
format Preprint
id arxiv_https___arxiv_org_abs_2601_16072
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle CLASP: An online learning algorithm for Convex Losses And Squared Penalties
Ferreira, Ricardo N.
Xavier, João
Soares, Cláudia
Machine Learning
Optimization and Control
We study Constrained Online Convex Optimization (COCO), where a learner chooses actions iteratively, observes both unanticipated convex loss and convex constraint, and accumulates loss while incurring penalties for constraint violations. We introduce CLASP (Convex Losses And Squared Penalties), an algorithm that minimizes cumulative loss together with squared constraint violations. Our analysis departs from prior work by fully leveraging the firm non-expansiveness of convex projectors, a proof strategy not previously applied in this setting. For convex losses, CLASP achieves regret $O\left(T^{\max\{β,1-β\}}\right)$ and cumulative squared penalty $O\left(T^{1-β}\right)$ for any $β\in (0,1)$. Most importantly, for strongly convex problems, CLASP provides the first logarithmic guarantees on both regret and cumulative squared penalty. In the strongly convex case, the regret is upper bounded by $O( \log T )$ and the cumulative squared penalty is also upper bounded by $O( \log T )$.
title CLASP: An online learning algorithm for Convex Losses And Squared Penalties
topic Machine Learning
Optimization and Control
url https://arxiv.org/abs/2601.16072