Concentration inequalities for semidefinite least squares based on data

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Fabiani, Filippo, Simonetto, Andrea
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914317164609536
author Fabiani, Filippo
Simonetto, Andrea
author_facet Fabiani, Filippo
Simonetto, Andrea
contents We study data-driven least squares (LS) problems with semidefinite (SD) constraints and derive finite-sample guarantees on the spectrum of their optimal solutions when these constraints are relaxed. In particular, we provide a high confidence bound allowing one to solve a simpler program in place of the full SDLS problem, while ensuring that the eigenvalues of the resulting solution are $\varepsilon$-close of those enforced by the SD constraints. The developed certificate, which consistently shrinks as the number of data increases, turns out to be easy-to-compute, distribution-free, and only requires independent and identically distributed samples. Moreover, when the SDLS is used to learn an unknown quadratic function, we establish bounds on the error between a gradient descent iterate minimizing the surrogate cost obtained with no SD constraints and the true minimizer.
format Preprint
id arxiv_https___arxiv_org_abs_2509_13166
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Concentration inequalities for semidefinite least squares based on data
Fabiani, Filippo
Simonetto, Andrea
Systems and Control
Machine Learning
Signal Processing
Optimization and Control
We study data-driven least squares (LS) problems with semidefinite (SD) constraints and derive finite-sample guarantees on the spectrum of their optimal solutions when these constraints are relaxed. In particular, we provide a high confidence bound allowing one to solve a simpler program in place of the full SDLS problem, while ensuring that the eigenvalues of the resulting solution are $\varepsilon$-close of those enforced by the SD constraints. The developed certificate, which consistently shrinks as the number of data increases, turns out to be easy-to-compute, distribution-free, and only requires independent and identically distributed samples. Moreover, when the SDLS is used to learn an unknown quadratic function, we establish bounds on the error between a gradient descent iterate minimizing the surrogate cost obtained with no SD constraints and the true minimizer.
title Concentration inequalities for semidefinite least squares based on data
topic Systems and Control
Machine Learning
Signal Processing
Optimization and Control
url https://arxiv.org/abs/2509.13166