Distribution free M-estimation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Areces, Felipe, Duchi, John C.
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912555377623040
author Areces, Felipe
Duchi, John C.
author_facet Areces, Felipe
Duchi, John C.
contents The basic question of delineating those statistical problems that are solvable without making any assumptions on the underlying data distribution has long animated statistics and learning theory. This paper characterizes when a convex M-estimation or stochastic optimization problem is solvable in such an assumption-free setting, providing a precise dividing line between solvable and unsolvable problems. The conditions we identify show, perhaps surprisingly, that Lipschitz continuity of the loss being minimized is not necessary for distribution free minimization, and they are also distinct from classical characterizations of learnability in machine learning.
format Preprint
id arxiv_https___arxiv_org_abs_2505_22807
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Distribution free M-estimation
Areces, Felipe
Duchi, John C.
Statistics Theory
Information Theory
Machine Learning
The basic question of delineating those statistical problems that are solvable without making any assumptions on the underlying data distribution has long animated statistics and learning theory. This paper characterizes when a convex M-estimation or stochastic optimization problem is solvable in such an assumption-free setting, providing a precise dividing line between solvable and unsolvable problems. The conditions we identify show, perhaps surprisingly, that Lipschitz continuity of the loss being minimized is not necessary for distribution free minimization, and they are also distinct from classical characterizations of learnability in machine learning.
title Distribution free M-estimation
topic Statistics Theory
Information Theory
Machine Learning
url https://arxiv.org/abs/2505.22807