Sandwiching Polynomials for Geometric Concepts with Low Intrinsic Dimension

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Klivans, Adam R., Stavropoulos, Konstantinos, Vasilyan, Arsen
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911473935056896
author Klivans, Adam R.
Stavropoulos, Konstantinos
Vasilyan, Arsen
author_facet Klivans, Adam R.
Stavropoulos, Konstantinos
Vasilyan, Arsen
contents Recent work has shown the surprising power of low-degree sandwiching polynomial approximators in the context of challenging learning settings such as learning with distribution shift, testable learning, and learning with contamination. A pair of sandwiching polynomials approximate a target function in expectation while also providing pointwise upper and lower bounds on the function's values. In this paper, we give a new method for constructing low-degree sandwiching polynomials that yield greatly improved degree bounds for several fundamental function classes and marginal distributions. In particular, we obtain degree $\mathrm{poly}(k)$ sandwiching polynomials for functions of $k$ halfspaces under the Gaussian distribution, improving exponentially over the prior $2^{O(k)}$ bound. More broadly, our approach applies to function classes that are low-dimensional and have smooth boundary. In contrast to prior work, our proof is relatively simple and directly uses the smoothness of the target function's boundary to construct sandwiching Lipschitz functions, which are amenable to results from high-dimensional approximation theory. For low-dimensional polynomial threshold functions (PTFs) with respect to Gaussians, we obtain doubly exponential improvements without applying the FT-mollification method of Kane used in the best previous result.
format Preprint
id arxiv_https___arxiv_org_abs_2602_24178
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Sandwiching Polynomials for Geometric Concepts with Low Intrinsic Dimension
Klivans, Adam R.
Stavropoulos, Konstantinos
Vasilyan, Arsen
Machine Learning
Computational Complexity
Recent work has shown the surprising power of low-degree sandwiching polynomial approximators in the context of challenging learning settings such as learning with distribution shift, testable learning, and learning with contamination. A pair of sandwiching polynomials approximate a target function in expectation while also providing pointwise upper and lower bounds on the function's values. In this paper, we give a new method for constructing low-degree sandwiching polynomials that yield greatly improved degree bounds for several fundamental function classes and marginal distributions. In particular, we obtain degree $\mathrm{poly}(k)$ sandwiching polynomials for functions of $k$ halfspaces under the Gaussian distribution, improving exponentially over the prior $2^{O(k)}$ bound. More broadly, our approach applies to function classes that are low-dimensional and have smooth boundary. In contrast to prior work, our proof is relatively simple and directly uses the smoothness of the target function's boundary to construct sandwiching Lipschitz functions, which are amenable to results from high-dimensional approximation theory. For low-dimensional polynomial threshold functions (PTFs) with respect to Gaussians, we obtain doubly exponential improvements without applying the FT-mollification method of Kane used in the best previous result.
title Sandwiching Polynomials for Geometric Concepts with Low Intrinsic Dimension
topic Machine Learning
Computational Complexity
url https://arxiv.org/abs/2602.24178