Skeleton Regression: A Graph-Based Approach to Estimation with Manifold Structure

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Wei, Zeyu, Chen, Yen-Chi
Natura: Preprint
Pubblicazione: 2023
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911513117196288
author Wei, Zeyu
Chen, Yen-Chi
author_facet Wei, Zeyu
Chen, Yen-Chi
contents We introduce a new regression framework designed to deal with large-scale, complex data that lies around a low-dimensional manifold with noises. Our approach first constructs a graph representation, referred to as the skeleton, to capture the underlying geometric structure. We then define metrics on the skeleton graph and apply nonparametric regression techniques, along with feature transformations based on the graph, to estimate the regression function. We also discuss the limitations of some nonparametric regressors with respect to the general metric space such as the skeleton graph. The proposed regression framework suggests a novel way to deal with data with underlying geometric structures and provides additional advantages in handling the union of multiple manifolds, additive noises, and noisy observations. We provide statistical guarantees for the proposed method and demonstrate its effectiveness through simulations and real data examples.
format Preprint
id arxiv_https___arxiv_org_abs_2303_11786
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Skeleton Regression: A Graph-Based Approach to Estimation with Manifold Structure
Wei, Zeyu
Chen, Yen-Chi
Machine Learning
Methodology
We introduce a new regression framework designed to deal with large-scale, complex data that lies around a low-dimensional manifold with noises. Our approach first constructs a graph representation, referred to as the skeleton, to capture the underlying geometric structure. We then define metrics on the skeleton graph and apply nonparametric regression techniques, along with feature transformations based on the graph, to estimate the regression function. We also discuss the limitations of some nonparametric regressors with respect to the general metric space such as the skeleton graph. The proposed regression framework suggests a novel way to deal with data with underlying geometric structures and provides additional advantages in handling the union of multiple manifolds, additive noises, and noisy observations. We provide statistical guarantees for the proposed method and demonstrate its effectiveness through simulations and real data examples.
title Skeleton Regression: A Graph-Based Approach to Estimation with Manifold Structure
topic Machine Learning
Methodology
url https://arxiv.org/abs/2303.11786