Minimax Optimal Algorithms with Fixed-$k$-Nearest Neighbors

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Ryu, J. Jon, Kim, Young-Han
Format: Preprint
Veröffentlicht: 2022
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910596510777344
author Ryu, J. Jon
Kim, Young-Han
author_facet Ryu, J. Jon
Kim, Young-Han
contents This paper presents how to perform minimax optimal classification, regression, and density estimation based on fixed-$k$ nearest neighbor (NN) searches. We consider a distributed learning scenario, in which a massive dataset is split into smaller groups, where the $k$-NNs are found for a query point with respect to each subset of data. We propose \emph{optimal} rules to aggregate the fixed-$k$-NN information for classification, regression, and density estimation that achieve minimax optimal rates for the respective problems. We show that the distributed algorithm with a fixed $k$ over a sufficiently large number of groups attains a minimax optimal error rate up to a multiplicative logarithmic factor under some regularity conditions. Roughly speaking, distributed $k$-NN rules with $M$ groups has a performance comparable to the standard $Θ(kM)$-NN rules even for fixed $k$.
format Preprint
id arxiv_https___arxiv_org_abs_2202_02464
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Minimax Optimal Algorithms with Fixed-$k$-Nearest Neighbors
Ryu, J. Jon
Kim, Young-Han
Statistics Theory
Distributed, Parallel, and Cluster Computing
Information Theory
Machine Learning
This paper presents how to perform minimax optimal classification, regression, and density estimation based on fixed-$k$ nearest neighbor (NN) searches. We consider a distributed learning scenario, in which a massive dataset is split into smaller groups, where the $k$-NNs are found for a query point with respect to each subset of data. We propose \emph{optimal} rules to aggregate the fixed-$k$-NN information for classification, regression, and density estimation that achieve minimax optimal rates for the respective problems. We show that the distributed algorithm with a fixed $k$ over a sufficiently large number of groups attains a minimax optimal error rate up to a multiplicative logarithmic factor under some regularity conditions. Roughly speaking, distributed $k$-NN rules with $M$ groups has a performance comparable to the standard $Θ(kM)$-NN rules even for fixed $k$.
title Minimax Optimal Algorithms with Fixed-$k$-Nearest Neighbors
topic Statistics Theory
Distributed, Parallel, and Cluster Computing
Information Theory
Machine Learning
url https://arxiv.org/abs/2202.02464