A Characterization of List Regression

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Pabbaraju, Chirag, Sarmasarkar, Sahasrajit
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915181006684160
author Pabbaraju, Chirag
Sarmasarkar, Sahasrajit
author_facet Pabbaraju, Chirag
Sarmasarkar, Sahasrajit
contents There has been a recent interest in understanding and characterizing the sample complexity of list learning tasks, where the learning algorithm is allowed to make a short list of $k$ predictions, and we simply require one of the predictions to be correct. This includes recent works characterizing the PAC sample complexity of standard list classification and online list classification. Adding to this theme, in this work, we provide a complete characterization of list PAC regression. We propose two combinatorial dimensions, namely the $k$-OIG dimension and the $k$-fat-shattering dimension, and show that they characterize realizable and agnostic $k$-list regression respectively. These quantities generalize known dimensions for standard regression. Our work thus extends existing list learning characterizations from classification to regression.
format Preprint
id arxiv_https___arxiv_org_abs_2409_19218
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Characterization of List Regression
Pabbaraju, Chirag
Sarmasarkar, Sahasrajit
Machine Learning
Data Structures and Algorithms
There has been a recent interest in understanding and characterizing the sample complexity of list learning tasks, where the learning algorithm is allowed to make a short list of $k$ predictions, and we simply require one of the predictions to be correct. This includes recent works characterizing the PAC sample complexity of standard list classification and online list classification. Adding to this theme, in this work, we provide a complete characterization of list PAC regression. We propose two combinatorial dimensions, namely the $k$-OIG dimension and the $k$-fat-shattering dimension, and show that they characterize realizable and agnostic $k$-list regression respectively. These quantities generalize known dimensions for standard regression. Our work thus extends existing list learning characterizations from classification to regression.
title A Characterization of List Regression
topic Machine Learning
Data Structures and Algorithms
url https://arxiv.org/abs/2409.19218