Saved in:
Bibliographic Details
Main Authors: Pour, Alireza F., Ben-David, Shai
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2511.09996
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • We address the general task of learning with a set of candidate models that is too large to have a uniform convergence of empirical estimates to true losses. While the common approach to such challenges is SRM (or regularization) based learning algorithms, we propose a novel learning paradigm that relies on stronger incorporation of empirical data and requires less algorithmic decisions to be based on prior assumptions. We analyze the generalization capabilities of our approach and demonstrate its merits in several common learning assumptions, including similarity of close points, clustering of the domain into highly label-homogeneous regions, Lipschitzness assumptions of the labeling rule, and contrastive learning assumptions. Our approach allows utilizing such assumptions without the need to know their true parameters a priori.