Saved in:
Bibliographic Details
Main Authors: Pour, Alireza F., Mansouri, Farnam, Ben-David, Shai
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2602.09402
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • We study an online learning problem with multiple correct answers, where each instance admits a set of valid labels, and in each round the learner must output a valid label for the queried example. This setting is motivated by language generation tasks, in which a prompt may admit many acceptable completions, but not every completion is acceptable. We study this problem under three feedback models. For each model, we characterize the optimal mistake bound in the realizable setting using an appropriate combinatorial dimension. We then establish a trichotomy of regret bounds across the three models in the agnostic setting. Our results also imply sample complexity bounds for the batch setup that depend on the respective combinatorial dimensions.