Saved in:
Bibliographic Details
Main Authors: Lee, Yonghoon, Ren, Zhimei
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2509.21691
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912606337368064
author Lee, Yonghoon
Ren, Zhimei
author_facet Lee, Yonghoon
Ren, Zhimei
contents We consider the problem of distribution-free conditional predictive inference. Prior work has established that achieving exact finite-sample control of conditional coverage without distributional assumptions is impossible, in the sense that it necessarily results in trivial prediction sets. While several lines of work have proposed methods targeting relaxed notions of conditional coverage guarantee, the inherent difficulty of the problem typically leads such methods to offer only approximate guarantees or yield less direct interpretations, even with the relaxations. In this work, we propose an inferential target as a relaxed version of conditional predictive inference that is achievable with exact distribution-free finite sample control, while also offering intuitive interpretations. One of the key ideas, though simple, is to view conditional coverage as a function rather than a scalar, and thereby aim to control its function norm. We propose a procedure that controls the $L^k$-norm -- while primarily focusing on the $L^2$-norm -- of a relaxed notion of conditional coverage, adapting to different approaches depending on the choice of hyperparameter (e.g., local-conditional coverage, smoothed conditional coverage, or conditional coverage for a perturbed sample). We illustrate the performance of our procedure as a tool for conditional predictive inference, through simulations and experiments on a real dataset.
format Preprint
id arxiv_https___arxiv_org_abs_2509_21691
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Conditional predictive inference with $L^k$-coverage control
Lee, Yonghoon
Ren, Zhimei
Methodology
We consider the problem of distribution-free conditional predictive inference. Prior work has established that achieving exact finite-sample control of conditional coverage without distributional assumptions is impossible, in the sense that it necessarily results in trivial prediction sets. While several lines of work have proposed methods targeting relaxed notions of conditional coverage guarantee, the inherent difficulty of the problem typically leads such methods to offer only approximate guarantees or yield less direct interpretations, even with the relaxations. In this work, we propose an inferential target as a relaxed version of conditional predictive inference that is achievable with exact distribution-free finite sample control, while also offering intuitive interpretations. One of the key ideas, though simple, is to view conditional coverage as a function rather than a scalar, and thereby aim to control its function norm. We propose a procedure that controls the $L^k$-norm -- while primarily focusing on the $L^2$-norm -- of a relaxed notion of conditional coverage, adapting to different approaches depending on the choice of hyperparameter (e.g., local-conditional coverage, smoothed conditional coverage, or conditional coverage for a perturbed sample). We illustrate the performance of our procedure as a tool for conditional predictive inference, through simulations and experiments on a real dataset.
title Conditional predictive inference with $L^k$-coverage control
topic Methodology
url https://arxiv.org/abs/2509.21691