KMM-CP: Practical Conformal Prediction under Covariate Shift via Selective Kernel Mean Matching

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Laghuvarapu, Siddhartha, Deb, Rohan, Sun, Jimeng
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911548243443712
author Laghuvarapu, Siddhartha
Deb, Rohan
Sun, Jimeng
author_facet Laghuvarapu, Siddhartha
Deb, Rohan
Sun, Jimeng
contents Uncertainty quantification is essential for deploying machine learning models in high-stakes domains such as scientific discovery and healthcare. Conformal Prediction (CP) provides finite-sample coverage guarantees under exchangeability, an assumption often violated in practice due to distribution shift. Under covariate shift, restoring validity requires importance weighting, yet accurate density-ratio estimation becomes unstable when training and test distributions exhibit limited support overlap. We propose KMM-CP, a conformal prediction framework based on Kernel Mean Matching (KMM) for covariate-shift correction. We show that KMM directly controls the bias-variance components governing conformal coverage error by minimizing RKHS moment discrepancy under explicit weight constraints, and establish asymptotic coverage guarantees under mild conditions. We then introduce a selective extension that identifies regions of reliable support overlap and restricts conformal correction to this subset, further improving stability in low-overlap regimes. Experiments on molecular property prediction benchmarks with realistic distribution shifts show that KMM-CP reduces coverage gap by over 50% compared to existing approaches. The code is available at https://github.com/siddharthal/KMM-CP.
format Preprint
id arxiv_https___arxiv_org_abs_2603_26415
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle KMM-CP: Practical Conformal Prediction under Covariate Shift via Selective Kernel Mean Matching
Laghuvarapu, Siddhartha
Deb, Rohan
Sun, Jimeng
Machine Learning
Artificial Intelligence
Applications
Uncertainty quantification is essential for deploying machine learning models in high-stakes domains such as scientific discovery and healthcare. Conformal Prediction (CP) provides finite-sample coverage guarantees under exchangeability, an assumption often violated in practice due to distribution shift. Under covariate shift, restoring validity requires importance weighting, yet accurate density-ratio estimation becomes unstable when training and test distributions exhibit limited support overlap. We propose KMM-CP, a conformal prediction framework based on Kernel Mean Matching (KMM) for covariate-shift correction. We show that KMM directly controls the bias-variance components governing conformal coverage error by minimizing RKHS moment discrepancy under explicit weight constraints, and establish asymptotic coverage guarantees under mild conditions. We then introduce a selective extension that identifies regions of reliable support overlap and restricts conformal correction to this subset, further improving stability in low-overlap regimes. Experiments on molecular property prediction benchmarks with realistic distribution shifts show that KMM-CP reduces coverage gap by over 50% compared to existing approaches. The code is available at https://github.com/siddharthal/KMM-CP.
title KMM-CP: Practical Conformal Prediction under Covariate Shift via Selective Kernel Mean Matching
topic Machine Learning
Artificial Intelligence
Applications
url https://arxiv.org/abs/2603.26415