Saved in:
Bibliographic Details
Main Authors: Hu, Haichen, Simchi-Levi, David
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2507.07852
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913936586047488
author Hu, Haichen
Simchi-Levi, David
author_facet Hu, Haichen
Simchi-Levi, David
contents We study a sequential contextual decision-making problem in which certain covariates are missing but can be imputed using a pre-trained AI model. From a theoretical perspective, we analyze how the presence of such a model influences the regret of the decision-making process. We introduce a novel notion called "model elasticity", which quantifies the sensitivity of the reward function to the discrepancy between the true covariate and its imputed counterpart. This concept provides a unified way to characterize the regret incurred due to model imputation, regardless of the underlying missingness mechanism. More surprisingly, we show that under the missing at random (MAR) setting, it is possible to sequentially calibrate the pre-trained model using tools from orthogonal statistical learning and doubly robust regression. This calibration significantly improves the quality of the imputed covariates, leading to much better regret guarantees. Our analysis highlights the practical value of having an accurate pre-trained model in sequential decision-making tasks and suggests that model elasticity may serve as a fundamental metric for understanding and improving the integration of pre-trained models in a wide range of data-driven decision-making problems.
format Preprint
id arxiv_https___arxiv_org_abs_2507_07852
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Pre-Trained AI Model Assisted Online Decision-Making under Missing Covariates: A Theoretical Perspective
Hu, Haichen
Simchi-Levi, David
Machine Learning
We study a sequential contextual decision-making problem in which certain covariates are missing but can be imputed using a pre-trained AI model. From a theoretical perspective, we analyze how the presence of such a model influences the regret of the decision-making process. We introduce a novel notion called "model elasticity", which quantifies the sensitivity of the reward function to the discrepancy between the true covariate and its imputed counterpart. This concept provides a unified way to characterize the regret incurred due to model imputation, regardless of the underlying missingness mechanism. More surprisingly, we show that under the missing at random (MAR) setting, it is possible to sequentially calibrate the pre-trained model using tools from orthogonal statistical learning and doubly robust regression. This calibration significantly improves the quality of the imputed covariates, leading to much better regret guarantees. Our analysis highlights the practical value of having an accurate pre-trained model in sequential decision-making tasks and suggests that model elasticity may serve as a fundamental metric for understanding and improving the integration of pre-trained models in a wide range of data-driven decision-making problems.
title Pre-Trained AI Model Assisted Online Decision-Making under Missing Covariates: A Theoretical Perspective
topic Machine Learning
url https://arxiv.org/abs/2507.07852