Saved in:
Bibliographic Details
Main Authors: Reid, Mirabel, Sühr, Tom, Vernade, Claire, Samadi, Samira
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2409.20489
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916415884230656
author Reid, Mirabel
Sühr, Tom
Vernade, Claire
Samadi, Samira
author_facet Reid, Mirabel
Sühr, Tom
Vernade, Claire
Samadi, Samira
contents Machine Learning (ML) models are increasingly used to support or substitute decision making. In applications where skilled experts are a limited resource, it is crucial to reduce their burden and automate decisions when the performance of an ML model is at least of equal quality. However, models are often pre-trained and fixed, while tasks arrive sequentially and their distribution may shift. In that case, the respective performance of the decision makers may change, and the deferral algorithm must remain adaptive. We propose a contextual bandit model of this online decision making problem. Our framework includes budget constraints and different types of partial feedback models. Beyond the theoretical guarantees of our algorithm, we propose efficient extensions that achieve remarkable performance on real-world datasets.
format Preprint
id arxiv_https___arxiv_org_abs_2409_20489
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Online Decision Deferral under Budget Constraints
Reid, Mirabel
Sühr, Tom
Vernade, Claire
Samadi, Samira
Machine Learning
Machine Learning (ML) models are increasingly used to support or substitute decision making. In applications where skilled experts are a limited resource, it is crucial to reduce their burden and automate decisions when the performance of an ML model is at least of equal quality. However, models are often pre-trained and fixed, while tasks arrive sequentially and their distribution may shift. In that case, the respective performance of the decision makers may change, and the deferral algorithm must remain adaptive. We propose a contextual bandit model of this online decision making problem. Our framework includes budget constraints and different types of partial feedback models. Beyond the theoretical guarantees of our algorithm, we propose efficient extensions that achieve remarkable performance on real-world datasets.
title Online Decision Deferral under Budget Constraints
topic Machine Learning
url https://arxiv.org/abs/2409.20489