Retraining as Approximate Bayesian Inference

Fuente: arXiv
Saved in:
Bibliographic Details
Main Author: Katz, Harrison
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912983810048000
author Katz, Harrison
author_facet Katz, Harrison
contents Model retraining is usually treated as an ongoing maintenance task. But as Harrison Katz now argues, retraining can be better understood as approximate Bayesian inference under computational constraints. The gap between a continuously updated belief state and your frozen deployed model is "learning debt," and the retraining decision is a cost minimization problem with a threshold that falls out of your loss function. In this article Katz provides a decision-theoretic framework for retraining policies. The result is evidence-based triggers that replace calendar schedules and make governance auditable. For readers less familiar with the Bayesian and decision-theoretic language, key terms are defined in a glossary at the end of the article.
format Preprint
id arxiv_https___arxiv_org_abs_2603_25480
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Retraining as Approximate Bayesian Inference
Katz, Harrison
Artificial Intelligence
Statistics Theory
Model retraining is usually treated as an ongoing maintenance task. But as Harrison Katz now argues, retraining can be better understood as approximate Bayesian inference under computational constraints. The gap between a continuously updated belief state and your frozen deployed model is "learning debt," and the retraining decision is a cost minimization problem with a threshold that falls out of your loss function. In this article Katz provides a decision-theoretic framework for retraining policies. The result is evidence-based triggers that replace calendar schedules and make governance auditable. For readers less familiar with the Bayesian and decision-theoretic language, key terms are defined in a glossary at the end of the article.
title Retraining as Approximate Bayesian Inference
topic Artificial Intelligence
Statistics Theory
url https://arxiv.org/abs/2603.25480