Saved in:
Bibliographic Details
Main Author: Beuoy, Michael
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2602.09982
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914319661268992
author Beuoy, Michael
author_facet Beuoy, Michael
contents This paper proposes a new way of evaluating the accuracy and validity of probabilistic forecasts that change over time (such as an in-game win probability model, or an election forecast). Under this approach, each model to be evaluated is treated as a canonical Kelly bettor, and the models are pitted against each other in an iterative betting contest. The growth or decline of each model's bankroll serves as the evaluation metric. Under this approach, market consensus probabilities and implied model credibilities can be updated real time as each model updates, and do not require one to wait for the final outcome. Using a simulation model, it will be shown that this method is in general more accurate than traditional average log-loss and Brier score methods at distinguishing a correct model from an incorrect model. This Kelly approach is shown to have a direct mathematical and conceptual analogue to Bayesian inference, with bankroll serving as a proxy for Bayesian credibility.
format Preprint
id arxiv_https___arxiv_org_abs_2602_09982
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Kelly Betting as Bayesian Model Evaluation: A Framework for Time-Updating Probabilistic Forecasts
Beuoy, Michael
Methodology
This paper proposes a new way of evaluating the accuracy and validity of probabilistic forecasts that change over time (such as an in-game win probability model, or an election forecast). Under this approach, each model to be evaluated is treated as a canonical Kelly bettor, and the models are pitted against each other in an iterative betting contest. The growth or decline of each model's bankroll serves as the evaluation metric. Under this approach, market consensus probabilities and implied model credibilities can be updated real time as each model updates, and do not require one to wait for the final outcome. Using a simulation model, it will be shown that this method is in general more accurate than traditional average log-loss and Brier score methods at distinguishing a correct model from an incorrect model. This Kelly approach is shown to have a direct mathematical and conceptual analogue to Bayesian inference, with bankroll serving as a proxy for Bayesian credibility.
title Kelly Betting as Bayesian Model Evaluation: A Framework for Time-Updating Probabilistic Forecasts
topic Methodology
url https://arxiv.org/abs/2602.09982