Saved in:
Bibliographic Details
Main Author: Coleman, Charles D.
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2505.18130
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909709751025664
author Coleman, Charles D.
author_facet Coleman, Charles D.
contents Measuring the accuracy of cross-sectional predictions is a subjective problem. Generally, this problem is avoided. In contrast, this paper confronts subjectivity up front by eliciting an impartial decision-maker's preferences. These preferences are embedded into an axiomatically-derived loss function, one of the simplest version of which is described. The parameters of the loss function can be estimated by linear regression. Specification tests for this function are described. This framework is extended to weighted averages of estimates to find the optimal weightings. A special case occurs when the predictions represent resource allocations: the apportionment literature is used to construct the Webster-Saint Lagüe Rule, a particular parametrization of the loss function. These loss functions are compared to those existing in the literature. Finally, a family of bias measures are created using signed versions of these loss functions.
format Preprint
id arxiv_https___arxiv_org_abs_2505_18130
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Loss Functions for Measuring the Accuracy of Nonnegative Cross-Sectional Predictions
Coleman, Charles D.
Methodology
Statistics Theory
91C05
Measuring the accuracy of cross-sectional predictions is a subjective problem. Generally, this problem is avoided. In contrast, this paper confronts subjectivity up front by eliciting an impartial decision-maker's preferences. These preferences are embedded into an axiomatically-derived loss function, one of the simplest version of which is described. The parameters of the loss function can be estimated by linear regression. Specification tests for this function are described. This framework is extended to weighted averages of estimates to find the optimal weightings. A special case occurs when the predictions represent resource allocations: the apportionment literature is used to construct the Webster-Saint Lagüe Rule, a particular parametrization of the loss function. These loss functions are compared to those existing in the literature. Finally, a family of bias measures are created using signed versions of these loss functions.
title Loss Functions for Measuring the Accuracy of Nonnegative Cross-Sectional Predictions
topic Methodology
Statistics Theory
91C05
url https://arxiv.org/abs/2505.18130