Proper Scoring Rules for Multivariate Probabilistic Forecasts based on Aggregation and Transformation
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866917955314384896 |
|---|---|
| author | Pic, Romain Dombry, Clément Naveau, Philippe Taillardat, Maxime |
| author_facet | Pic, Romain Dombry, Clément Naveau, Philippe Taillardat, Maxime |
| contents | Proper scoring rules are an essential tool to assess the predictive performance of probabilistic forecasts. However, propriety alone does not ensure an informative characterization of predictive performance and it is recommended to compare forecasts using multiple scoring rules. With that in mind, interpretable scoring rules providing complementary information are necessary. We formalize a framework based on aggregation and transformation to build interpretable multivariate proper scoring rules. Aggregation-and-transformation-based scoring rules are able to target specific features of the probabilistic forecasts; which improves the characterization of the predictive performance. This framework is illustrated through examples taken from the literature and studied using numerical experiments showcasing its benefits. In particular, it is shown that it can help bridge the gap between proper scoring rules and spatial verification tools. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_00650 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Proper Scoring Rules for Multivariate Probabilistic Forecasts based on Aggregation and Transformation Pic, Romain Dombry, Clément Naveau, Philippe Taillardat, Maxime Methodology Statistics Theory Applications Proper scoring rules are an essential tool to assess the predictive performance of probabilistic forecasts. However, propriety alone does not ensure an informative characterization of predictive performance and it is recommended to compare forecasts using multiple scoring rules. With that in mind, interpretable scoring rules providing complementary information are necessary. We formalize a framework based on aggregation and transformation to build interpretable multivariate proper scoring rules. Aggregation-and-transformation-based scoring rules are able to target specific features of the probabilistic forecasts; which improves the characterization of the predictive performance. This framework is illustrated through examples taken from the literature and studied using numerical experiments showcasing its benefits. In particular, it is shown that it can help bridge the gap between proper scoring rules and spatial verification tools. |
| title | Proper Scoring Rules for Multivariate Probabilistic Forecasts based on Aggregation and Transformation |
| topic | Methodology Statistics Theory Applications |
| url | https://arxiv.org/abs/2407.00650 |