Potential root mean square error skill score

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Mayer, Martin János, Yang, Dazhi
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929509692866560
author Mayer, Martin János
Yang, Dazhi
author_facet Mayer, Martin János
Yang, Dazhi
contents Consistency, in a narrow sense, denotes the alignment between the forecast-optimization strategy and the verification directive. The current recommended deterministic solar forecast verification practice is to report the skill score based on root mean square error (RMSE), which would violate the notion of consistency if the forecasts are optimized under another strategy such as minimizing the mean absolute error (MAE). This paper overcomes such difficulty by proposing a so-called "potential RMSE skill score," which depends only on: (1) the crosscorrelation between forecasts and observations, and (2) the autocorrelation of observations. While greatly simplifying the calculation, the new skill score does not discriminate inconsistent forecasts as much, e.g., even MAE-optimized forecasts can attain a high RMSE skill score.
format Preprint
id arxiv_https___arxiv_org_abs_2409_14263
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Potential root mean square error skill score
Mayer, Martin János
Yang, Dazhi
Methodology
Consistency, in a narrow sense, denotes the alignment between the forecast-optimization strategy and the verification directive. The current recommended deterministic solar forecast verification practice is to report the skill score based on root mean square error (RMSE), which would violate the notion of consistency if the forecasts are optimized under another strategy such as minimizing the mean absolute error (MAE). This paper overcomes such difficulty by proposing a so-called "potential RMSE skill score," which depends only on: (1) the crosscorrelation between forecasts and observations, and (2) the autocorrelation of observations. While greatly simplifying the calculation, the new skill score does not discriminate inconsistent forecasts as much, e.g., even MAE-optimized forecasts can attain a high RMSE skill score.
title Potential root mean square error skill score
topic Methodology
url https://arxiv.org/abs/2409.14263