Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2408.04391 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917794108407808 |
|---|---|
| author | Most, Thomas Gräning, Lars Wolff, Sebastian |
| author_facet | Most, Thomas Gräning, Lars Wolff, Sebastian |
| contents | In this paper the accuracy and robustness of quality measures for the assessment of machine learning models are investigated. The prediction quality of a machine learning model is evaluated model-independent based on a cross-validation approach, where the approximation error is estimated for unknown data. The presented measures quantify the amount of explained variation in the model prediction. The reliability of these measures is assessed by means of several numerical examples, where an additional data set for the verification of the estimated prediction error is available. Furthermore, the confidence bounds of the presented quality measures are estimated and local quality measures are derived from the prediction residuals obtained by the cross-validation approach. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_04391 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Robustness investigation of cross-validation based quality measures for model assessment Most, Thomas Gräning, Lars Wolff, Sebastian Machine Learning In this paper the accuracy and robustness of quality measures for the assessment of machine learning models are investigated. The prediction quality of a machine learning model is evaluated model-independent based on a cross-validation approach, where the approximation error is estimated for unknown data. The presented measures quantify the amount of explained variation in the model prediction. The reliability of these measures is assessed by means of several numerical examples, where an additional data set for the verification of the estimated prediction error is available. Furthermore, the confidence bounds of the presented quality measures are estimated and local quality measures are derived from the prediction residuals obtained by the cross-validation approach. |
| title | Robustness investigation of cross-validation based quality measures for model assessment |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2408.04391 |