Saved in:
Bibliographic Details
Main Authors: Mountasir, Nassime, Lafabregue, Baptiste, Albert, Bruno, Lachiche, Nicolas
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2603.19291
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908901784420352
author Mountasir, Nassime
Lafabregue, Baptiste
Albert, Bruno
Lachiche, Nicolas
author_facet Mountasir, Nassime
Lafabregue, Baptiste
Albert, Bruno
Lachiche, Nicolas
contents As regression is a widely studied problem, many methods have been proposed to solve it, each of them often requiring setting different hyper-parameters. Therefore, selecting the proper method for a given application may be very difficult and relies on comparing their performances. Performance is usually measured using various metrics such as Mean Absolute Error (MAE), Root Mean Squared Error (RMSE), or R-squared (R${}^2$). These metrics provide a numerical summary of predictive accuracy by quantifying the difference between predicted and actual values. However, while these metrics are widely used in the literature for summarizing model performance and useful to distinguish between models performing poorly and well, they often aggregate too much information. This article addresses these limitations by introducing a novel visualization approach that highlights key aspects of regression model performance. The proposed method builds upon three main contributions: (1) considering the residuals in a 2D space, which allows for simultaneous evaluation of errors from two models, (2) leveraging the Mahalanobis distance to account for correlations and differences in scale within the data, and (3) employing a colormap to visualize the percentile-based distribution of errors, making it easier to identify dense regions and outliers. By graphically representing the distribution of errors and their correlations, this approach provides a more detailed and comprehensive view of model performance, enabling users to uncover patterns that traditional aggregate metrics may obscure. The proposed visualization method facilitates a deeper understanding of regression model performance differences and error distributions, enhancing the evaluation and comparison process.
format Preprint
id arxiv_https___arxiv_org_abs_2603_19291
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle A Visualization for Comparative Analysis of Regression Models
Mountasir, Nassime
Lafabregue, Baptiste
Albert, Bruno
Lachiche, Nicolas
Machine Learning
Artificial Intelligence
As regression is a widely studied problem, many methods have been proposed to solve it, each of them often requiring setting different hyper-parameters. Therefore, selecting the proper method for a given application may be very difficult and relies on comparing their performances. Performance is usually measured using various metrics such as Mean Absolute Error (MAE), Root Mean Squared Error (RMSE), or R-squared (R${}^2$). These metrics provide a numerical summary of predictive accuracy by quantifying the difference between predicted and actual values. However, while these metrics are widely used in the literature for summarizing model performance and useful to distinguish between models performing poorly and well, they often aggregate too much information. This article addresses these limitations by introducing a novel visualization approach that highlights key aspects of regression model performance. The proposed method builds upon three main contributions: (1) considering the residuals in a 2D space, which allows for simultaneous evaluation of errors from two models, (2) leveraging the Mahalanobis distance to account for correlations and differences in scale within the data, and (3) employing a colormap to visualize the percentile-based distribution of errors, making it easier to identify dense regions and outliers. By graphically representing the distribution of errors and their correlations, this approach provides a more detailed and comprehensive view of model performance, enabling users to uncover patterns that traditional aggregate metrics may obscure. The proposed visualization method facilitates a deeper understanding of regression model performance differences and error distributions, enhancing the evaluation and comparison process.
title A Visualization for Comparative Analysis of Regression Models
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2603.19291