Linear regression with known noise distribution up to a scale: The reward of not using the OLSE
Fuente:
arXiv
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908620415827968 |
|---|---|
| author | Balabdaoui, Fadoua Leclerc, Justine |
| author_facet | Balabdaoui, Fadoua Leclerc, Justine |
| contents | While the ordinary least squares estimator (OLSE) is still the most used estimator in linear regression models, other estimators can be more efficient when the error distribution is not Gaussian. In this paper, our goal is to evaluate this efficiency in the case of the Maximum Likelihood estimator (MLE) when the noise distribution belongs to a scale family. Under some regularity conditions, we show that (β_n,s_n), the MLE of the unknown regression vector β_0 and the scale s_0 exists and give the expression of the asymptotic efficiency of β_n over the OLSE. For given three scale families of densities, we quantify the true statistical gain of the MLE as a function of their deviation from the Gaussian family. To illustrate the theory, we present simulation results for different settings and also compare the MLE to the OLSE for the real market fish dataset. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_26539 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Linear regression with known noise distribution up to a scale: The reward of not using the OLSE Balabdaoui, Fadoua Leclerc, Justine Statistics Theory While the ordinary least squares estimator (OLSE) is still the most used estimator in linear regression models, other estimators can be more efficient when the error distribution is not Gaussian. In this paper, our goal is to evaluate this efficiency in the case of the Maximum Likelihood estimator (MLE) when the noise distribution belongs to a scale family. Under some regularity conditions, we show that (β_n,s_n), the MLE of the unknown regression vector β_0 and the scale s_0 exists and give the expression of the asymptotic efficiency of β_n over the OLSE. For given three scale families of densities, we quantify the true statistical gain of the MLE as a function of their deviation from the Gaussian family. To illustrate the theory, we present simulation results for different settings and also compare the MLE to the OLSE for the real market fish dataset. |
| title | Linear regression with known noise distribution up to a scale: The reward of not using the OLSE |
| topic | Statistics Theory |
| url | https://arxiv.org/abs/2510.26539 |