On the use of the principle of maximum entropy to improve the robustness of bivariate spline least-squares approximation
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866915424610811904 |
|---|---|
| author | Amodio, Pierluigi Brugnano, Luigi Iavernaro, Felice |
| author_facet | Amodio, Pierluigi Brugnano, Luigi Iavernaro, Felice |
| contents | We consider fitting a bivariate spline regression model to data using a weighted least-squares cost function, with weights that sum to one to form a discrete probability distribution. By applying the principle of maximum entropy, the weight distribution is determined by maximizing the associated entropy function. This approach, previously applied successfully to polynomials and spline curves, enhances the robustness of the regression model by automatically detecting and down-weighting anomalous data during the fitting process. To demonstrate the effectiveness of the method, we present applications to two image processing problems and further illustrate its potential through two synthetic examples.
Unlike the standard ordinary least-squares method, the maximum entropy formulation leads to a nonlinear algebraic system whose solvability requires careful theoretical analysis. We provide preliminary results in this direction and discuss the computational implications of solving the associated constrained optimization problem, which calls for dedicated iterative algorithms. These aspects suggest natural directions for further research on both the theoretical and algorithmic fronts. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_00942 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | On the use of the principle of maximum entropy to improve the robustness of bivariate spline least-squares approximation Amodio, Pierluigi Brugnano, Luigi Iavernaro, Felice Methodology Numerical Analysis 65D10, 94A17 We consider fitting a bivariate spline regression model to data using a weighted least-squares cost function, with weights that sum to one to form a discrete probability distribution. By applying the principle of maximum entropy, the weight distribution is determined by maximizing the associated entropy function. This approach, previously applied successfully to polynomials and spline curves, enhances the robustness of the regression model by automatically detecting and down-weighting anomalous data during the fitting process. To demonstrate the effectiveness of the method, we present applications to two image processing problems and further illustrate its potential through two synthetic examples. Unlike the standard ordinary least-squares method, the maximum entropy formulation leads to a nonlinear algebraic system whose solvability requires careful theoretical analysis. We provide preliminary results in this direction and discuss the computational implications of solving the associated constrained optimization problem, which calls for dedicated iterative algorithms. These aspects suggest natural directions for further research on both the theoretical and algorithmic fronts. |
| title | On the use of the principle of maximum entropy to improve the robustness of bivariate spline least-squares approximation |
| topic | Methodology Numerical Analysis 65D10, 94A17 |
| url | https://arxiv.org/abs/2503.00942 |