Towards regularized learning from functional data with covariate shift
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911405388595200 |
|---|---|
| author | Holzleitner, Markus Pereverzyev Jr., Sergiy Pereverzyev, Sergei V. Silmana, Vaibhav Sivananthan, S. |
| author_facet | Holzleitner, Markus Pereverzyev Jr., Sergiy Pereverzyev, Sergei V. Silmana, Vaibhav Sivananthan, S. |
| contents | This paper investigates a general regularization framework for unsupervised domain adaptation in vector-valued regression under the covariate shift assumption, utilizing vector-valued reproducing kernel Hilbert spaces (vRKHS). Covariate shift occurs when the input distributions of the training and test data differ, introducing significant challenges for reliable learning. By restricting the hypothesis space, we develop a practical operator learning algorithm capable of handling functional outputs. We establish optimal convergence rates for the proposed framework under a general source condition, providing a theoretical foundation for regularized learning in this setting. We also propose an aggregation-based approach that forms a linear combination of estimators corresponding to different regularization parameters and different kernels. The proposed approach addresses the challenge of selecting appropriate tuning parameters, which is crucial for constructing a good estimator, and we provide a theoretical justification for its effectiveness. Furthermore, we illustrate the proposed method on a real-world face image dataset, demonstrating robustness and effectiveness in mitigating distributional discrepancies under covariate shift. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_21019 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Towards regularized learning from functional data with covariate shift Holzleitner, Markus Pereverzyev Jr., Sergiy Pereverzyev, Sergei V. Silmana, Vaibhav Sivananthan, S. Statistics Theory Machine Learning Numerical Analysis 68T05, 68Q32 This paper investigates a general regularization framework for unsupervised domain adaptation in vector-valued regression under the covariate shift assumption, utilizing vector-valued reproducing kernel Hilbert spaces (vRKHS). Covariate shift occurs when the input distributions of the training and test data differ, introducing significant challenges for reliable learning. By restricting the hypothesis space, we develop a practical operator learning algorithm capable of handling functional outputs. We establish optimal convergence rates for the proposed framework under a general source condition, providing a theoretical foundation for regularized learning in this setting. We also propose an aggregation-based approach that forms a linear combination of estimators corresponding to different regularization parameters and different kernels. The proposed approach addresses the challenge of selecting appropriate tuning parameters, which is crucial for constructing a good estimator, and we provide a theoretical justification for its effectiveness. Furthermore, we illustrate the proposed method on a real-world face image dataset, demonstrating robustness and effectiveness in mitigating distributional discrepancies under covariate shift. |
| title | Towards regularized learning from functional data with covariate shift |
| topic | Statistics Theory Machine Learning Numerical Analysis 68T05, 68Q32 |
| url | https://arxiv.org/abs/2601.21019 |