Robust Calibration For Improved Weather Prediction Under Distributional Shift
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910290716655616 |
|---|---|
| author | Gilda, Sankalp Bhandari, Neel Mak, Wendy Panizza, Andrea |
| author_facet | Gilda, Sankalp Bhandari, Neel Mak, Wendy Panizza, Andrea |
| contents | In this paper, we present results on improving out-of-domain weather prediction and uncertainty estimation as part of the \texttt{Shifts Challenge on Robustness and Uncertainty under Real-World Distributional Shift} challenge. We find that by leveraging a mixture of experts in conjunction with an advanced data augmentation technique borrowed from the computer vision domain, in conjunction with robust \textit{post-hoc} calibration of predictive uncertainties, we can potentially achieve more accurate and better-calibrated results with deep neural networks than with boosted tree models for tabular data. We quantify our predictions using several metrics and propose several future lines of inquiry and experimentation to boost performance. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_04144 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Robust Calibration For Improved Weather Prediction Under Distributional Shift Gilda, Sankalp Bhandari, Neel Mak, Wendy Panizza, Andrea Machine Learning Artificial Intelligence In this paper, we present results on improving out-of-domain weather prediction and uncertainty estimation as part of the \texttt{Shifts Challenge on Robustness and Uncertainty under Real-World Distributional Shift} challenge. We find that by leveraging a mixture of experts in conjunction with an advanced data augmentation technique borrowed from the computer vision domain, in conjunction with robust \textit{post-hoc} calibration of predictive uncertainties, we can potentially achieve more accurate and better-calibrated results with deep neural networks than with boosted tree models for tabular data. We quantify our predictions using several metrics and propose several future lines of inquiry and experimentation to boost performance. |
| title | Robust Calibration For Improved Weather Prediction Under Distributional Shift |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2401.04144 |