Robust Calibration For Improved Weather Prediction Under Distributional Shift

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Gilda, Sankalp, Bhandari, Neel, Mak, Wendy, Panizza, Andrea
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910290716655616
author Gilda, Sankalp
Bhandari, Neel
Mak, Wendy
Panizza, Andrea
author_facet Gilda, Sankalp
Bhandari, Neel
Mak, Wendy
Panizza, Andrea
contents In this paper, we present results on improving out-of-domain weather prediction and uncertainty estimation as part of the \texttt{Shifts Challenge on Robustness and Uncertainty under Real-World Distributional Shift} challenge. We find that by leveraging a mixture of experts in conjunction with an advanced data augmentation technique borrowed from the computer vision domain, in conjunction with robust \textit{post-hoc} calibration of predictive uncertainties, we can potentially achieve more accurate and better-calibrated results with deep neural networks than with boosted tree models for tabular data. We quantify our predictions using several metrics and propose several future lines of inquiry and experimentation to boost performance.
format Preprint
id arxiv_https___arxiv_org_abs_2401_04144
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Robust Calibration For Improved Weather Prediction Under Distributional Shift
Gilda, Sankalp
Bhandari, Neel
Mak, Wendy
Panizza, Andrea
Machine Learning
Artificial Intelligence
In this paper, we present results on improving out-of-domain weather prediction and uncertainty estimation as part of the \texttt{Shifts Challenge on Robustness and Uncertainty under Real-World Distributional Shift} challenge. We find that by leveraging a mixture of experts in conjunction with an advanced data augmentation technique borrowed from the computer vision domain, in conjunction with robust \textit{post-hoc} calibration of predictive uncertainties, we can potentially achieve more accurate and better-calibrated results with deep neural networks than with boosted tree models for tabular data. We quantify our predictions using several metrics and propose several future lines of inquiry and experimentation to boost performance.
title Robust Calibration For Improved Weather Prediction Under Distributional Shift
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2401.04144