MoGU: Mixture-of-Gaussians with Uncertainty-based Gating for Time Series Forecasting

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Aviv, Gilad, Goldberger, Jacob, Shavit, Yoli
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910009354354688
author Aviv, Gilad
Goldberger, Jacob
Shavit, Yoli
author_facet Aviv, Gilad
Goldberger, Jacob
Shavit, Yoli
contents We introduce Mixture-of-Gaussians with Uncertainty-based Gating (MoGU), a novel Mixture-of-Experts (MoE) framework designed for regression tasks. MoGU replaces standard learned gating with an intrinsic routing paradigm where expert-specific uncertainty serves as the native gating signal. By modeling each prediction as a Gaussian distribution, the system utilizes predicted variance to dynamically weight expert contributions. We validate MoGU on multivariate time-series forecasting, a domain defined by high volatility and varying noise patterns. Empirical results across multiple benchmarks, horizon lengths, and backbones demonstrate that MoGU consistently improves forecasting accuracy compared to traditional MoE. Further evaluation via conformal prediction indicates that our approach yields more efficient prediction intervals than existing baselines. These findings highlight MoGU's capacity for providing both competitive performance and reliable, high-fidelity uncertainty quantification. Our code is available at: https://github.com/yolish/moe_unc_tsf
format Preprint
id arxiv_https___arxiv_org_abs_2510_07459
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MoGU: Mixture-of-Gaussians with Uncertainty-based Gating for Time Series Forecasting
Aviv, Gilad
Goldberger, Jacob
Shavit, Yoli
Machine Learning
Artificial Intelligence
We introduce Mixture-of-Gaussians with Uncertainty-based Gating (MoGU), a novel Mixture-of-Experts (MoE) framework designed for regression tasks. MoGU replaces standard learned gating with an intrinsic routing paradigm where expert-specific uncertainty serves as the native gating signal. By modeling each prediction as a Gaussian distribution, the system utilizes predicted variance to dynamically weight expert contributions. We validate MoGU on multivariate time-series forecasting, a domain defined by high volatility and varying noise patterns. Empirical results across multiple benchmarks, horizon lengths, and backbones demonstrate that MoGU consistently improves forecasting accuracy compared to traditional MoE. Further evaluation via conformal prediction indicates that our approach yields more efficient prediction intervals than existing baselines. These findings highlight MoGU's capacity for providing both competitive performance and reliable, high-fidelity uncertainty quantification. Our code is available at: https://github.com/yolish/moe_unc_tsf
title MoGU: Mixture-of-Gaussians with Uncertainty-based Gating for Time Series Forecasting
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2510.07459