IDOBE: Infectious Disease Outbreak forecasting Benchmark Ecosystem

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Adiga, Aniruddha, Chou, Jingyuan, Chiranth, Anshul, Lewis, Bryan, Bento, Ana I., Truelove, Shaun, Fox, Geoffrey, Marathe, Madhav, Hochheiser, Harry, Venkatramanan, Srini
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913072417865728
author Adiga, Aniruddha
Chou, Jingyuan
Chiranth, Anshul
Lewis, Bryan
Bento, Ana I.
Truelove, Shaun
Fox, Geoffrey
Marathe, Madhav
Hochheiser, Harry
Venkatramanan, Srini
author_facet Adiga, Aniruddha
Chou, Jingyuan
Chiranth, Anshul
Lewis, Bryan
Bento, Ana I.
Truelove, Shaun
Fox, Geoffrey
Marathe, Madhav
Hochheiser, Harry
Venkatramanan, Srini
contents Epidemic forecasting has become an integral part of real-time infectious disease outbreak response. While collaborative ensembles composed of statistical and machine learning models have become the norm for real-time forecasting, standardized benchmark datasets for evaluating such methods are lacking. Further, there is limited understanding on performance of these methods for novel outbreaks with limited historical data. In this paper, we propose IDOBE, a curated collection of epidemiological time series focused on outbreak forecasting. IDOBE compiles from multiple data repositories spanning over a century of surveillance and across U.S. states and global locations. We perform derivative-based segmentation to generate over 10,000 outbreaks covering multiple outcomes such as cases and hospitalizations for 13 diseases. We consider a variety of information-theoretic and distributional measures to quantify the epidemiological diversity of the dataset. Finally, we perform multi-horizon short-term forecasting (1- to 4-week-ahead) through the progression of the outbreak using 11 baseline models and report on their performance. In addition to standard metrics such as NMSE and MAPE for point forecasts, we include probabilistic scoring rules such as Normalized Weighted Interval Score (NWIS) to quantify the performance. We find that MLP-based methods have the most robust performance, with statistical methods having a slight edge during the pre-peak phase. IDOBE dataset along with baselines are released publicly on https://github.com/NSSAC/IDOBE to enable standardized, reproducible benchmarking of outbreak forecasting methods.
format Preprint
id arxiv_https___arxiv_org_abs_2604_18521
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle IDOBE: Infectious Disease Outbreak forecasting Benchmark Ecosystem
Adiga, Aniruddha
Chou, Jingyuan
Chiranth, Anshul
Lewis, Bryan
Bento, Ana I.
Truelove, Shaun
Fox, Geoffrey
Marathe, Madhav
Hochheiser, Harry
Venkatramanan, Srini
Machine Learning
Artificial Intelligence
Populations and Evolution
Epidemic forecasting has become an integral part of real-time infectious disease outbreak response. While collaborative ensembles composed of statistical and machine learning models have become the norm for real-time forecasting, standardized benchmark datasets for evaluating such methods are lacking. Further, there is limited understanding on performance of these methods for novel outbreaks with limited historical data. In this paper, we propose IDOBE, a curated collection of epidemiological time series focused on outbreak forecasting. IDOBE compiles from multiple data repositories spanning over a century of surveillance and across U.S. states and global locations. We perform derivative-based segmentation to generate over 10,000 outbreaks covering multiple outcomes such as cases and hospitalizations for 13 diseases. We consider a variety of information-theoretic and distributional measures to quantify the epidemiological diversity of the dataset. Finally, we perform multi-horizon short-term forecasting (1- to 4-week-ahead) through the progression of the outbreak using 11 baseline models and report on their performance. In addition to standard metrics such as NMSE and MAPE for point forecasts, we include probabilistic scoring rules such as Normalized Weighted Interval Score (NWIS) to quantify the performance. We find that MLP-based methods have the most robust performance, with statistical methods having a slight edge during the pre-peak phase. IDOBE dataset along with baselines are released publicly on https://github.com/NSSAC/IDOBE to enable standardized, reproducible benchmarking of outbreak forecasting methods.
title IDOBE: Infectious Disease Outbreak forecasting Benchmark Ecosystem
topic Machine Learning
Artificial Intelligence
Populations and Evolution
url https://arxiv.org/abs/2604.18521