Marginalize, Rather than Impute: Probabilistic Wind Power Forecasting with Incomplete Data

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Wen, Honglin, Pinson, Pierre, Gu, Jie, Jin, Zhijian
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917120320733184
author Wen, Honglin
Pinson, Pierre
Gu, Jie
Jin, Zhijian
author_facet Wen, Honglin
Pinson, Pierre
Gu, Jie
Jin, Zhijian
contents Machine learning methods are widely and successfully used for probabilistic wind power forecasting, yet the pervasive issue of missing values (e.g., due to sensor faults or communication outages) has received limited attention. The prevailing practice is impute-then-predict, but conditioning on point imputations biases parameter estimates and fails to propagate uncertainty from missing features. Our approach treats missing features and forecast targets uniformly: we learn a joint generative model of features and targets from incomplete data and, at operational deployment, condition on the observed features and marginalize the unobserved ones to produce forecasts. This imputation-free procedure avoids error introduced by imputation and preserves uncertainty aroused from missing features. In experiments, it improves forecast quality in terms of continuous ranked probability score relative to impute-then-predict baselines while incurring substantially lower computational cost than common alternatives.
format Preprint
id arxiv_https___arxiv_org_abs_2403_03631
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Marginalize, Rather than Impute: Probabilistic Wind Power Forecasting with Incomplete Data
Wen, Honglin
Pinson, Pierre
Gu, Jie
Jin, Zhijian
Machine Learning
Systems and Control
Machine learning methods are widely and successfully used for probabilistic wind power forecasting, yet the pervasive issue of missing values (e.g., due to sensor faults or communication outages) has received limited attention. The prevailing practice is impute-then-predict, but conditioning on point imputations biases parameter estimates and fails to propagate uncertainty from missing features. Our approach treats missing features and forecast targets uniformly: we learn a joint generative model of features and targets from incomplete data and, at operational deployment, condition on the observed features and marginalize the unobserved ones to produce forecasts. This imputation-free procedure avoids error introduced by imputation and preserves uncertainty aroused from missing features. In experiments, it improves forecast quality in terms of continuous ranked probability score relative to impute-then-predict baselines while incurring substantially lower computational cost than common alternatives.
title Marginalize, Rather than Impute: Probabilistic Wind Power Forecasting with Incomplete Data
topic Machine Learning
Systems and Control
url https://arxiv.org/abs/2403.03631