Control-Augmented Autoregressive Diffusion for Data Assimilation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Srivastava, Prakhar, Sofian, Farrin Marouf, Immorlano, Francesco, Pandey, Kushagra, Mandt, Stephan
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915996882698240
author Srivastava, Prakhar
Sofian, Farrin Marouf
Immorlano, Francesco
Pandey, Kushagra
Mandt, Stephan
author_facet Srivastava, Prakhar
Sofian, Farrin Marouf
Immorlano, Francesco
Pandey, Kushagra
Mandt, Stephan
contents Despite advances in test-time scaling and diffusion finetuning, guidance for Auto-Regressive Diffusion Models (ARDMs) remains underexplored. We introduce an amortized framework that augments a pretrained ARDM with an offline-trained controller. By previewing future rollouts, the controller learns stepwise corrections that anticipate observations under a terminal-cost objective, yielding a reusable policy for guided generation. Motivated by a stochastic optimal control view of ARDM trajectories, our method injects small controls within each denoising sub-step while staying close to the pretrained dynamics. We study this approach for dataassimilation (DA) in chaotic spatiotemporal partial differential equations (PDEs), where existing methods are often computationally expensive and susceptible to forecast drift under sparse observations. At inference, DA becomes a feed-forward rollout with on-the-fly corrections, achieving an order-of-magnitude speedup over strong diffusion-based baselines. Across two canonical PDEs and a compact ECMWF Reanalysis v5 (ERA5) pilot spanning six observation regimes, our method consistently improves stability and accuracy over state-of-the-art alternatives, with similar improvements observed in a larger-scale GenCast study.
format Preprint
id arxiv_https___arxiv_org_abs_2510_06637
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Control-Augmented Autoregressive Diffusion for Data Assimilation
Srivastava, Prakhar
Sofian, Farrin Marouf
Immorlano, Francesco
Pandey, Kushagra
Mandt, Stephan
Machine Learning
Artificial Intelligence
Computer Vision and Pattern Recognition
Despite advances in test-time scaling and diffusion finetuning, guidance for Auto-Regressive Diffusion Models (ARDMs) remains underexplored. We introduce an amortized framework that augments a pretrained ARDM with an offline-trained controller. By previewing future rollouts, the controller learns stepwise corrections that anticipate observations under a terminal-cost objective, yielding a reusable policy for guided generation. Motivated by a stochastic optimal control view of ARDM trajectories, our method injects small controls within each denoising sub-step while staying close to the pretrained dynamics. We study this approach for dataassimilation (DA) in chaotic spatiotemporal partial differential equations (PDEs), where existing methods are often computationally expensive and susceptible to forecast drift under sparse observations. At inference, DA becomes a feed-forward rollout with on-the-fly corrections, achieving an order-of-magnitude speedup over strong diffusion-based baselines. Across two canonical PDEs and a compact ECMWF Reanalysis v5 (ERA5) pilot spanning six observation regimes, our method consistently improves stability and accuracy over state-of-the-art alternatives, with similar improvements observed in a larger-scale GenCast study.
title Control-Augmented Autoregressive Diffusion for Data Assimilation
topic Machine Learning
Artificial Intelligence
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2510.06637