Generating time-consistent dynamics with discriminator-guided image diffusion models
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866913838135246848 |
|---|---|
| author | Hess, Philipp Gelbrecht, Maximilian Schötz, Christof Aich, Michael Huang, Yu Yang, Shangshang Boers, Niklas |
| author_facet | Hess, Philipp Gelbrecht, Maximilian Schötz, Christof Aich, Michael Huang, Yu Yang, Shangshang Boers, Niklas |
| contents | Realistic temporal dynamics are crucial for many video generation, processing and modelling applications, e.g. in computational fluid dynamics, weather prediction, or long-term climate simulations. Video diffusion models (VDMs) are the current state-of-the-art method for generating highly realistic dynamics. However, training VDMs from scratch can be challenging and requires large computational resources, limiting their wider application. Here, we propose a time-consistency discriminator that enables pretrained image diffusion models to generate realistic spatiotemporal dynamics. The discriminator guides the sampling inference process and does not require extensions or finetuning of the image diffusion model. We compare our approach against a VDM trained from scratch on an idealized turbulence simulation and a real-world global precipitation dataset. Our approach performs equally well in terms of temporal consistency, shows improved uncertainty calibration and lower biases compared to the VDM, and achieves stable centennial-scale climate simulations at daily time steps. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_09089 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Generating time-consistent dynamics with discriminator-guided image diffusion models Hess, Philipp Gelbrecht, Maximilian Schötz, Christof Aich, Michael Huang, Yu Yang, Shangshang Boers, Niklas Machine Learning Realistic temporal dynamics are crucial for many video generation, processing and modelling applications, e.g. in computational fluid dynamics, weather prediction, or long-term climate simulations. Video diffusion models (VDMs) are the current state-of-the-art method for generating highly realistic dynamics. However, training VDMs from scratch can be challenging and requires large computational resources, limiting their wider application. Here, we propose a time-consistency discriminator that enables pretrained image diffusion models to generate realistic spatiotemporal dynamics. The discriminator guides the sampling inference process and does not require extensions or finetuning of the image diffusion model. We compare our approach against a VDM trained from scratch on an idealized turbulence simulation and a real-world global precipitation dataset. Our approach performs equally well in terms of temporal consistency, shows improved uncertainty calibration and lower biases compared to the VDM, and achieves stable centennial-scale climate simulations at daily time steps. |
| title | Generating time-consistent dynamics with discriminator-guided image diffusion models |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2505.09089 |