PhysicsGen: Can Generative Models Learn from Images to Predict Complex Physical Relations?

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Spitznagel, Martin, Vaillant, Jan, Keuper, Janis
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916646371721216
author Spitznagel, Martin
Vaillant, Jan
Keuper, Janis
author_facet Spitznagel, Martin
Vaillant, Jan
Keuper, Janis
contents The image-to-image translation abilities of generative learning models have recently made significant progress in the estimation of complex (steered) mappings between image distributions. While appearance based tasks like image in-painting or style transfer have been studied at length, we propose to investigate the potential of generative models in the context of physical simulations. Providing a dataset of 300k image-pairs and baseline evaluations for three different physical simulation tasks, we propose a benchmark to investigate the following research questions: i) are generative models able to learn complex physical relations from input-output image pairs? ii) what speedups can be achieved by replacing differential equation based simulations? While baseline evaluations of different current models show the potential for high speedups (ii), these results also show strong limitations toward the physical correctness (i). This underlines the need for new methods to enforce physical correctness. Data, baseline models and evaluation code http://www.physics-gen.org.
format Preprint
id arxiv_https___arxiv_org_abs_2503_05333
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle PhysicsGen: Can Generative Models Learn from Images to Predict Complex Physical Relations?
Spitznagel, Martin
Vaillant, Jan
Keuper, Janis
Computer Vision and Pattern Recognition
The image-to-image translation abilities of generative learning models have recently made significant progress in the estimation of complex (steered) mappings between image distributions. While appearance based tasks like image in-painting or style transfer have been studied at length, we propose to investigate the potential of generative models in the context of physical simulations. Providing a dataset of 300k image-pairs and baseline evaluations for three different physical simulation tasks, we propose a benchmark to investigate the following research questions: i) are generative models able to learn complex physical relations from input-output image pairs? ii) what speedups can be achieved by replacing differential equation based simulations? While baseline evaluations of different current models show the potential for high speedups (ii), these results also show strong limitations toward the physical correctness (i). This underlines the need for new methods to enforce physical correctness. Data, baseline models and evaluation code http://www.physics-gen.org.
title PhysicsGen: Can Generative Models Learn from Images to Predict Complex Physical Relations?
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.05333