FunDiff: Diffusion Models over Function Spaces for Physics-Informed Generative Modeling

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Wang, Sifan, Dou, Zehao, Shan, Siming, Liu, Tong-Rui, Lu, Lu
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912727177363456
author Wang, Sifan
Dou, Zehao
Shan, Siming
Liu, Tong-Rui
Lu, Lu
author_facet Wang, Sifan
Dou, Zehao
Shan, Siming
Liu, Tong-Rui
Lu, Lu
contents Recent advances in generative modeling -- particularly diffusion models and flow matching -- have achieved remarkable success in synthesizing discrete data such as images and videos. However, adapting these models to physical applications remains challenging, as the quantities of interest are continuous functions governed by complex physical laws. Here, we introduce $\textbf{FunDiff}$, a novel framework for generative modeling in function spaces. FunDiff combines a latent diffusion process with a function autoencoder architecture to handle input functions with varying discretizations, generate continuous functions evaluable at arbitrary locations, and seamlessly incorporate physical priors. These priors are enforced through architectural constraints or physics-informed loss functions, ensuring that generated samples satisfy fundamental physical laws. We theoretically establish minimax optimality guarantees for density estimation in function spaces, showing that diffusion-based estimators achieve optimal convergence rates under suitable regularity conditions. We demonstrate the practical effectiveness of FunDiff across diverse applications in fluid dynamics and solid mechanics. Empirical results show that our method generates physically consistent samples with high fidelity to the target distribution and exhibits robustness to noisy and low-resolution data. Code and datasets are publicly available at https://github.com/sifanexisted/fundiff.
format Preprint
id arxiv_https___arxiv_org_abs_2506_07902
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle FunDiff: Diffusion Models over Function Spaces for Physics-Informed Generative Modeling
Wang, Sifan
Dou, Zehao
Shan, Siming
Liu, Tong-Rui
Lu, Lu
Machine Learning
Computational Physics
Recent advances in generative modeling -- particularly diffusion models and flow matching -- have achieved remarkable success in synthesizing discrete data such as images and videos. However, adapting these models to physical applications remains challenging, as the quantities of interest are continuous functions governed by complex physical laws. Here, we introduce $\textbf{FunDiff}$, a novel framework for generative modeling in function spaces. FunDiff combines a latent diffusion process with a function autoencoder architecture to handle input functions with varying discretizations, generate continuous functions evaluable at arbitrary locations, and seamlessly incorporate physical priors. These priors are enforced through architectural constraints or physics-informed loss functions, ensuring that generated samples satisfy fundamental physical laws. We theoretically establish minimax optimality guarantees for density estimation in function spaces, showing that diffusion-based estimators achieve optimal convergence rates under suitable regularity conditions. We demonstrate the practical effectiveness of FunDiff across diverse applications in fluid dynamics and solid mechanics. Empirical results show that our method generates physically consistent samples with high fidelity to the target distribution and exhibits robustness to noisy and low-resolution data. Code and datasets are publicly available at https://github.com/sifanexisted/fundiff.
title FunDiff: Diffusion Models over Function Spaces for Physics-Informed Generative Modeling
topic Machine Learning
Computational Physics
url https://arxiv.org/abs/2506.07902