Learning an Implicit Physics Model for Image-based Fluid Simulation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Jia, Emily Yue-Ting, Mao, Jiageng, Gao, Zhiyuan, Zhao, Yajie, Wang, Yue
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866908484527718400
author Jia, Emily Yue-Ting
Mao, Jiageng
Gao, Zhiyuan
Zhao, Yajie
Wang, Yue
author_facet Jia, Emily Yue-Ting
Mao, Jiageng
Gao, Zhiyuan
Zhao, Yajie
Wang, Yue
contents Humans possess an exceptional ability to imagine 4D scenes, encompassing both motion and 3D geometry, from a single still image. This ability is rooted in our accumulated observations of similar scenes and an intuitive understanding of physics. In this paper, we aim to replicate this capacity in neural networks, specifically focusing on natural fluid imagery. Existing methods for this task typically employ simplistic 2D motion estimators to animate the image, leading to motion predictions that often defy physical principles, resulting in unrealistic animations. Our approach introduces a novel method for generating 4D scenes with physics-consistent animation from a single image. We propose the use of a physics-informed neural network that predicts motion for each surface point, guided by a loss term derived from fundamental physical principles, including the Navier-Stokes equations. To capture appearance, we predict feature-based 3D Gaussians from the input image and its estimated depth, which are then animated using the predicted motions and rendered from any desired camera perspective. Experimental results highlight the effectiveness of our method in producing physically plausible animations, showcasing significant performance improvements over existing methods. Our project page is https://physfluid.github.io/ .
format Preprint
id arxiv_https___arxiv_org_abs_2508_08254
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Learning an Implicit Physics Model for Image-based Fluid Simulation
Jia, Emily Yue-Ting
Mao, Jiageng
Gao, Zhiyuan
Zhao, Yajie
Wang, Yue
Computer Vision and Pattern Recognition
Humans possess an exceptional ability to imagine 4D scenes, encompassing both motion and 3D geometry, from a single still image. This ability is rooted in our accumulated observations of similar scenes and an intuitive understanding of physics. In this paper, we aim to replicate this capacity in neural networks, specifically focusing on natural fluid imagery. Existing methods for this task typically employ simplistic 2D motion estimators to animate the image, leading to motion predictions that often defy physical principles, resulting in unrealistic animations. Our approach introduces a novel method for generating 4D scenes with physics-consistent animation from a single image. We propose the use of a physics-informed neural network that predicts motion for each surface point, guided by a loss term derived from fundamental physical principles, including the Navier-Stokes equations. To capture appearance, we predict feature-based 3D Gaussians from the input image and its estimated depth, which are then animated using the predicted motions and rendered from any desired camera perspective. Experimental results highlight the effectiveness of our method in producing physically plausible animations, showcasing significant performance improvements over existing methods. Our project page is https://physfluid.github.io/ .
title Learning an Implicit Physics Model for Image-based Fluid Simulation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2508.08254