Saved in:
Bibliographic Details
Main Authors: Hsiao, Cheng-Hsi, Kumar, Krishna
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2507.09005
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909686279700480
author Hsiao, Cheng-Hsi
Kumar, Krishna
author_facet Hsiao, Cheng-Hsi
Kumar, Krishna
contents We introduce a novel framework that integrates Neural Radiance Fields (NeRF) with Material Point Method (MPM) simulation to infer granular material properties from visual observations. Our approach begins by generating synthetic experimental data, simulating an plow interacting with sand. The experiment is rendered into realistic images as the photographic observations. These observations include multi-view images of the experiment's initial state and time-sequenced images from two fixed cameras. Using NeRF, we reconstruct the 3D geometry from the initial multi-view images, leveraging its capability to synthesize novel viewpoints and capture intricate surface details. The reconstructed geometry is then used to initialize material point positions for the MPM simulation, where the friction angle remains unknown. We render images of the simulation under the same camera setup and compare them to the observed images. By employing Bayesian optimization, we minimize the image loss to estimate the best-fitting friction angle. Our results demonstrate that friction angle can be estimated with an error within 2 degrees, highlighting the effectiveness of inverse analysis through purely visual observations. This approach offers a promising solution for characterizing granular materials in real-world scenarios where direct measurement is impractical or impossible.
format Preprint
id arxiv_https___arxiv_org_abs_2507_09005
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle From images to properties: a NeRF-driven framework for granular material parameter inversion
Hsiao, Cheng-Hsi
Kumar, Krishna
Computer Vision and Pattern Recognition
Geophysics
We introduce a novel framework that integrates Neural Radiance Fields (NeRF) with Material Point Method (MPM) simulation to infer granular material properties from visual observations. Our approach begins by generating synthetic experimental data, simulating an plow interacting with sand. The experiment is rendered into realistic images as the photographic observations. These observations include multi-view images of the experiment's initial state and time-sequenced images from two fixed cameras. Using NeRF, we reconstruct the 3D geometry from the initial multi-view images, leveraging its capability to synthesize novel viewpoints and capture intricate surface details. The reconstructed geometry is then used to initialize material point positions for the MPM simulation, where the friction angle remains unknown. We render images of the simulation under the same camera setup and compare them to the observed images. By employing Bayesian optimization, we minimize the image loss to estimate the best-fitting friction angle. Our results demonstrate that friction angle can be estimated with an error within 2 degrees, highlighting the effectiveness of inverse analysis through purely visual observations. This approach offers a promising solution for characterizing granular materials in real-world scenarios where direct measurement is impractical or impossible.
title From images to properties: a NeRF-driven framework for granular material parameter inversion
topic Computer Vision and Pattern Recognition
Geophysics
url https://arxiv.org/abs/2507.09005