RAMS: Residual-based adversarial-gradient moving sample method for scientific machine learning in solving partial differential equations

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ouyang, Weihang, Zhu, Min, Xiong, Wei, Liu, Si-Wei, Lu, Lu
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915472856842240
author Ouyang, Weihang
Zhu, Min
Xiong, Wei
Liu, Si-Wei
Lu, Lu
author_facet Ouyang, Weihang
Zhu, Min
Xiong, Wei
Liu, Si-Wei
Lu, Lu
contents Physics-informed neural networks (PINNs) and neural operators, two leading scientific machine learning (SciML) paradigms, have emerged as powerful tools for solving partial differential equations (PDEs). Although increasing the training sample size generally enhances network performance, it also increases computational costs for physics-informed or data-driven training. To address this trade-off, different sampling strategies have been developed to sample more points in regions with high PDE residuals. However, existing sampling methods are computationally demanding for high-dimensional problems, such as high-dimensional PDEs or operator learning tasks. Here, we propose a residual-based adversarial-gradient moving sample (RAMS) method, which moves samples according to the adversarial gradient direction to maximize the PDE residual via gradient-based optimization. RAMS can be easily integrated into existing sampling methods. Extensive experiments, ranging from PINN applied to high-dimensional PDEs to physics-informed and data-driven operator learning problems, have been conducted to demonstrate the effectiveness of RAMS. Notably, RAMS represents the first efficient adaptive sampling approach for operator learning, marking a significant advancement in the SciML field.
format Preprint
id arxiv_https___arxiv_org_abs_2509_01234
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle RAMS: Residual-based adversarial-gradient moving sample method for scientific machine learning in solving partial differential equations
Ouyang, Weihang
Zhu, Min
Xiong, Wei
Liu, Si-Wei
Lu, Lu
Computational Engineering, Finance, and Science
Machine Learning
Computational Physics
Physics-informed neural networks (PINNs) and neural operators, two leading scientific machine learning (SciML) paradigms, have emerged as powerful tools for solving partial differential equations (PDEs). Although increasing the training sample size generally enhances network performance, it also increases computational costs for physics-informed or data-driven training. To address this trade-off, different sampling strategies have been developed to sample more points in regions with high PDE residuals. However, existing sampling methods are computationally demanding for high-dimensional problems, such as high-dimensional PDEs or operator learning tasks. Here, we propose a residual-based adversarial-gradient moving sample (RAMS) method, which moves samples according to the adversarial gradient direction to maximize the PDE residual via gradient-based optimization. RAMS can be easily integrated into existing sampling methods. Extensive experiments, ranging from PINN applied to high-dimensional PDEs to physics-informed and data-driven operator learning problems, have been conducted to demonstrate the effectiveness of RAMS. Notably, RAMS represents the first efficient adaptive sampling approach for operator learning, marking a significant advancement in the SciML field.
title RAMS: Residual-based adversarial-gradient moving sample method for scientific machine learning in solving partial differential equations
topic Computational Engineering, Finance, and Science
Machine Learning
Computational Physics
url https://arxiv.org/abs/2509.01234