Saved in:
Bibliographic Details
Main Authors: Luo, Jiaqi, Yang, Yahong, Yuan, Yuan, Xu, Shixin, Hao, Wenrui
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2501.11222
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929682298961920
author Luo, Jiaqi
Yang, Yahong
Yuan, Yuan
Xu, Shixin
Hao, Wenrui
author_facet Luo, Jiaqi
Yang, Yahong
Yuan, Yuan
Xu, Shixin
Hao, Wenrui
contents This paper introduces Residual-based Smote (RSmote), an innovative local adaptive sampling technique tailored to improve the performance of Physics-Informed Neural Networks (PINNs) through imbalanced learning strategies. Traditional residual-based adaptive sampling methods, while effective in enhancing PINN accuracy, often struggle with efficiency and high memory consumption, particularly in high-dimensional problems. RSmote addresses these challenges by targeting regions with high residuals and employing oversampling techniques from imbalanced learning to refine the sampling process. Our approach is underpinned by a rigorous theoretical analysis that supports the effectiveness of RSmote in managing computational resources more efficiently. Through extensive evaluations, we benchmark RSmote against the state-of-the-art Residual-based Adaptive Distribution (RAD) method across a variety of dimensions and differential equations. The results demonstrate that RSmote not only achieves or exceeds the accuracy of RAD but also significantly reduces memory usage, making it particularly advantageous in high-dimensional scenarios. These contributions position RSmote as a robust and resource-efficient solution for solving complex partial differential equations, especially when computational constraints are a critical consideration.
format Preprint
id arxiv_https___arxiv_org_abs_2501_11222
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle An Imbalanced Learning-based Sampling Method for Physics-informed Neural Networks
Luo, Jiaqi
Yang, Yahong
Yuan, Yuan
Xu, Shixin
Hao, Wenrui
Machine Learning
G.1.8
This paper introduces Residual-based Smote (RSmote), an innovative local adaptive sampling technique tailored to improve the performance of Physics-Informed Neural Networks (PINNs) through imbalanced learning strategies. Traditional residual-based adaptive sampling methods, while effective in enhancing PINN accuracy, often struggle with efficiency and high memory consumption, particularly in high-dimensional problems. RSmote addresses these challenges by targeting regions with high residuals and employing oversampling techniques from imbalanced learning to refine the sampling process. Our approach is underpinned by a rigorous theoretical analysis that supports the effectiveness of RSmote in managing computational resources more efficiently. Through extensive evaluations, we benchmark RSmote against the state-of-the-art Residual-based Adaptive Distribution (RAD) method across a variety of dimensions and differential equations. The results demonstrate that RSmote not only achieves or exceeds the accuracy of RAD but also significantly reduces memory usage, making it particularly advantageous in high-dimensional scenarios. These contributions position RSmote as a robust and resource-efficient solution for solving complex partial differential equations, especially when computational constraints are a critical consideration.
title An Imbalanced Learning-based Sampling Method for Physics-informed Neural Networks
topic Machine Learning
G.1.8
url https://arxiv.org/abs/2501.11222