Learn Singularly Perturbed Solutions via Homotopy Dynamics

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Chen, Chuqi, Yang, Yahong, Xiang, Yang, Hao, Wenrui
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866915312289447936
author Chen, Chuqi
Yang, Yahong
Xiang, Yang
Hao, Wenrui
author_facet Chen, Chuqi
Yang, Yahong
Xiang, Yang
Hao, Wenrui
contents Solving partial differential equations (PDEs) using neural networks has become a central focus in scientific machine learning. Training neural networks for singularly perturbed problems is particularly challenging due to certain parameters in the PDEs that introduce near-singularities in the loss function. In this study, we overcome this challenge by introducing a novel method based on homotopy dynamics to effectively manipulate these parameters. From a theoretical perspective, we analyze the effects of these parameters on training difficulty in these singularly perturbed problems and establish the convergence of the proposed homotopy dynamics method. Experimentally, we demonstrate that our approach significantly accelerates convergence and improves the accuracy of these singularly perturbed problems. These findings present an efficient optimization strategy leveraging homotopy dynamics, offering a robust framework to extend the applicability of neural networks for solving singularly perturbed differential equations.
format Preprint
id arxiv_https___arxiv_org_abs_2502_00488
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Learn Singularly Perturbed Solutions via Homotopy Dynamics
Chen, Chuqi
Yang, Yahong
Xiang, Yang
Hao, Wenrui
Machine Learning
Numerical Analysis
Solving partial differential equations (PDEs) using neural networks has become a central focus in scientific machine learning. Training neural networks for singularly perturbed problems is particularly challenging due to certain parameters in the PDEs that introduce near-singularities in the loss function. In this study, we overcome this challenge by introducing a novel method based on homotopy dynamics to effectively manipulate these parameters. From a theoretical perspective, we analyze the effects of these parameters on training difficulty in these singularly perturbed problems and establish the convergence of the proposed homotopy dynamics method. Experimentally, we demonstrate that our approach significantly accelerates convergence and improves the accuracy of these singularly perturbed problems. These findings present an efficient optimization strategy leveraging homotopy dynamics, offering a robust framework to extend the applicability of neural networks for solving singularly perturbed differential equations.
title Learn Singularly Perturbed Solutions via Homotopy Dynamics
topic Machine Learning
Numerical Analysis
url https://arxiv.org/abs/2502.00488