Saved in:
Bibliographic Details
Main Authors: Sun, Wenkui, Fan, Xiaoya, Jia, Lijuan, Chu, Tinyi, Yau, Shing-Tung, Wu, Rongling, Wang, Zhong
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2411.08651
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915018051682304
author Sun, Wenkui
Fan, Xiaoya
Jia, Lijuan
Chu, Tinyi
Yau, Shing-Tung
Wu, Rongling
Wang, Zhong
author_facet Sun, Wenkui
Fan, Xiaoya
Jia, Lijuan
Chu, Tinyi
Yau, Shing-Tung
Wu, Rongling
Wang, Zhong
contents Differential equations offer a foundational yet powerful framework for modeling interactions within complex dynamic systems and are widely applied across numerous scientific fields. One common challenge in this area is estimating the unknown parameters of these dynamic relationships. However, traditional numerical optimization methods rely on the selection of initial parameter values, making them prone to local optima. Meanwhile, deep learning and Bayesian methods require training models on specific differential equations, resulting in poor versatility. This paper reformulates the parameter estimation problem of differential equations as an optimization problem by introducing the concept of particles from the particle swarm optimization algorithm. Building on reinforcement learning-based particle swarm optimization (RLLPSO), this paper proposes a novel method, DERLPSO, for estimating unknown parameters of differential equations. We compared its performance on three typical ordinary differential equations with the state-of-the-art methods, including the RLLPSO algorithm, traditional numerical methods, deep learning approaches, and Bayesian methods. The experimental results demonstrate that our DERLPSO consistently outperforms other methods in terms of performance, achieving an average Mean Square Error of 1.13e-05, which reduces the error by approximately 4 orders of magnitude compared to other methods. Apart from ordinary differential equations, our DERLPSO also show great promise for estimating unknown parameters of partial differential equations. The DERLPSO method proposed in this paper has high accuracy, is independent of initial parameter values, and possesses strong versatility and stability. This work provides new insights into unknown parameter estimation for differential equations.
format Preprint
id arxiv_https___arxiv_org_abs_2411_08651
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Estimating unknown parameters in differential equations with a reinforcement learning based PSO method
Sun, Wenkui
Fan, Xiaoya
Jia, Lijuan
Chu, Tinyi
Yau, Shing-Tung
Wu, Rongling
Wang, Zhong
Machine Learning
Artificial Intelligence
Differential equations offer a foundational yet powerful framework for modeling interactions within complex dynamic systems and are widely applied across numerous scientific fields. One common challenge in this area is estimating the unknown parameters of these dynamic relationships. However, traditional numerical optimization methods rely on the selection of initial parameter values, making them prone to local optima. Meanwhile, deep learning and Bayesian methods require training models on specific differential equations, resulting in poor versatility. This paper reformulates the parameter estimation problem of differential equations as an optimization problem by introducing the concept of particles from the particle swarm optimization algorithm. Building on reinforcement learning-based particle swarm optimization (RLLPSO), this paper proposes a novel method, DERLPSO, for estimating unknown parameters of differential equations. We compared its performance on three typical ordinary differential equations with the state-of-the-art methods, including the RLLPSO algorithm, traditional numerical methods, deep learning approaches, and Bayesian methods. The experimental results demonstrate that our DERLPSO consistently outperforms other methods in terms of performance, achieving an average Mean Square Error of 1.13e-05, which reduces the error by approximately 4 orders of magnitude compared to other methods. Apart from ordinary differential equations, our DERLPSO also show great promise for estimating unknown parameters of partial differential equations. The DERLPSO method proposed in this paper has high accuracy, is independent of initial parameter values, and possesses strong versatility and stability. This work provides new insights into unknown parameter estimation for differential equations.
title Estimating unknown parameters in differential equations with a reinforcement learning based PSO method
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2411.08651