MixFunn: A Neural Network for Differential Equations with Improved Generalization and Interpretability

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Farias, Tiago de Souza, de Lima, Gubio Gomes, Maziero, Jonas, Villas-Boas, Celso Jorge
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866908288655818752
author Farias, Tiago de Souza
de Lima, Gubio Gomes
Maziero, Jonas
Villas-Boas, Celso Jorge
author_facet Farias, Tiago de Souza
de Lima, Gubio Gomes
Maziero, Jonas
Villas-Boas, Celso Jorge
contents We introduce MixFunn, a novel neural network architecture designed to solve differential equations with enhanced precision, interpretability, and generalization capability. The architecture comprises two key components: the mixed-function neuron, which integrates multiple parameterized nonlinear functions to improve representational flexibility, and the second-order neuron, which combines a linear transformation of its inputs with a quadratic term to capture cross-combinations of input variables. These features significantly enhance the expressive power of the network, enabling it to achieve comparable or superior results with drastically fewer parameters and a reduction of up to four orders of magnitude compared to conventional approaches. We applied MixFunn in a physics-informed setting to solve differential equations in classical mechanics, quantum mechanics, and fluid dynamics, demonstrating its effectiveness in achieving higher accuracy and improved generalization to regions outside the training domain relative to standard machine learning models. Furthermore, the architecture facilitates the extraction of interpretable analytical expressions, offering valuable insights into the underlying solutions.
format Preprint
id arxiv_https___arxiv_org_abs_2503_22528
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MixFunn: A Neural Network for Differential Equations with Improved Generalization and Interpretability
Farias, Tiago de Souza
de Lima, Gubio Gomes
Maziero, Jonas
Villas-Boas, Celso Jorge
Machine Learning
Applied Physics
Computational Physics
We introduce MixFunn, a novel neural network architecture designed to solve differential equations with enhanced precision, interpretability, and generalization capability. The architecture comprises two key components: the mixed-function neuron, which integrates multiple parameterized nonlinear functions to improve representational flexibility, and the second-order neuron, which combines a linear transformation of its inputs with a quadratic term to capture cross-combinations of input variables. These features significantly enhance the expressive power of the network, enabling it to achieve comparable or superior results with drastically fewer parameters and a reduction of up to four orders of magnitude compared to conventional approaches. We applied MixFunn in a physics-informed setting to solve differential equations in classical mechanics, quantum mechanics, and fluid dynamics, demonstrating its effectiveness in achieving higher accuracy and improved generalization to regions outside the training domain relative to standard machine learning models. Furthermore, the architecture facilitates the extraction of interpretable analytical expressions, offering valuable insights into the underlying solutions.
title MixFunn: A Neural Network for Differential Equations with Improved Generalization and Interpretability
topic Machine Learning
Applied Physics
Computational Physics
url https://arxiv.org/abs/2503.22528