Higher-order-ReLU-KANs (HRKANs) for solving physics-informed neural networks (PINNs) more accurately, robustly and faster
Fuente:
arXiv
Saved in:
| Main Authors: | So, Chi Chiu, Yung, Siu Pang |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Competition-based Adaptive ReLU for Deep Neural Networks
by: Chen, Junjia, et al.
Published: (2024)
by: Chen, Junjia, et al.
Published: (2024)
The Geometry of ReLU Networks through the ReLU Transition Graph
by: Dhayalkar, Sahil Rajesh
Published: (2025)
by: Dhayalkar, Sahil Rajesh
Published: (2025)
ReLU-KAN: New Kolmogorov-Arnold Networks that Only Need Matrix Addition, Dot Multiplication, and ReLU
by: Qiu, Qi, et al.
Published: (2024)
by: Qiu, Qi, et al.
Published: (2024)
On Space Folds of ReLU Neural Networks
by: Lewandowski, Michal, et al.
Published: (2025)
by: Lewandowski, Michal, et al.
Published: (2025)
From Tempered to Benign Overfitting in ReLU Neural Networks
by: Kornowski, Guy, et al.
Published: (2023)
by: Kornowski, Guy, et al.
Published: (2023)
Causal Explanations from the Geometric Properties of ReLU Neural Networks
by: Woods, Hector, et al.
Published: (2026)
by: Woods, Hector, et al.
Published: (2026)
Deep Learning using Rectified Linear Units (ReLU)
by: Agarap, Abien Fred
Published: (2018)
by: Agarap, Abien Fred
Published: (2018)
Zorro: A Flexible and Differentiable Parametric Family of Activation Functions That Extends ReLU and GELU
by: Roodschild, Matias, et al.
Published: (2024)
by: Roodschild, Matias, et al.
Published: (2024)
Sign Gradient Descent-based Neuronal Dynamics: ANN-to-SNN Conversion Beyond ReLU Network
by: Oh, Hyunseok, et al.
Published: (2024)
by: Oh, Hyunseok, et al.
Published: (2024)
On the Depth of Monotone ReLU Neural Networks and ICNNs
by: Bakaev, Egor, et al.
Published: (2025)
by: Bakaev, Egor, et al.
Published: (2025)
Towards Lower Bounds on the Depth of ReLU Neural Networks
by: Hertrich, Christoph, et al.
Published: (2021)
by: Hertrich, Christoph, et al.
Published: (2021)
Expressivity and Approximation Properties of Deep Neural Networks with ReLU$^k$ Activation
by: He, Juncai, et al.
Published: (2023)
by: He, Juncai, et al.
Published: (2023)
Provable Unlearning with Gradient Ascent on Two-Layer ReLU Neural Networks
by: Melamed, Odelia, et al.
Published: (2025)
by: Melamed, Odelia, et al.
Published: (2025)
The Computational Complexity of Counting Linear Regions in ReLU Neural Networks
by: Stargalla, Moritz, et al.
Published: (2025)
by: Stargalla, Moritz, et al.
Published: (2025)
Dendrites endow artificial neural networks with accurate, robust and parameter-efficient learning
by: Chavlis, Spyridon, et al.
Published: (2024)
by: Chavlis, Spyridon, et al.
Published: (2024)
Physics-informed neural network for modeling dynamic linear elasticity
by: Kag, Vijay, et al.
Published: (2023)
by: Kag, Vijay, et al.
Published: (2023)
A fast and accurate physics-informed neural network reduced order model with shallow masked autoencoder
by: Kim, Youngkyu, et al.
Published: (2020)
by: Kim, Youngkyu, et al.
Published: (2020)
ReLU Neural Networks of Polynomial Size for Exact Maximum Flow Computation
by: Hertrich, Christoph, et al.
Published: (2021)
by: Hertrich, Christoph, et al.
Published: (2021)
SO-PIFRNN: Self-optimization physics-informed Fourier-features randomized neural network for solving partial differential equations
by: Linghu, Jiale, et al.
Published: (2025)
by: Linghu, Jiale, et al.
Published: (2025)
Approximation Rates and VC-Dimension Bounds for (P)ReLU MLP Mixture of Experts
by: Kratsios, Anastasis, et al.
Published: (2024)
by: Kratsios, Anastasis, et al.
Published: (2024)
Do physics-informed neural networks (PINNs) need to be deep? Shallow PINNs using the Levenberg-Marquardt algorithm
by: Shahab, Muhammad Luthfi, et al.
Published: (2026)
by: Shahab, Muhammad Luthfi, et al.
Published: (2026)
Geometry-induced Regularization in Deep ReLU Neural Networks
by: Bona-Pellissier, Joachim, et al.
Published: (2024)
by: Bona-Pellissier, Joachim, et al.
Published: (2024)
APTx: better activation function than MISH, SWISH, and ReLU's variants used in deep learning
by: Kumar, Ravin
Published: (2022)
by: Kumar, Ravin
Published: (2022)
Evolutionary feature selection for spiking neural network pattern classifiers
by: Valko, Michal, et al.
Published: (2026)
by: Valko, Michal, et al.
Published: (2026)
DelRec: learning delays in recurrent spiking neural networks
by: Queant, Alexandre, et al.
Published: (2025)
by: Queant, Alexandre, et al.
Published: (2025)
Robustness of Deep ReLU Networks to Misclassification of High-Dimensional Data
by: Kůrková, Věra
Published: (2026)
by: Kůrková, Věra
Published: (2026)
A survey on learning models of spiking neural membrane systems and spiking neural networks
by: Paul, Prithwineel, et al.
Published: (2024)
by: Paul, Prithwineel, et al.
Published: (2024)
Exploiting heterogeneous delays for efficient computation in low-bit neural networks
by: Sun, Pengfei, et al.
Published: (2025)
by: Sun, Pengfei, et al.
Published: (2025)
Provably robust learning of regression neural networks using $β$-divergences
by: Ghosh, Abhik, et al.
Published: (2026)
by: Ghosh, Abhik, et al.
Published: (2026)
Efficient Approximation to Analytic and $L^p$ functions by Height-Augmented ReLU Networks
by: Li, ZeYu, et al.
Published: (2026)
by: Li, ZeYu, et al.
Published: (2026)
TDE-3: An improved prior for optical flow computation in spiking neural networks
by: Yedutenko, Matthew, et al.
Published: (2024)
by: Yedutenko, Matthew, et al.
Published: (2024)
A two-stage algorithm in evolutionary product unit neural networks for classification
by: Tallón-Ballesteros, Antonio J., et al.
Published: (2024)
by: Tallón-Ballesteros, Antonio J., et al.
Published: (2024)
KAT to KANs: A Review of Kolmogorov-Arnold Networks and the Neural Leap Forward
by: Basina, Divesh, et al.
Published: (2024)
by: Basina, Divesh, et al.
Published: (2024)
Towards free-response paradigm: a theory on decision-making in spiking neural networks
by: Zhu, Zhichao, et al.
Published: (2024)
by: Zhu, Zhichao, et al.
Published: (2024)
When Spiking neural networks meet temporal attention image decoding and adaptive spiking neuron
by: Qiu, Xuerui, et al.
Published: (2024)
by: Qiu, Xuerui, et al.
Published: (2024)
Regression-based Physics Informed Neural Networks (Reg-PINNs) for Magnetopause Tracking
by: Hou, Po-Han, et al.
Published: (2023)
by: Hou, Po-Han, et al.
Published: (2023)
A Significantly Better Class of Activation Functions Than ReLU Like Activation Functions
by: Noel, Mathew Mithra, et al.
Published: (2024)
by: Noel, Mathew Mithra, et al.
Published: (2024)
Towards graph neural networks for provably solving convex optimization problems
by: Qian, Chendi, et al.
Published: (2025)
by: Qian, Chendi, et al.
Published: (2025)
Splitting physics-informed neural networks for inferring the dynamics of integer- and fractional-order neuron models
by: Shekarpaz, Simin, et al.
Published: (2023)
by: Shekarpaz, Simin, et al.
Published: (2023)
STCSNN: High energy efficiency spike-train level spiking neural networks with spatio-temporal conversion
by: Xu, Changqing, et al.
Published: (2023)
by: Xu, Changqing, et al.
Published: (2023)
Similar Items
-
Competition-based Adaptive ReLU for Deep Neural Networks
by: Chen, Junjia, et al.
Published: (2024) -
The Geometry of ReLU Networks through the ReLU Transition Graph
by: Dhayalkar, Sahil Rajesh
Published: (2025) -
ReLU-KAN: New Kolmogorov-Arnold Networks that Only Need Matrix Addition, Dot Multiplication, and ReLU
by: Qiu, Qi, et al.
Published: (2024) -
On Space Folds of ReLU Neural Networks
by: Lewandowski, Michal, et al.
Published: (2025) -
From Tempered to Benign Overfitting in ReLU Neural Networks
by: Kornowski, Guy, et al.
Published: (2023)