Cover Image

Expressivity and Approximation Properties of Deep Neural Networks with ReLU$^k$ Activation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	He, Juncai, Mao, Tong, Xu, Jinchao
Format:	Preprint
Published:	2023
Subjects:	Machine Learning Numerical Analysis Neural and Evolutionary Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Approximation Rates and VC-Dimension Bounds for (P)ReLU MLP Mixture of Experts
by: Kratsios, Anastasis, et al.
Published: (2024)

Sharp Lower Bounds for Linearized ReLU^k Approximation on the Sphere
by: Mao, Tong, et al.
Published: (2025)

Approximating Matrix Functions with Deep Neural Networks and Transformers
by: Padmanabhan, Rahul, et al.
Published: (2026)

On Space Folds of ReLU Neural Networks
by: Lewandowski, Michal, et al.
Published: (2025)

Causal Explanations from the Geometric Properties of ReLU Neural Networks
by: Woods, Hector, et al.
Published: (2026)

From Tempered to Benign Overfitting in ReLU Neural Networks
by: Kornowski, Guy, et al.
Published: (2023)

The Geometry of ReLU Networks through the ReLU Transition Graph
by: Dhayalkar, Sahil Rajesh
Published: (2025)

Bridging the Gap Between Approximation and Learning via Optimal Approximation by ReLU MLPs of Maximal Regularity
by: Hong, Ruiyang, et al.
Published: (2024)

ReLU-KAN: New Kolmogorov-Arnold Networks that Only Need Matrix Addition, Dot Multiplication, and ReLU
by: Qiu, Qi, et al.
Published: (2024)

Semialgebraic Neural Networks: From roots to representations
by: Mis, S. David, et al.
Published: (2025)

Structured and Balanced Multi-Component and Multi-Layer Neural Networks
by: Zhang, Shijun, et al.
Published: (2024)

HiPreNets: High-Precision Neural Networks through Progressive Training
by: Mulle, Ethan, et al.
Published: (2025)

Activations Through Extensions: A Framework To Boost Performance Of Neural Networks
by: Kamanchi, Chandramouli, et al.
Published: (2024)

Robust Parameter and State Estimation in Multiscale Neuronal Systems Using Physics-Informed Neural Networks
by: Wei, Changliang, et al.
Published: (2026)

Physics-Informed Neural Network based inverse framework for time-fractional differential equations for rheology
by: Thakur, Sukirt, et al.
Published: (2024)

On the Depth of Monotone ReLU Neural Networks and ICNNs
by: Bakaev, Egor, et al.
Published: (2025)

Auto-weighted Bayesian Physics-Informed Neural Networks and robust estimations for multitask inverse problems in pore-scale imaging of dissolution
by: Perez, Sarah, et al.
Published: (2023)

Zorro: A Flexible and Differentiable Parametric Family of Activation Functions That Extends ReLU and GELU
by: Roodschild, Matias, et al.
Published: (2024)

Approximation Rates in Besov Norms and Sample-Complexity of Kolmogorov-Arnold Networks with Residual Connections
by: Kratsios, Anastasis, et al.
Published: (2025)

QuAKE: Speeding up Model Inference Using Quick and Approximate Kernels for Exponential Non-Linearities
by: Narayanaswami, Sai Kiran, et al.
Published: (2024)

Chebyshev Feature Neural Network for Accurate Function Approximation
by: Xu, Zhongshu, et al.
Published: (2024)

Towards Lower Bounds on the Depth of ReLU Neural Networks
by: Hertrich, Christoph, et al.
Published: (2021)

Provable Unlearning with Gradient Ascent on Two-Layer ReLU Neural Networks
by: Melamed, Odelia, et al.
Published: (2025)

Deep greedy unfolding: Sorting out argsorting in greedy sparse recovery algorithms
by: Mohammad-Taheri, Sina, et al.
Published: (2025)

Competition-based Adaptive ReLU for Deep Neural Networks
by: Chen, Junjia, et al.
Published: (2024)

rKAN: Rational Kolmogorov-Arnold Networks
by: Aghaei, Alireza Afzal
Published: (2024)

Geometry-induced Regularization in Deep ReLU Neural Networks
by: Bona-Pellissier, Joachim, et al.
Published: (2024)

Sign Gradient Descent-based Neuronal Dynamics: ANN-to-SNN Conversion Beyond ReLU Network
by: Oh, Hyunseok, et al.
Published: (2024)

Approximation Rates for Shallow ReLU$^k$ Neural Networks on Sobolev Spaces via the Radon Transform
by: Mao, Tong, et al.
Published: (2024)

Towards an Algebraic Framework For Approximating Functions Using Neural Network Polynomials
by: Rafi, Shakil, et al.
Published: (2024)

Deep Learning using Rectified Linear Units (ReLU)
by: Agarap, Abien Fred
Published: (2018)

The Computational Complexity of Counting Linear Regions in ReLU Neural Networks
by: Stargalla, Moritz, et al.
Published: (2025)

A third-order finite difference weighted essentially non-oscillatory scheme with shallow neural network
by: Park, Kwanghyuk, et al.
Published: (2024)

A fast and accurate physics-informed neural network reduced order model with shallow masked autoencoder
by: Kim, Youngkyu, et al.
Published: (2020)

Universality and approximation bounds for echo state networks with random weights
by: Li, Zhen, et al.
Published: (2022)

ReLU Neural Networks of Polynomial Size for Exact Maximum Flow Computation
by: Hertrich, Christoph, et al.
Published: (2021)

Hermite Neural Network Simulation for Solving the 2D Schrodinger Equation
by: Parand, Kourosh, et al.
Published: (2024)

TensorGPT: Efficient Compression of Large Language Models based on Tensor-Train Decomposition
by: Xu, Mingxue, et al.
Published: (2023)

Efficient Approximation to Analytic and $L^p$ functions by Height-Augmented ReLU Networks
by: Li, ZeYu, et al.
Published: (2026)

Stability and Discretization Error of State Space Model Neural Operators
by: Bendahi, Abderrahim, et al.
Published: (2026)