Cover Image

Understanding Two-Layer Neural Networks with Smooth Activation Functions

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Huang, Changcun
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence Numerical Analysis 68T07(Primary), 41A15(Secondary) I.2.6; G.1.2
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

On the Principles of ReLU Networks with One Hidden Layer
by: Huang, Changcun
Published: (2024)

Deep Neural Networks with General Activations: Super-Convergence in Sobolev Norms
by: Yang, Yahong, et al.
Published: (2025)

Polyharmonic Spline Packages: Composition, Efficient Procedures for Computation and Differentiation
by: Bakhvalov, Yuriy N.
Published: (2025)

From Taylor Series to Fourier Synthesis: The Periodic Linear Unit
by: Kudo, Shiko
Published: (2025)

Divergence-free Linearized Neural Networks: Integral Representation and Optimal Approximation Rates
by: He, Juncai, et al.
Published: (2026)

PolyKAN: A Polyhedral Analysis Framework for Provable and Approximately Optimal KAN Compression
by: Zhang, Di
Published: (2025)

Initialization of a Polyharmonic Cascade, Launch and Testing
by: Bakhvalov, Yuriy N.
Published: (2025)

Polyharmonic Cascade
by: Bakhvalov, Yuriy N.
Published: (2025)

Sprecher Networks: A Parameter-Efficient Kolmogorov-Arnold Architecture
by: Hägg, Christian, et al.
Published: (2025)

Sparsifying dimensionality reduction of PDE solution data with Bregman learning
by: Heeringa, Tjeerd Jan, et al.
Published: (2024)

Shallow ReLU$^s$ Networks in $L^p$-Type and Sobolev Spaces: Approximation and Path-Norm Controlled Generalization
by: Li, Weizhao, et al.
Published: (2026)

VORT: Adaptive Power-Law Memory for NLP Transformers
by: Mlaiki, Nabil
Published: (2026)

Compressive sensing inspired self-supervised single-pixel imaging
by: Lu, Jijun, et al.
Published: (2026)

Neural Green's Operators for Parametric Partial Differential Equations
by: Melchers, Hugo, et al.
Published: (2024)

Autoencoders in Function Space
by: Bunker, Justin, et al.
Published: (2024)

Application of Sensitivity Analysis Methods for Studying Neural Network Models
by: Miao, Jiaxuan, et al.
Published: (2025)

Graph2Tac: Online Representation Learning of Formal Math Concepts
by: Blaauwbroek, Lasse, et al.
Published: (2024)

Deep Networks are Reproducing Kernel Chains
by: Heeringa, Tjeerd Jan, et al.
Published: (2025)

The Geometric Mechanics of Contrastive Representation Learning: Alignment Potentials, Entropic Dispersion, and Cross-modal Divergence
by: Cai, Yichao, et al.
Published: (2026)

Structured Multidimensional Representation Learning for Large Language Models
by: Ichi, Alaa El, et al.
Published: (2026)

When can a neural operator replace a coarse solve? Architectural principles for two-level preconditioning
by: Melchers, Hugo, et al.
Published: (2026)

Machine learning based animal emotion classification using audio signals
by: Slobodian, Mariia, et al.
Published: (2025)

Symmetry-reduced model reduction of shift-equivariant systems via operator inference
by: Shuai, Yu, et al.
Published: (2025)

Mathematical analysis of the gradients in deep learning
by: Dereich, Steffen, et al.
Published: (2025)

A Comparison Between Decision Transformers and Traditional Offline Reinforcement Learning Algorithms
by: Caunhye, Ali Murtaza, et al.
Published: (2025)

Explaining Deep Network Classification of Matrices: A Case Study on Monotonicity
by: Farina, Leandro, et al.
Published: (2025)

Functional Similarity Metric for Neural Networks: Overcoming Parametric Ambiguity via Activation Region Analysis
by: Hennadii, Kutomanov
Published: (2026)

Data-driven quasi-interpolant spline surfaces for point cloud approximation
by: Raffo, Andrea, et al.
Published: (2019)

Active Learning for Conditional Generative Compressed Sensing
by: DeLise, Alexander, et al.
Published: (2026)

Linguistic Collapse: Neural Collapse in (Large) Language Models
by: Wu, Robert, et al.
Published: (2024)

Differentiable Optimization Layers for Guaranteed Fairness in Deep Learning
by: Troxell, David, et al.
Published: (2026)

Koopman operator learning using invertible neural networks
by: Meng, Yuhuang, et al.
Published: (2023)

Context-dependent manifold learning: A neuromodulated constrained autoencoder approach
by: Adriaens, Jérôme, et al.
Published: (2026)

AiGAS-dEVL-RC: An Adaptive Growing Neural Gas Model for Recurrently Drifting Unsupervised Data Streams
by: Arostegi, Maria, et al.
Published: (2025)

Alternately-optimized SNN method for acoustic scattering problem in unbounded domain
by: Song, Haoming, et al.
Published: (2025)

Exploring specialization and sensitivity of convolutional neural networks in the context of simultaneous image augmentations
by: Kharyuk, Pavel, et al.
Published: (2025)

Trustworthy AI in numerics: On verification algorithms for neural network-based PDE solvers
by: Haugen, Emil, et al.
Published: (2025)

Geodesic Calculus on Implicitly Defined Latent Manifolds
by: Hartwig, Florine, et al.
Published: (2025)

GDNSQ: Gradual Differentiable Noise Scale Quantization for Low-bit Neural Networks
by: Salishev, Sergey, et al.
Published: (2025)

DrivAer Transformer: A high-precision and fast prediction method for vehicle aerodynamic drag coefficient based on the DrivAerNet++ dataset
by: He, Jiaqi, et al.
Published: (2025)