Cover Image

On the Principles of ReLU Networks with One Hidden Layer

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Huang, Changcun
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence Neural and Evolutionary Computing 68T07(Primary), 41A15(Secondary) I.2.6; G.1.2
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Understanding Two-Layer Neural Networks with Smooth Activation Functions
by: Huang, Changcun
Published: (2025)

From Taylor Series to Fourier Synthesis: The Periodic Linear Unit
by: Kudo, Shiko
Published: (2025)

Shallow ReLU$^s$ Networks in $L^p$-Type and Sobolev Spaces: Approximation and Path-Norm Controlled Generalization
by: Li, Weizhao, et al.
Published: (2026)

AiGAS-dEVL-RC: An Adaptive Growing Neural Gas Model for Recurrently Drifting Unsupervised Data Streams
by: Arostegi, Maria, et al.
Published: (2025)

Task-Synchronized Recurrent Neural Networks
by: Lukoševičius, Mantas, et al.
Published: (2022)

Game-Theoretic Gradient Control for Robust Neural Network Training
by: Zaitseva, Maria, et al.
Published: (2025)

Loss shaping enhances exact gradient learning with Eventprop in spiking neural networks
by: Nowotny, Thomas, et al.
Published: (2022)

Rapid training of Hamiltonian graph networks using random features
by: Rahma, Atamert, et al.
Published: (2025)

Distributionally Robust Geometric Joint Chance-Constrained Optimization: Neurodynamic Approaches
by: Valli, Ange, et al.
Published: (2026)

Efficient Approximation to Analytic and $L^p$ functions by Height-Augmented ReLU Networks
by: Li, ZeYu, et al.
Published: (2026)

VORT: Adaptive Power-Law Memory for NLP Transformers
by: Mlaiki, Nabil
Published: (2026)

InhibiDistilbert: Knowledge Distillation for a ReLU and Addition-based Transformer
by: Zhang, Tony, et al.
Published: (2025)

Is ReLU Adversarially Robust?
by: Sooksatra, Korn, et al.
Published: (2024)

The Inhibitor: ReLU and Addition-Based Attention for Efficient Transformers under Fully Homomorphic Encryption on the Torus
by: Brännvall, Rickard, et al.
Published: (2023)

Polyharmonic Spline Packages: Composition, Efficient Procedures for Computation and Differentiation
by: Bakhvalov, Yuriy N.
Published: (2025)

Exploring the Intersection between Neural Architecture Search and Continual Learning
by: Shahawy, Mohamed, et al.
Published: (2022)

Bridging the Gap Between Approximation and Learning via Optimal Approximation by ReLU MLPs of Maximal Regularity
by: Hong, Ruiyang, et al.
Published: (2024)

Compressive sensing inspired self-supervised single-pixel imaging
by: Lu, Jijun, et al.
Published: (2026)

Combining AI Control Systems and Human Decision Support via Robustness and Criticality
by: Woods, Walt, et al.
Published: (2024)

Contraction, Criticality, and Capacity: A Dynamical-Systems Perspective on Echo-State Networks
by: Singh, Pradeep, et al.
Published: (2025)

TOPSIS-like metaheuristic for LABS problem
by: Urbańczyk, Aleksandra, et al.
Published: (2025)

Topology and Geometry of the Learning Space of ReLU Networks: Connectivity and Singularities
by: Nurisso, Marco, et al.
Published: (2026)

Graph2Tac: Online Representation Learning of Formal Math Concepts
by: Blaauwbroek, Lasse, et al.
Published: (2024)

The Geometric Mechanics of Contrastive Representation Learning: Alignment Potentials, Entropic Dispersion, and Cross-modal Divergence
by: Cai, Yichao, et al.
Published: (2026)

Deep Neural Networks with General Activations: Super-Convergence in Sobolev Norms
by: Yang, Yahong, et al.
Published: (2025)

Topological obstruction to the training of shallow ReLU neural networks
by: Nurisso, Marco, et al.
Published: (2024)

Machine learning based animal emotion classification using audio signals
by: Slobodian, Mariia, et al.
Published: (2025)

Pulse-Driven Neural Architecture: Learnable Oscillatory Dynamics for Robust Continuous-Time Sequence Processing
by: Sharma, Paras
Published: (2026)

Muscle Synergy Priors Enhance Biomechanical Fidelity in Predictive Musculoskeletal Locomotion Simulation
by: Park, Ilseung, et al.
Published: (2026)

A Comparison Between Decision Transformers and Traditional Offline Reinforcement Learning Algorithms
by: Caunhye, Ali Murtaza, et al.
Published: (2025)

Autoencoders in Function Space
by: Bunker, Justin, et al.
Published: (2024)

Algorithmic Analysis of Dense Associative Memory: Finite-Size Guarantees and Adversarial Robustness
by: Gaikwad, Madhava
Published: (2026)

Differentiable Optimization Layers for Guaranteed Fairness in Deep Learning
by: Troxell, David, et al.
Published: (2026)

Exact Loop Controllers for ReLU Realization of Homogeneous Curve Refinements
by: Bolorkhuu, Boldsaikhan, et al.
Published: (2026)

Model Input-Output Configuration Search with Embedded Feature Selection for Sensor Time-series and Image Classification
by: Hoang, Anh T., et al.
Published: (2023)

Context-dependent manifold learning: A neuromodulated constrained autoencoder approach
by: Adriaens, Jérôme, et al.
Published: (2026)

Hybrid activation functions for deep neural networks: S3 and S4 -- a novel approach to gradient flow optimization
by: Kavun, Sergii
Published: (2025)

Implementing Online Reinforcement Learning with Clustering Neural Networks
by: Smith, James E.
Published: (2024)

Sequential, Parallel and Consecutive Hybrid Evolutionary-Swarm Optimization Metaheuristics
by: Urbańczyk, Piotr, et al.
Published: (2025)

Anarchy in the swarm: Testing informed and uninformed diversity-enhancing mechanisms within PSO framework
by: Urbańczyk, Piotr, et al.
Published: (2026)