Copertina

On the Principles of ReLU Networks with One Hidden Layer

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autore principale:	Huang, Changcun
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Artificial Intelligence Neural and Evolutionary Computing 68T07(Primary), 41A15(Secondary) I.2.6; G.1.2
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Understanding Two-Layer Neural Networks with Smooth Activation Functions
di: Huang, Changcun
Pubblicazione: (2025)

From Taylor Series to Fourier Synthesis: The Periodic Linear Unit
di: Kudo, Shiko
Pubblicazione: (2025)

Shallow ReLU$^s$ Networks in $L^p$-Type and Sobolev Spaces: Approximation and Path-Norm Controlled Generalization
di: Li, Weizhao, et al.
Pubblicazione: (2026)

AiGAS-dEVL-RC: An Adaptive Growing Neural Gas Model for Recurrently Drifting Unsupervised Data Streams
di: Arostegi, Maria, et al.
Pubblicazione: (2025)

Task-Synchronized Recurrent Neural Networks
di: Lukoševičius, Mantas, et al.
Pubblicazione: (2022)

Game-Theoretic Gradient Control for Robust Neural Network Training
di: Zaitseva, Maria, et al.
Pubblicazione: (2025)

Loss shaping enhances exact gradient learning with Eventprop in spiking neural networks
di: Nowotny, Thomas, et al.
Pubblicazione: (2022)

Rapid training of Hamiltonian graph networks using random features
di: Rahma, Atamert, et al.
Pubblicazione: (2025)

Distributionally Robust Geometric Joint Chance-Constrained Optimization: Neurodynamic Approaches
di: Valli, Ange, et al.
Pubblicazione: (2026)

Efficient Approximation to Analytic and $L^p$ functions by Height-Augmented ReLU Networks
di: Li, ZeYu, et al.
Pubblicazione: (2026)

VORT: Adaptive Power-Law Memory for NLP Transformers
di: Mlaiki, Nabil
Pubblicazione: (2026)

InhibiDistilbert: Knowledge Distillation for a ReLU and Addition-based Transformer
di: Zhang, Tony, et al.
Pubblicazione: (2025)

Is ReLU Adversarially Robust?
di: Sooksatra, Korn, et al.
Pubblicazione: (2024)

The Inhibitor: ReLU and Addition-Based Attention for Efficient Transformers under Fully Homomorphic Encryption on the Torus
di: Brännvall, Rickard, et al.
Pubblicazione: (2023)

Polyharmonic Spline Packages: Composition, Efficient Procedures for Computation and Differentiation
di: Bakhvalov, Yuriy N.
Pubblicazione: (2025)

Exploring the Intersection between Neural Architecture Search and Continual Learning
di: Shahawy, Mohamed, et al.
Pubblicazione: (2022)

Bridging the Gap Between Approximation and Learning via Optimal Approximation by ReLU MLPs of Maximal Regularity
di: Hong, Ruiyang, et al.
Pubblicazione: (2024)

Compressive sensing inspired self-supervised single-pixel imaging
di: Lu, Jijun, et al.
Pubblicazione: (2026)

Combining AI Control Systems and Human Decision Support via Robustness and Criticality
di: Woods, Walt, et al.
Pubblicazione: (2024)

Contraction, Criticality, and Capacity: A Dynamical-Systems Perspective on Echo-State Networks
di: Singh, Pradeep, et al.
Pubblicazione: (2025)

TOPSIS-like metaheuristic for LABS problem
di: Urbańczyk, Aleksandra, et al.
Pubblicazione: (2025)

Topology and Geometry of the Learning Space of ReLU Networks: Connectivity and Singularities
di: Nurisso, Marco, et al.
Pubblicazione: (2026)

Graph2Tac: Online Representation Learning of Formal Math Concepts
di: Blaauwbroek, Lasse, et al.
Pubblicazione: (2024)

The Geometric Mechanics of Contrastive Representation Learning: Alignment Potentials, Entropic Dispersion, and Cross-modal Divergence
di: Cai, Yichao, et al.
Pubblicazione: (2026)

Deep Neural Networks with General Activations: Super-Convergence in Sobolev Norms
di: Yang, Yahong, et al.
Pubblicazione: (2025)

Topological obstruction to the training of shallow ReLU neural networks
di: Nurisso, Marco, et al.
Pubblicazione: (2024)

Machine learning based animal emotion classification using audio signals
di: Slobodian, Mariia, et al.
Pubblicazione: (2025)

Pulse-Driven Neural Architecture: Learnable Oscillatory Dynamics for Robust Continuous-Time Sequence Processing
di: Sharma, Paras
Pubblicazione: (2026)

Muscle Synergy Priors Enhance Biomechanical Fidelity in Predictive Musculoskeletal Locomotion Simulation
di: Park, Ilseung, et al.
Pubblicazione: (2026)

A Comparison Between Decision Transformers and Traditional Offline Reinforcement Learning Algorithms
di: Caunhye, Ali Murtaza, et al.
Pubblicazione: (2025)

Autoencoders in Function Space
di: Bunker, Justin, et al.
Pubblicazione: (2024)

Algorithmic Analysis of Dense Associative Memory: Finite-Size Guarantees and Adversarial Robustness
di: Gaikwad, Madhava
Pubblicazione: (2026)

Differentiable Optimization Layers for Guaranteed Fairness in Deep Learning
di: Troxell, David, et al.
Pubblicazione: (2026)

Exact Loop Controllers for ReLU Realization of Homogeneous Curve Refinements
di: Bolorkhuu, Boldsaikhan, et al.
Pubblicazione: (2026)

Model Input-Output Configuration Search with Embedded Feature Selection for Sensor Time-series and Image Classification
di: Hoang, Anh T., et al.
Pubblicazione: (2023)

Context-dependent manifold learning: A neuromodulated constrained autoencoder approach
di: Adriaens, Jérôme, et al.
Pubblicazione: (2026)

Hybrid activation functions for deep neural networks: S3 and S4 -- a novel approach to gradient flow optimization
di: Kavun, Sergii
Pubblicazione: (2025)

Implementing Online Reinforcement Learning with Clustering Neural Networks
di: Smith, James E.
Pubblicazione: (2024)

Sequential, Parallel and Consecutive Hybrid Evolutionary-Swarm Optimization Metaheuristics
di: Urbańczyk, Piotr, et al.
Pubblicazione: (2025)

Anarchy in the swarm: Testing informed and uninformed diversity-enhancing mechanisms within PSO framework
di: Urbańczyk, Piotr, et al.
Pubblicazione: (2026)