Cover Image

Solution space and storage capacity of fully connected two-layer neural networks with generic activation functions

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Nishiyama, Sota, Ohzeki, Masayuki
Format:	Preprint
Published:	2024
Subjects:	Disordered Systems and Neural Networks Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Exact capacity of the \emph{wide} hidden layer treelike neural networks with generic activations
by: Stojnic, Mihailo
Published: (2024)

Storage capacity of perceptron with variable selection
by: Xu, Yingying, et al.
Published: (2025)

Statistical Mechanics Calculations Using Variational Autoregressive Networks and Quantum Annealing
by: Tamura, Yuta, et al.
Published: (2024)

Properties of the geometry of solutions and capacity of multi-layer neural networks with Rectified Linear Units activations
by: Baldassi, Carlo, et al.
Published: (2019)

High-Dimensional Limit of Stochastic Gradient Flow via Dynamical Mean-Field Theory
by: Nishiyama, Sota, et al.
Published: (2026)

Precise Dynamics of Diagonal Linear Networks: A Unifying Analysis by Dynamical Mean-Field Theory
by: Nishiyama, Sota, et al.
Published: (2025)

Fixed width treelike neural networks capacity analysis -- generic activations
by: Stojnic, Mihailo
Published: (2024)

Pruning-induced phases in fully-connected neural networks: the eumentia, the dementia, and the amentia
by: Pan, Haining, et al.
Published: (2026)

Application of time-series quantum generative model to financial data
by: Okumura, Shun, et al.
Published: (2024)

Sharp description of local minima in the loss landscape of high-dimensional two-layer ReLU neural networks
by: Huang, Jie, et al.
Published: (2026)

Exact full-RSB SAT/UNSAT transition in infinitely wide two-layer neural networks
by: Annesi, Brandon L., et al.
Published: (2024)

Storage Capacity Evaluation of the Quantum Perceptron using the Replica Method
by: Urushibata, Mitsuru, et al.
Published: (2024)

Reconsideration of optimization for reduction of traffic congestion
by: Ohzeki, Masayuki
Published: (2024)

A Minimal Duality Estimate for the Surface-Code Threshold under Nearest-Neighbor Correlated Errors
by: Ohzeki, Masayuki
Published: (2026)

Attention-Like Hebbian Learning from Quantum Probability Flow and Quantum-Annealer Tests
by: Ohzeki, Masayuki
Published: (2026)

Duality analysis in symmetric group and its application to random tensor network model
by: Ohzeki, Masayuki
Published: (2023)

Asymptotics of feature learning in two-layer networks after one gradient-step
by: Cui, Hugo, et al.
Published: (2024)

Comparing the effects of Boltzmann machines as associative memory in Generative Adversarial Networks between classical and quantum sampling
by: Urushibata, Mitsuru, et al.
Published: (2022)

Temperature chaos as a logical consequence of the reentrant transition in spin glasses
by: Nishimori, Hidetoshi, et al.
Published: (2025)

Optimal storage capacity of quantum Hopfield neural networks
by: Bödeker, Lukas, et al.
Published: (2022)

High-dimensional learning of narrow neural networks
by: Cui, Hugo
Published: (2024)

Emergent weight morphologies in deep neural networks
by: de Jong, Pascal, et al.
Published: (2025)

In-context denoising with one-layer transformers: connections between attention and associative memory retrieval
by: Smart, Matthew, et al.
Published: (2025)

Supervised and Unsupervised protocols for hetero-associative neural networks
by: Alessandrelli, Andrea, et al.
Published: (2025)

Deep neural networks from the perspective of ergodic theory
by: Zhang, Fan
Published: (2023)

Computing frustration and near-monotonicity in deep neural networks
by: Wendin, Joel, et al.
Published: (2025)

Finite-time Lyapunov exponents of deep neural networks
by: Storm, L., et al.
Published: (2023)

Daydreaming algorithm for Biased Patterns
by: Doi, Mikiya, et al.
Published: (2026)

Training neural networks with structured noise improves classification and generalization
by: Benedetti, Marco, et al.
Published: (2023)

Toward mean-field bound for critical temperature on Nishimori line
by: Okuyama, Manaka, et al.
Published: (2024)

Existence of a Phase Transition in the One-Dimensional Ising Spin Glass Model with Long-Range Interactions on the Nishimori Line
by: Okuyama, Manaka, et al.
Published: (2026)

Online calibration scheme for training restricted Boltzmann machines with quantum annealing
by: Goto, Takeru, et al.
Published: (2023)

Asymptotic generalization error of a single-layer graph convolutional network
by: Duranthon, O., et al.
Published: (2024)

How does training shape the Riemannian geometry of neural network representations?
by: Zavatone-Veth, Jacob A., et al.
Published: (2023)

Predictive power of a Bayesian effective action for fully-connected one hidden layer neural networks in the proportional limit
by: Baglioni, P., et al.
Published: (2024)

Boundary between noise and information applied to filtering neural network weight matrices
by: Staats, Max, et al.
Published: (2022)

Adaptive kernel predictors from feature-learning infinite limits of neural networks
by: Lauditi, Clarissa, et al.
Published: (2025)

Neuronal correlations shape the scaling behavior of memory capacity and nonlinear computational capability of reservoir recurrent neural networks
by: Takasu, Shotaro, et al.
Published: (2025)

Statistical physics analysis of graph neural networks: Approaching optimality in the contextual stochastic block model
by: Duranthon, O., et al.
Published: (2025)

Implicit bias produces neural scaling laws in learning curves, from perceptrons to deep networks
by: D'Amico, Francesco, et al.
Published: (2025)