Cover Image

Rare dense solutions clusters in asymmetric binary perceptrons -- local entropy via fully lifted RDT

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Stojnic, Mihailo
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Disordered Systems and Neural Networks Information Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Parametric RDT approach to computational gap of symmetric binary perceptron
by: Stojnic, Mihailo
Published: (2026)

Ultrametric OGP - parametric RDT \emph{symmetric} binary perceptron connection
by: Stojnic, Mihailo
Published: (2026)

Binary perceptron computational gap -- a parametric fl RDT view
by: Stojnic, Mihailo
Published: (2025)

Ground state energies of multipartite $p$-spin models -- partially lifted RDT view
by: Stojnic, Mihailo
Published: (2025)

Deep ReLU networks -- injectivity capacity upper bounds
by: Stojnic, Mihailo
Published: (2024)

Injectivity capacity of ReLU gates
by: Stojnic, Mihailo
Published: (2024)

Exact capacity of the \emph{wide} hidden layer treelike neural networks with generic activations
by: Stojnic, Mihailo
Published: (2024)

Fixed width treelike neural networks capacity analysis -- generic activations
by: Stojnic, Mihailo
Published: (2024)

Capacity of the Hebbian-Hopfield network associative memory
by: Stojnic, Mihailo
Published: (2024)

CLuP practically achieves $\sim 1.77$ positive and $\sim 0.33$ negative Hopfield model ground state free energy
by: Stojnic, Mihailo
Published: (2025)

A CLuP algorithm to practically achieve $\sim 0.76$ SK--model ground state free energy
by: Stojnic, Mihailo
Published: (2025)

Storage capacity of perceptron with variable selection
by: Xu, Yingying, et al.
Published: (2025)

Statistical physics of deep learning: Optimal learning of a multi-layer perceptron near interpolation
by: Barbier, Jean, et al.
Published: (2025)

Generative diffusion for perceptron problems: statistical physics analysis and efficient algorithms
by: Demyanenko, Elizaveta, et al.
Published: (2025)

Single-Head Attention in High Dimensions: A Theory of Generalization, Weights Spectra, and Scaling Laws
by: Boncoraglio, Fabrizio, et al.
Published: (2025)

Bayes optimal learning of attention-indexed models
by: Boncoraglio, Fabrizio, et al.
Published: (2025)

The Nuclear Route: Sharp Asymptotics of ERM in Overparameterized Quadratic Networks
by: Erba, Vittorio, et al.
Published: (2025)

A universal compression theory for lottery ticket hypothesis and neural scaling laws
by: Wang, Hong-Yi, et al.
Published: (2025)

When resampling/reweighting improves feature learning in imbalanced classification?: A toy-model study
by: Obuchi, Tomoyuki, et al.
Published: (2024)

On the phase diagram of extensive-rank symmetric matrix denoising beyond rotational invariance
by: Barbier, Jean, et al.
Published: (2024)

Implicit bias produces neural scaling laws in learning curves, from perceptrons to deep networks
by: D'Amico, Francesco, et al.
Published: (2025)

Fundamental Limits of Matrix Sensing: Exact Asymptotics, Universality, and Applications
by: Xu, Yizhou, et al.
Published: (2025)

Bayes-optimal learning of an extensive-width neural network from quadratically many samples
by: Maillard, Antoine, et al.
Published: (2024)

Optimal spectral initializers impact on phase retrieval phase transitions -- an RDT view
by: Stojnic, Mihailo
Published: (2025)

A large deviation view of \emph{stationarized} fully lifted blirp interpolation
by: Stojnic, Mihailo
Published: (2025)

Statistical mechanics of extensive-width Bayesian neural networks near interpolation
by: Barbier, Jean, et al.
Published: (2025)

Graphical model for factorization and completion of relatively high rank tensors by sparse sampling
by: Cavaliere, Angelo Giorgio, et al.
Published: (2025)

Optimal generalisation and learning transition in extensive-width shallow neural networks near interpolation
by: Barbier, Jean, et al.
Published: (2025)

Sharp feature-learning transitions and Bayes-optimal neural scaling laws in extensive-width networks
by: Nguyen, Minh-Toan, et al.
Published: (2026)

Analysis of Diffusion Models for Manifold Data
by: George, Anand Jerry, et al.
Published: (2025)

Solution space and storage capacity of fully connected two-layer neural networks with generic activation functions
by: Nishiyama, Sota, et al.
Published: (2024)

Pruning-induced phases in fully-connected neural networks: the eumentia, the dementia, and the amentia
by: Pan, Haining, et al.
Published: (2026)

Neural Langevin Machine: a local asymmetric learning rule can be creative
by: Yu, Zhendong, et al.
Published: (2025)

Information-theoretic reduction of deep neural networks to linear models in the overparametrized proportional regime
by: Camilli, Francesco, et al.
Published: (2025)

High-dimensional manifold of solutions in neural networks: insights from statistical physics
by: Malatesta, Enrico M.
Published: (2023)

Phase transition in compressed sensing using log-sum penalty and adaptive smoothing
by: Morita, Keisuke, et al.
Published: (2026)

Macroscopic Analysis of Vector Approximate Message Passing in a Model Mismatch Setting
by: Takahashi, Takashi, et al.
Published: (2020)

The phase diagram of compressed sensing with $\ell_0$-norm regularization
by: Barbier, Damien, et al.
Published: (2024)

Statistical mechanics of the maximum-average submatrix problem
by: Erba, Vittorio, et al.
Published: (2023)

The Exponential Capacity of Dense Associative Memories
by: Lucibello, Carlo, et al.
Published: (2023)