Imagen de Portada

Multi-layer State Evolution Under Random Convolutional Design

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Daniels, Mara, Gerbelot, Cédric, Krzakala, Florent, Zdeborová, Lenka
Formato:	Preprint
Publicado:	2022
Materias:	Information Theory
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Rigorous dynamical mean field theory for stochastic gradient descent methods
por: Gerbelot, Cedric, et al.
Publicado: (2022)

Statistical mechanics of the maximum-average submatrix problem
por: Erba, Vittorio, et al.
Publicado: (2023)

The Nuclear Route: Sharp Asymptotics of ERM in Overparameterized Quadratic Networks
por: Erba, Vittorio, et al.
Publicado: (2025)

Fundamental Limits of Matrix Sensing: Exact Asymptotics, Universality, and Applications
por: Xu, Yizhou, et al.
Publicado: (2025)

The phase diagram of compressed sensing with $\ell_0$-norm regularization
por: Barbier, Damien, et al.
Publicado: (2024)

Bayes-optimal learning of an extensive-width neural network from quadratically many samples
por: Maillard, Antoine, et al.
Publicado: (2024)

Single-Head Attention in High Dimensions: A Theory of Generalization, Weights Spectra, and Scaling Laws
por: Boncoraglio, Fabrizio, et al.
Publicado: (2025)

Gaussian Universality of Perceptrons with Random Labels
por: Gerace, Federica, et al.
Publicado: (2022)

Low-rank Matrix Estimation with Inhomogeneous Noise
por: Guionnet, Alice, et al.
Publicado: (2022)

Universality laws for Gaussian mixtures in generalized linear models
por: Dandi, Yatin, et al.
Publicado: (2023)

Learning with Restricted Boltzmann Machines: Asymptotics of AMP and GD in High Dimensions
por: Xu, Yizhou, et al.
Publicado: (2025)

Computational Thresholds in Multi-Modal Learning via the Spiked Matrix-Tensor Model
por: Tabanelli, Hugo, et al.
Publicado: (2025)

Fundamental limits of Non-Linear Low-Rank Matrix Estimation
por: Mergny, Pierre, et al.
Publicado: (2024)

Sampling with flows, diffusion and autoregressive neural networks: A spin-glass perspective
por: Ghio, Davide, et al.
Publicado: (2023)

Estimating rank-one matrices with mismatched prior and noise: universality and large deviations
por: Guionnet, Alice, et al.
Publicado: (2023)

A phase transition between positional and semantic learning in a solvable model of dot-product attention
por: Cui, Hugo, et al.
Publicado: (2024)

Quenches in the Sherrington-Kirkpatrick model
por: Erba, Vittorio, et al.
Publicado: (2024)

The Computational Advantage of Depth: Learning High-Dimensional Hierarchical Functions with Gradient Descent
por: Dandi, Yatin, et al.
Publicado: (2025)

Compressed sensing with l0-norm: statistical physics analysis and algorithms for signal recovery
por: Barbier, D., et al.
Publicado: (2023)

Bayes optimal learning of attention-indexed models
por: Boncoraglio, Fabrizio, et al.
Publicado: (2025)

The committee machine: Computational to statistical gaps in learning a two-layers neural network
por: Aubin, Benjamin, et al.
Publicado: (2018)

Analysis of learning a flow-based generative model from limited sample complexity
por: Cui, Hugo, et al.
Publicado: (2023)

On the Atypical Solutions of the Symmetric Binary Perceptron
por: Barbier, Damien, et al.
Publicado: (2023)

The maximum-average subtensor problem: equilibrium and out-of-equilibrium properties
por: Erba, Vittorio, et al.
Publicado: (2025)

Asymptotics of Non-Convex Generalized Linear Models in High-Dimensions: A proof of the replica formula
por: Vilucchio, Matteo, et al.
Publicado: (2025)

Asymptotics of SGD in Sequence-Single Index Models and Single-Layer Attention Networks
por: Arnaboldi, Luca, et al.
Publicado: (2025)

Fundamental limits of learning in sequence multi-index models and deep attention networks: High-dimensional asymptotics and sharp thresholds
por: Troiani, Emanuele, et al.
Publicado: (2025)

Counting and Hardness-of-Finding Fixed Points in Cellular Automata on Random Graphs
por: Koller, Cédric, et al.
Publicado: (2024)

Asymptotics of feature learning in two-layer networks after one gradient-step
por: Cui, Hugo, et al.
Publicado: (2024)

Spectral Thresholds in Correlated Spiked Models and Fundamental Limits of Partial Least Squares
por: Mergny, Pierre, et al.
Publicado: (2025)

Analysis of Bootstrap and Subsampling in High-dimensional Regularized Regression
por: Clarté, Lucas, et al.
Publicado: (2024)

Fundamental computational limits of weak learnability in high-dimensional multi-index models
por: Troiani, Emanuele, et al.
Publicado: (2024)

The Benefits of Reusing Batches for Gradient Descent in Two-Layer Networks: Breaking the Curse of Information and Leap Exponents
por: Dandi, Yatin, et al.
Publicado: (2024)

Fluid Antenna Meets RIS: Random Matrix Analysis and Two-Timescale Design for Multi-User Communications
por: Zhang, Xin, et al.
Publicado: (2025)

Design of Convolutional Codes for Varying Constraint Lengths
por: Dhounde, Parag, et al.
Publicado: (2024)

Multi-User Distillation of Common Randomness and Entanglement from Quantum States
por: Salek, Farzin, et al.
Publicado: (2020)

Design of MDP Convolutional Codes and Maximally Recoverable Codes Through the Lens of Matrix Completion
por: Dang, Sakshi, et al.
Publicado: (2026)

ColBERT-Zero: To Pre-train Or Not To Pre-train ColBERT models
por: Chaffin, Antoine, et al.
Publicado: (2026)

Stochastic gradient descent in high dimensions for multi-spiked tensor PCA
por: Arous, Gérard Ben, et al.
Publicado: (2024)

Multi-layer RIS on Edge: Communication, Computation and Wireless Power Transfer
por: Chen, Shuyi, et al.
Publicado: (2025)