Cover Image

Overparametrized linear dimensionality reductions: From projection pursuit to two-layer neural networks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Montanari, Andrea, Zhou, Kangjie
Format:	Preprint
Published:	2022
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Learning time-scales in two-layers neural networks
by: Berthier, Raphaël, et al.
Published: (2023)

Which exceptional low-dimensional projections of a Gaussian point cloud can be found in polynomial time?
by: Montanari, Andrea, et al.
Published: (2024)

Tractability from overparametrization: The example of the negative perceptron
by: Montanari, Andrea, et al.
Published: (2021)

Pinet: Optimizing hard-constrained neural networks with orthogonal projection layers
by: Grontas, Panagiotis D., et al.
Published: (2025)

Generalization error property of infoGAN for two-layer neural network
by: Hasan, Mahmud, et al.
Published: (2023)

Overparametrized models with posterior drift
by: Coqueret, Guillaume, et al.
Published: (2025)

A duality framework for analyzing random feature and two-layer neural networks
by: Chen, Hongrui, et al.
Published: (2023)

Sampling, Diffusions, and Stochastic Localization
by: Montanari, Andrea
Published: (2023)

Quantitative convergence of trained single layer neural networks to Gaussian processes
by: Mosig, Eloy, et al.
Published: (2025)

The Lattice Overparametrization Paradigm for the Machine Learning of Lattice Operators
by: Marcondes, Diego, et al.
Published: (2023)

On the Interplay of Priors and Overparametrization in Bayesian Neural Network Posteriors
by: Kobialka, Julius, et al.
Published: (2026)

On the Epistemic Uncertainty of Overparametrized Neural Networks
by: Rügamer, David
Published: (2026)

High-dimensional logistic regression with missing data: Imputation, regularization, and universality
by: Verchand, Kabir Aladin, et al.
Published: (2024)

Sharp description of local minima in the loss landscape of high-dimensional two-layer ReLU neural networks
by: Huang, Jie, et al.
Published: (2026)

Ultra-fast feature learning for the training of two-layer neural networks in the two-timescale regime
by: Barboni, Raphaël, et al.
Published: (2025)

Understanding Overparametrization in Survival Models through Interpolation
by: Liu, Yin, et al.
Published: (2025)

Optimization and generalization analysis for two-layer physics-informed neural networks without over-parametrization
by: Zeng, Zhihan, et al.
Published: (2025)

CBMAP: Clustering-based manifold approximation and projection for dimensionality reduction
by: Dogan, Berat
Published: (2024)

Escaping mediocrity: how two-layer networks learn hard generalized linear models with SGD
by: Arnaboldi, Luca, et al.
Published: (2023)

Gaussian mixture layers for neural networks
by: Chewi, Sinho, et al.
Published: (2025)

Interpretable non-linear dimensionality reduction using gaussian weighted linear transformation
by: Bergh, Erik
Published: (2025)

Training Overparametrized Neural Networks in Sublinear Time
by: Deng, Yichuan, et al.
Published: (2022)

Symmetries in Overparametrized Neural Networks: A Mean-Field View
by: Maass, Javier, et al.
Published: (2024)

Random-projection ensemble dimension reduction
by: Zhou, Wenxing, et al.
Published: (2024)

Simultaneous linear connectivity of neural networks modulo permutation
by: Sharma, Ekansh, et al.
Published: (2024)

Memory capacity of two layer neural networks with smooth activations
by: Madden, Liam, et al.
Published: (2023)

Implicit Compressibility of Overparametrized Neural Networks Trained with Heavy-Tailed SGD
by: Wan, Yijun, et al.
Published: (2023)

Lower Bounds for the Convergence of Tensor Power Iteration on Random Overcomplete Models
by: Wu, Yuchen, et al.
Published: (2022)

Sharp Analysis of Power Iteration for Tensor PCA
by: Wu, Yuchen, et al.
Published: (2024)

Sobolev neural network with residual weighting as a surrogate in linear and non-linear mechanics
by: Kilicsoy, A. O. M., et al.
Published: (2024)

A universal linearized subspace refinement framework for neural networks
by: Cao, Wenbo, et al.
Published: (2026)

Computational bottlenecks for denoising diffusions
by: Montanari, Andrea, et al.
Published: (2025)

Any-dimensional equivariant neural networks
by: Levin, Eitan, et al.
Published: (2023)

SIMAP: A simplicial-map layer for neural networks
by: Gonzalez-Diaz, Rocio, et al.
Published: (2024)

Generalization error bounds for two-layer neural networks with Lipschitz loss function
by: Nguwi, Jiang Yu, et al.
Published: (2026)

Smoothing the Edges: Smooth Optimization for Sparse Regularization using Hadamard Overparametrization
by: Kolb, Chris, et al.
Published: (2023)

Critical Points of Degenerate Metrics on Algebraic Varieties: A Tale of Overparametrization
by: Marchetti, Giovanni Luca, et al.
Published: (2025)

Macroscopic auxiliary asymptotic preserving neural networks for the linear radiative transfer equations
by: Li, Hongyan, et al.
Published: (2024)

Causally Consistent Normalizing Flow
by: Zhou, Qingyang, et al.
Published: (2024)

Information-theoretic reduction of deep neural networks to linear models in the overparametrized proportional regime
by: Camilli, Francesco, et al.
Published: (2025)