Image de couverture de livre

Overparametrized linear dimensionality reductions: From projection pursuit to two-layer neural networks

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Montanari, Andrea, Zhou, Kangjie
Format:	Preprint
Publié:	2022
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Learning time-scales in two-layers neural networks
par: Berthier, Raphaël, et autres
Publié: (2023)

Which exceptional low-dimensional projections of a Gaussian point cloud can be found in polynomial time?
par: Montanari, Andrea, et autres
Publié: (2024)

Tractability from overparametrization: The example of the negative perceptron
par: Montanari, Andrea, et autres
Publié: (2021)

Pinet: Optimizing hard-constrained neural networks with orthogonal projection layers
par: Grontas, Panagiotis D., et autres
Publié: (2025)

Generalization error property of infoGAN for two-layer neural network
par: Hasan, Mahmud, et autres
Publié: (2023)

Overparametrized models with posterior drift
par: Coqueret, Guillaume, et autres
Publié: (2025)

A duality framework for analyzing random feature and two-layer neural networks
par: Chen, Hongrui, et autres
Publié: (2023)

Sampling, Diffusions, and Stochastic Localization
par: Montanari, Andrea
Publié: (2023)

Quantitative convergence of trained single layer neural networks to Gaussian processes
par: Mosig, Eloy, et autres
Publié: (2025)

The Lattice Overparametrization Paradigm for the Machine Learning of Lattice Operators
par: Marcondes, Diego, et autres
Publié: (2023)

On the Interplay of Priors and Overparametrization in Bayesian Neural Network Posteriors
par: Kobialka, Julius, et autres
Publié: (2026)

On the Epistemic Uncertainty of Overparametrized Neural Networks
par: Rügamer, David
Publié: (2026)

High-dimensional logistic regression with missing data: Imputation, regularization, and universality
par: Verchand, Kabir Aladin, et autres
Publié: (2024)

Sharp description of local minima in the loss landscape of high-dimensional two-layer ReLU neural networks
par: Huang, Jie, et autres
Publié: (2026)

Ultra-fast feature learning for the training of two-layer neural networks in the two-timescale regime
par: Barboni, Raphaël, et autres
Publié: (2025)

Understanding Overparametrization in Survival Models through Interpolation
par: Liu, Yin, et autres
Publié: (2025)

Optimization and generalization analysis for two-layer physics-informed neural networks without over-parametrization
par: Zeng, Zhihan, et autres
Publié: (2025)

CBMAP: Clustering-based manifold approximation and projection for dimensionality reduction
par: Dogan, Berat
Publié: (2024)

Escaping mediocrity: how two-layer networks learn hard generalized linear models with SGD
par: Arnaboldi, Luca, et autres
Publié: (2023)

Gaussian mixture layers for neural networks
par: Chewi, Sinho, et autres
Publié: (2025)

Interpretable non-linear dimensionality reduction using gaussian weighted linear transformation
par: Bergh, Erik
Publié: (2025)

Training Overparametrized Neural Networks in Sublinear Time
par: Deng, Yichuan, et autres
Publié: (2022)

Symmetries in Overparametrized Neural Networks: A Mean-Field View
par: Maass, Javier, et autres
Publié: (2024)

Random-projection ensemble dimension reduction
par: Zhou, Wenxing, et autres
Publié: (2024)

Simultaneous linear connectivity of neural networks modulo permutation
par: Sharma, Ekansh, et autres
Publié: (2024)

Memory capacity of two layer neural networks with smooth activations
par: Madden, Liam, et autres
Publié: (2023)

Implicit Compressibility of Overparametrized Neural Networks Trained with Heavy-Tailed SGD
par: Wan, Yijun, et autres
Publié: (2023)

Lower Bounds for the Convergence of Tensor Power Iteration on Random Overcomplete Models
par: Wu, Yuchen, et autres
Publié: (2022)

Sharp Analysis of Power Iteration for Tensor PCA
par: Wu, Yuchen, et autres
Publié: (2024)

Sobolev neural network with residual weighting as a surrogate in linear and non-linear mechanics
par: Kilicsoy, A. O. M., et autres
Publié: (2024)

A universal linearized subspace refinement framework for neural networks
par: Cao, Wenbo, et autres
Publié: (2026)

Computational bottlenecks for denoising diffusions
par: Montanari, Andrea, et autres
Publié: (2025)

Any-dimensional equivariant neural networks
par: Levin, Eitan, et autres
Publié: (2023)

SIMAP: A simplicial-map layer for neural networks
par: Gonzalez-Diaz, Rocio, et autres
Publié: (2024)

Generalization error bounds for two-layer neural networks with Lipschitz loss function
par: Nguwi, Jiang Yu, et autres
Publié: (2026)

Smoothing the Edges: Smooth Optimization for Sparse Regularization using Hadamard Overparametrization
par: Kolb, Chris, et autres
Publié: (2023)

Critical Points of Degenerate Metrics on Algebraic Varieties: A Tale of Overparametrization
par: Marchetti, Giovanni Luca, et autres
Publié: (2025)

Macroscopic auxiliary asymptotic preserving neural networks for the linear radiative transfer equations
par: Li, Hongyan, et autres
Publié: (2024)

Causally Consistent Normalizing Flow
par: Zhou, Qingyang, et autres
Publié: (2024)

Information-theoretic reduction of deep neural networks to linear models in the overparametrized proportional regime
par: Camilli, Francesco, et autres
Publié: (2025)