Imagen de Portada

Beyond Unconstrained Features: Neural Collapse for Shallow Neural Networks with General Data

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Hong, Wanli, Ling, Shuyang
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Neural Collapse Beyond the Unconstrained Features Model: Landscape, Dynamics, and Generalization in the Mean-Field Regime
por: Wu, Diyuan, et al.
Publicado: (2025)

Neural Collapse in Cumulative Link Models for Ordinal Regression: An Analysis with Unconstrained Feature Model
por: Ma, Chuang, et al.
Publicado: (2025)

Neural Collapse for Cross-entropy Class-Imbalanced Learning with Unconstrained ReLU Feature Model
por: Dang, Hien, et al.
Publicado: (2024)

Learning with Shallow Neural Networks on Cluster-Structured Features
por: Cornacchia, Elisabetta, et al.
Publicado: (2026)

Cross Entropy versus Label Smoothing: A Neural Collapse Perspective
por: Guo, Li, et al.
Publicado: (2024)

Neural Collapse under Gradient Flow on Shallow ReLU Networks for Orthogonally Separable Data
por: Min, Hancheng, et al.
Publicado: (2025)

Neural Multivariate Regression: Qualitative Insights from the Unconstrained Feature Model
por: Andriopoulos, George, et al.
Publicado: (2025)

Constrained or Unconstrained? Neural-Network-Based Equation Discovery from Data
por: Norman, Grant, et al.
Publicado: (2024)

Measuring Feature Dependency of Neural Networks by Collapsing Feature Dimensions in the Data Manifold
por: Jin, Yinzhu, et al.
Publicado: (2024)

Time Scale Network: A Shallow Neural Network For Time Series Data
por: Meyer, Trevor, et al.
Publicado: (2023)

On the Robustness of Neural Collapse and the Neural Collapse of Robustness
por: Su, Jingtong, et al.
Publicado: (2023)

Finite Samples for Shallow Neural Networks
por: Xia, Yu, et al.
Publicado: (2025)

Scaling Laws and Spectra of Shallow Neural Networks in the Feature Learning Regime
por: Defilippis, Leonardo, et al.
Publicado: (2025)

Uniform-in-Time Weak Propagation-of-Chaos in Shallow Neural Networks
por: Glasgow, Margalit, et al.
Publicado: (2026)

Generalized Orthogonal Procrustes Problem under Arbitrary Adversaries
por: Ling, Shuyang
Publicado: (2021)

Provable Privacy Attacks on Trained Shallow Neural Networks
por: Smorodinsky, Guy, et al.
Publicado: (2024)

Wasserstein Distributionally Robust Shallow Convex Neural Networks
por: Pallage, Julien, et al.
Publicado: (2024)

Uncertainty Quantification in Graph Neural Networks with Shallow Ensembles
por: Vinchurkar, Tirtha, et al.
Publicado: (2025)

Performance Analysis of Convolutional Neural Network By Applying Unconstrained Binary Quadratic Programming
por: Sharma, Aasish Kumar, et al.
Publicado: (2025)

Leveraging Intermediate Neural Collapse with Simplex ETFs for Efficient Deep Neural Networks
por: Liu, Emily
Publicado: (2024)

Over-parameterised Shallow Neural Networks with Asymmetrical Node Scaling: Global Convergence Guarantees and Feature Learning
por: Caron, Francois, et al.
Publicado: (2023)

Shallow Neural Networks Learn Low-Degree Spherical Polynomials with Feature Learning by Learnable Channel Attention
por: Yang, Yingzhen
Publicado: (2025)

Neural Collapse Dynamics: Depth, Activation, Regularisation, and Feature Norm Threshold
por: Rupa, Anamika Paul
Publicado: (2026)

Implicit Bias of Mirror Flow for Shallow Neural Networks in Univariate Regression
por: Liang, Shuang, et al.
Publicado: (2024)

A General Constructive Upper Bound on Shallow Neural Nets Complexity
por: Hakl, Frantisek, et al.
Publicado: (2025)

Towards Initialization-dependent and Non-vacuous Generalization Bounds for Overparameterized Shallow Neural Networks
por: Lei, Yunwen, et al.
Publicado: (2026)

Statistical Guarantees for Approximate Stationary Points of Shallow Neural Networks
por: Taheri, Mahsa, et al.
Publicado: (2022)

On the Neural Feature Ansatz for Deep Neural Networks
por: Tansley, Edward, et al.
Publicado: (2025)

Mixture of Scope Experts at Test: Generalizing Deeper Graph Neural Networks with Shallow Variants
por: Deng, Gangda, et al.
Publicado: (2024)

From Shallow Bayesian Neural Networks to Gaussian Processes: General Convergence, Identifiability and Scalable Inference
por: de Araújo, Gracielle Antunes, et al.
Publicado: (2026)

Wide Neural Networks Trained with Weight Decay Provably Exhibit Neural Collapse
por: Jacot, Arthur, et al.
Publicado: (2024)

Beyond NNGP: Large Deviations and Feature Learning in Bayesian Neural Networks
por: Papagiannouli, Katerina, et al.
Publicado: (2026)

Flatness is Necessary, Neural Collapse is Not: Rethinking Generalization via Grokking
por: Han, Ting, et al.
Publicado: (2025)

The Prevalence of Neural Collapse in Neural Multivariate Regression
por: Andriopoulos, George, et al.
Publicado: (2024)

Geometric Analysis of Unconstrained Feature Models with $d=K$
por: Shen, Yi, et al.
Publicado: (2024)

Neural Collapse versus Low-rank Bias: Is Deep Neural Collapse Really Optimal?
por: Súkeník, Peter, et al.
Publicado: (2024)

Harnessing Collective Structure Knowledge in Data Augmentation for Graph Neural Networks
por: Ma, Rongrong, et al.
Publicado: (2024)

Quotient Geometry, Effective Curvature, and Implicit Bias in Simple Shallow Neural Networks
por: Dong, Hang-Cheng, et al.
Publicado: (2026)

The Spectral Bias of Shallow Neural Network Learning is Shaped by the Choice of Non-linearity
por: Sahs, Justin, et al.
Publicado: (2025)

Posterior Inference on Shallow Infinitely Wide Bayesian Neural Networks under Weights with Unbounded Variance
por: Loría, Jorge, et al.
Publicado: (2023)