Neural Collapse Dynamics: Depth, Activation, Regularisation, and Feature Norm Threshold

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Rupa, Anamika Paul
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Systematic Empirical Study of Grokking: Depth, Architecture, Activation, and Regularization
by: Manir, Shalima Binta, et al.
Published: (2026)

Probe-Geometry Alignment: Erasing the Cross-Sequence Memorization Signature Below Chance
by: Rupa, Anamika Paul, et al.
Published: (2026)

Canonical Regularisation of Wide Feature-Learning Neural Networks
by: Whittle, George, et al.
Published: (2026)

Enhanced Feature Learning via Regularisation: Integrating Neural Networks and Kernel Methods
by: Follain, Bertille, et al.
Published: (2024)

Temporal Smoothness Regularisers for Neural Link Predictors
by: Dileo, Manuel, et al.
Published: (2023)

Depth Separation in Norm-Bounded Infinite-Width Neural Networks
by: Parkinson, Suzanna, et al.
Published: (2024)

On Self-Supervised Dynamic Incremental Regularised Adaptation
by: Ghobrial, Abanoub, et al.
Published: (2023)

DIRA: Dynamic Domain Incremental Regularised Adaptation
by: Ghobrial, Abanoub, et al.
Published: (2022)

Geometry and Dynamics of LayerNorm
by: Riechers, Paul M.
Published: (2024)

Comparing Spectral Bias and Robustness For Two-Layer Neural Networks: SGD vs Adaptive Random Fourier Features
by: Kammonen, Aku, et al.
Published: (2024)

Feature Learning Dynamics in Infinite-Depth Neural Networks
by: Yao, Zihan, et al.
Published: (2025)

Neural Collapse Beyond the Unconstrained Features Model: Landscape, Dynamics, and Generalization in the Mean-Field Regime
by: Wu, Diyuan, et al.
Published: (2025)

An Infinite-Width Analysis on the Jacobian-Regularised Training of a Neural Network
by: Kim, Taeyoung, et al.
Published: (2023)

Beyond Unconstrained Features: Neural Collapse for Shallow Neural Networks with General Data
by: Hong, Wanli, et al.
Published: (2024)

On the Robustness of Neural Collapse and the Neural Collapse of Robustness
by: Su, Jingtong, et al.
Published: (2023)

Feature Normalization Prevents Collapse of Non-contrastive Learning Dynamics
by: Bao, Han
Published: (2023)

An Adaptive Random Fourier Features approach Applied to Learning Stochastic Differential Equations
by: Douglas, Owen, et al.
Published: (2025)

Feature Dynamics as Implicit Data Augmentation: A Depth-Decomposed View on Deep Neural Network Generalization
by: Ruan, Tianyu, et al.
Published: (2025)

Approximate Equivariance via Projection-based Regularisation
by: Berndt, Torben, et al.
Published: (2026)

Monte Carlo Functional Regularisation for Continual Learning
by: Hao, Pengcheng, et al.
Published: (2025)

Regularising NARX models with multi-task learning
by: Bee, Sarah, et al.
Published: (2025)

Adaptive Random Fourier Features Training Stabilized By Resampling With Applications in Image Regression
by: Kammonen, Aku, et al.
Published: (2024)

Neural Collapse in Cumulative Link Models for Ordinal Regression: An Analysis with Unconstrained Feature Model
by: Ma, Chuang, et al.
Published: (2025)

Measuring Feature Dependency of Neural Networks by Collapsing Feature Dimensions in the Data Manifold
by: Jin, Yinzhu, et al.
Published: (2024)

Function-Space Empirical Bayes Regularisation with Student's t Priors
by: Hao, Pengcheng, et al.
Published: (2026)

Evidence on the Regularisation Properties of Maximum-Entropy Reinforcement Learning
by: Hosseinkhan-Boucher, Rémy, et al.
Published: (2025)

Neural Collapse for Cross-entropy Class-Imbalanced Learning with Unconstrained ReLU Feature Model
by: Dang, Hien, et al.
Published: (2024)

Minimizing Layerwise Activation Norm Improves Generalization in Federated Learning
by: Yashwanth, M, et al.
Published: (2025)

Scaling Collapse Reveals Universal Dynamics in Compute-Optimally Trained Neural Networks
by: Qiu, Shikai, et al.
Published: (2025)

TASER: Task-Aware Stein Regularisation for Geometry-Driven Robustness
by: Kozyra, Michał, et al.
Published: (2026)

Stochastic Kernel Regularisation Improves Generalisation in Deep Kernel Machines
by: Milsom, Edward, et al.
Published: (2024)

Sobolev Space Regularised Pre Density Models
by: Kozdoba, Mark, et al.
Published: (2023)

Pursuing Feature Separation based on Neural Collapse for Out-of-Distribution Detection
by: Wu, Yingwen, et al.
Published: (2024)

Harnessing Feature Clustering For Enhanced Anomaly Detection With Variational Autoencoder And Dynamic Threshold
by: Ale, Tolulope, et al.
Published: (2024)

Depth Separations in Neural Networks: Separating the Dimension from the Accuracy
by: Safran, Itay, et al.
Published: (2024)

Direct Training Needs Regularisation: Anytime Optimal Inference Spiking Neural Network
by: Wu, Dengyu, et al.
Published: (2024)

A Novel Approach to Regularising 1NN classifier for Improved Generalization
by: Challa, Aditya, et al.
Published: (2024)

High-dimensional Asymptotics of VAEs: Threshold of Posterior Collapse and Dataset-Size Dependence of Rate-Distortion Curve
by: Ichikawa, Yuma, et al.
Published: (2023)

A Computable Measure of Suboptimality for Entropy-Regularised Variational Objectives
by: Chazal, Clémentine, et al.
Published: (2025)

Neural Collapse versus Low-rank Bias: Is Deep Neural Collapse Really Optimal?
by: Súkeník, Peter, et al.
Published: (2024)