The Impact of Geometric Complexity on Neural Collapse in Transfer Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Munn, Michael, Dherin, Benoit, Gonzalvo, Javier
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Margin-based Multiclass Generalization Bound via Geometric Complexity
by: Munn, Michael, et al.
Published: (2024)

Equivalence of Context and Parameter Updates in Modern Transformer Blocks
by: Goldwaser, Adrian, et al.
Published: (2025)

Learning without training: The implicit dynamics of in-context learning
by: Dherin, Benoit, et al.
Published: (2025)

Transmuting prompts into weights
by: Mazzawi, Hanna, et al.
Published: (2025)

On residual network depth
by: Dherin, Benoit, et al.
Published: (2025)

Learning by solving differential equations
by: Dherin, Benoit, et al.
Published: (2025)

How iteration order influences convergence and stability in deep learning
by: Dherin, Benoit, et al.
Published: (2025)

Grow, Don't Overwrite: Fine-tuning Without Forgetting
by: Adila, Dyah, et al.
Published: (2026)

Deep Fusion: Efficient Network Training via Pre-trained Initializations
by: Mazzawi, Hanna, et al.
Published: (2023)

Corridor Geometry in Gradient-Based Optimization
by: Dherin, Benoit, et al.
Published: (2024)

Geometric States
by: Dherin, Benoit, et al.
Published: (2024)

Controlling Neural Collapse Enhances Out-of-Distribution Detection and Transfer Learning
by: Harun, Md Yousuf, et al.
Published: (2025)

Towards Understanding the Link Between Modularity and Performance in Neural Networks for Reinforcement Learning
by: Munn, Humphrey, et al.
Published: (2022)

A Bayesian Model Selection Criterion for Selecting Pretraining Checkpoints
by: Munn, Michael, et al.
Published: (2024)

Geometric Analysis of Neural Regression Collapse via Intrinsic Dimension
by: Andriopoulos, George, et al.
Published: (2025)

On the Robustness of Neural Collapse and the Neural Collapse of Robustness
by: Su, Jingtong, et al.
Published: (2023)

Directional Neural Collapse Explains Few-Shot Transfer in Self-Supervised Learning
by: Luthra, Achleshwar, et al.
Published: (2026)

Rethinking Continual Learning with Progressive Neural Collapse
by: Wang, Zheng, et al.
Published: (2025)

A Unified Geometric Framework for Weighted Contrastive Learning
by: Vock, Raphael, et al.
Published: (2026)

Echoes Before Collapse: Deep Learning Detection of Flickering in Complex Systems
by: Maghsoodlo, Yazdan Babazadeh, et al.
Published: (2025)

Understanding and Improving Transfer Learning of Deep Models via Neural Collapse
by: Li, Xiao, et al.
Published: (2022)

Flatness is Necessary, Neural Collapse is Not: Rethinking Generalization via Grokking
by: Han, Ting, et al.
Published: (2025)

Neural Collapse in Multi-label Learning with Pick-all-label Loss
by: Li, Pengyu, et al.
Published: (2023)

Neural Collapse versus Low-rank Bias: Is Deep Neural Collapse Really Optimal?
by: Súkeník, Peter, et al.
Published: (2024)

Pushing Boundaries: Mixup's Influence on Neural Collapse
by: Fisher, Quinn, et al.
Published: (2024)

Optimizer choice matters for the emergence of Neural Collapse
by: Zhao, Jim, et al.
Published: (2026)

Trojan Cleansing with Neural Collapse
by: Gu, Xihe, et al.
Published: (2024)

Physics-Informed Neural Networks for Methane Sorption: Cross-Gas Transfer Learning, Ensemble Collapse Under Physics Constraints, and Monte Carlo Dropout Uncertainty Quantification
by: Nooraiepour, Mohammad, et al.
Published: (2026)

The Prevalence of Neural Collapse in Neural Multivariate Regression
by: Andriopoulos, George, et al.
Published: (2024)

SAMix: Calibrated and Accurate Continual Learning via Sphere-Adaptive Mixup and Neural Collapse
by: Dang, Trung-Anh, et al.
Published: (2025)

Scalable Multi-Objective Robot Reinforcement Learning through Gradient Conflict Resolution
by: Munn, Humphrey, et al.
Published: (2025)

The Geometric Cost of Normalization: Affine Bounds on the Bayesian Complexity of Neural Networks
by: Chun, Sungbae
Published: (2026)

The Persistence of Neural Collapse Despite Low-Rank Bias
by: Garrod, Connall, et al.
Published: (2024)

Neural Collapse by Design: Learning Class Prototypes on the Hypersphere
by: Koromilas, Panagiotis, et al.
Published: (2026)

Leveraging Intermediate Neural Collapse with Simplex ETFs for Efficient Deep Neural Networks
by: Liu, Emily
Published: (2024)

Beyond Unconstrained Features: Neural Collapse for Shallow Neural Networks with General Data
by: Hong, Wanli, et al.
Published: (2024)

Neural Collapse for Cross-entropy Class-Imbalanced Learning with Unconstrained ReLU Feature Model
by: Dang, Hien, et al.
Published: (2024)

Hard-Negative Sampling for Contrastive Learning: Optimal Representation Geometry and Neural- vs Dimensional-Collapse
by: Jiang, Ruijie, et al.
Published: (2023)

Geometric Embedding Alignment via Curvature Matching in Transfer Learning
by: Ko, Sung Moon, et al.
Published: (2025)

Majority Kernels: An Approach to Leverage Big Model Dynamics for Efficient Small Model Training
by: Mazzawi, Hanna, et al.
Published: (2024)