Cover Image

Does Sparse Connectivity Improve Generalization? Convolutional Networks Below the Edge of Stability

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Liang, Tongtong, Singh, Esha, Parhi, Rahul, Cloninger, Alexander, Wang, Yu-Xiang
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Generalization Below the Edge of Stability: The Role of Data Geometry
by: Liang, Tongtong, et al.
Published: (2025)

Stable Minima of ReLU Neural Networks Suffer from the Curse of Dimensionality: The Neural Shattering Phenomenon
by: Liang, Tongtong, et al.
Published: (2025)

On the Loss Landscape Geometry of Regularized Deep Matrix Factorization: Uniqueness and Sharpness
by: Kamber, Anil, et al.
Published: (2026)

Function-Space Optimality of Neural Architectures with Multivariate Nonlinearities
by: Parhi, Rahul, et al.
Published: (2023)

Sharpness of Minima in Deep Matrix Factorization
by: Kamber, Anil, et al.
Published: (2025)

LoLA: Low-Rank Linear Attention With Sparse Caching
by: McDermott, Luke, et al.
Published: (2025)

Stable Minima Cannot Overfit in Univariate ReLU Networks: Generalization by Large Step Sizes
by: Qiao, Dan, et al.
Published: (2024)

A Gap Between the Gaussian RKHS and Neural Networks: An Infinite-Center Asymptotic Analysis
by: Kumar, Akash, et al.
Published: (2025)

Finding Stable Subnetworks at Initialization with Dataset Distillation
by: McDermott, Luke, et al.
Published: (2025)

Training Guarantees of Neural Network Classification Two-Sample Tests by Kernel Analysis
by: Khurana, Varun, et al.
Published: (2024)

Nonasymptotic Convergence Rates for Plug-and-Play Methods With MMSE Denoisers
by: Pritchard, Henry, et al.
Published: (2025)

Variation Spaces for Multi-Output Neural Networks: Insights on Multi-Task Learning and Network Compression
by: Shenouda, Joseph, et al.
Published: (2023)

ALPS: Improved Optimization for Highly Sparse One-Shot Pruning for Large Language Models
by: Meng, Xiang, et al.
Published: (2024)

Point Cloud Classification via Deep Set Linearized Optimal Transport
by: Mahan, Scott, et al.
Published: (2024)

CW-CNN & CW-AN: Convolutional Networks and Attention Networks for CW-Complexes
by: Khorana, Rahul
Published: (2024)

Towards Sharp Minimax Risk Bounds for Operator Learning
by: Adcock, Ben, et al.
Published: (2025)

Random ReLU Neural Networks as Non-Gaussian Processes
by: Parhi, Rahul, et al.
Published: (2024)

LayerPipe2: Multistage Pipelining and Weight Recompute via Improved Exponential Moving Average for Training Neural Networks
by: Unnikrishnan, Nanda K., et al.
Published: (2025)

Generalization Bound for Diffusion Models using Random Features
by: Saha, Esha, et al.
Published: (2023)

Does Flatness imply Generalization for Logistic Loss in Univariate Two-Layer ReLU Network?
by: Qiao, Dan, et al.
Published: (2025)

GTAGCN: Generalized Topology Adaptive Graph Convolutional Networks
by: Singh, Sukhdeep, et al.
Published: (2024)

Risk Prediction of Cardiovascular Disease for Diabetic Patients with Machine Learning and Deep Learning Techniques
by: Chowdhury, Esha
Published: (2025)

When Data Falls Short: Grokking Below the Critical Threshold
by: Singh, Vaibhav, et al.
Published: (2025)

Edge AI: Evaluation of Model Compression Techniques for Convolutional Neural Networks
by: Francy, Samer, et al.
Published: (2024)

Hierarchical Multiple Kernel K-Means Algorithm Based on Sparse Connectivity
by: Wang, Lei, et al.
Published: (2024)

Learning Coupled System Dynamics under Incomplete Physical Constraints and Missing Data
by: Saha, Esha, et al.
Published: (2025)

Deeper Insights into Deep Graph Convolutional Networks: Stability and Generalization
by: Yang, Guangrui, et al.
Published: (2024)

The Transferability of Downsamped Sparse Graph Convolutional Networks
by: Shu, Qinji, et al.
Published: (2024)

High-Order Tensor Regression in Sparse Convolutional Neural Networks
by: Algarte, Roberto Dias
Published: (2025)

Transformers for Learning on Noisy and Task-Level Manifolds: Approximation and Generalization Insights
by: Shen, Zhaiming, et al.
Published: (2025)

3BASiL: An Algorithmic Framework for Sparse plus Low-Rank Compression of LLMs
by: Makni, Mehdi, et al.
Published: (2026)

Channel-Wise MLPs Improve the Generalization of Recurrent Convolutional Networks
by: Breslow, Nathan
Published: (2025)

Tensor Convolutional Network for Higher-Order Interaction Prediction in Sparse Tensors
by: Jang, Jun-Gi, et al.
Published: (2025)

Linearized Optimal Transport pyLOT Library: A Toolkit for Machine Learning on Point Clouds
by: Linwu, Jun, et al.
Published: (2025)

Linear Mode Connectivity in Sparse Neural Networks
by: McDermott, Luke, et al.
Published: (2023)

Generalized Linear Mode Connectivity for Transformers
by: Theus, Alexander, et al.
Published: (2025)

Learning Dynamics of Deep Linear Networks Beyond the Edge of Stability
by: Ghosh, Avrajit, et al.
Published: (2025)

Robust Tangent Space Estimation via Laplacian Eigenvector Gradient Orthogonalization
by: Kohli, Dhruv, et al.
Published: (2025)

Weighted variation spaces and approximation by shallow ReLU networks
by: DeVore, Ronald, et al.
Published: (2023)

Ghost-Connect Net: A Generalization-Enhanced Guidance For Sparse Deep Networks Under Distribution Shifts
by: Wisell, Mary Isabelle, et al.
Published: (2024)