Cover Image

Graph Neural Networks Do Not Always Oversmooth

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Epping, Bastian, René, Alexandre, Helias, Moritz, Schaub, Michael T.
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Disordered Systems and Neural Networks
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Field theory for optimal signal propagation in ResNets
by: Fischer, Kirsten, et al.
Published: (2023)

A unified theory of feature learning in RNNs and DNNs
by: Bauer, Jan P., et al.
Published: (2026)

Beyond-mean-field fluctuations for the solution of constraint satisfaction problems
by: Foos, Niklas, et al.
Published: (2025)

Linking Network and Neuron-level Correlations by Renormalized Field Theory
by: Dick, Michael, et al.
Published: (2023)

From Kernels to Features: A Multi-Scale Adaptive Theory of Feature Learning
by: Rubin, Noa, et al.
Published: (2025)

Applications of Statistical Field Theory in Deep Learning
by: Ringel, Zohar, et al.
Published: (2025)

Dynamics of neural scaling laws in random feature regression with powerlaw-distributed kernel eigenvalues
by: Kramp, Jakob, et al.
Published: (2026)

Renormalization group for deep neural networks: Universality of learning and scaling laws
by: Coppola, Gorka Peraza, et al.
Published: (2025)

Benchmarking Graph Neural Networks in Solving Hard Constraint Satisfaction Problems
by: Skenderi, Geri, et al.
Published: (2026)

Lecture notes: From Gaussian processes to feature learning
by: Helias, Moritz, et al.
Published: (2026)

Effect of Synaptic Heterogeneity on Neuronal Coordination
by: Layer, Moritz, et al.
Published: (2023)

Graph Neural Network Approach to Predicting Magnetization in Quasi-One-Dimensional Ising Systems
by: Slavin, V., et al.
Published: (2025)

Reduction of interaction order in hard combinatorial optimization via conditionally independent degrees of freedom
by: Ciobanu, Alexandru, et al.
Published: (2025)

Formation of Representations in Neural Networks
by: Ziyin, Liu, et al.
Published: (2024)

Critical feature learning in deep neural networks
by: Fischer, Kirsten, et al.
Published: (2024)

Thermodynamics-Consistent Graph Neural Networks
by: Rittig, Jan G., et al.
Published: (2024)

Demolition and Reinforcement of Memories in Spin-Glass-like Neural Networks
by: Ventura, Enrico
Published: (2024)

Dynamical Mean-Field Theory of Self-Attention Neural Networks
by: Poc-López, Ángel, et al.
Published: (2024)

Growing Neural Networks: Dynamic Evolution through Gradient Descent
by: Radhakrishnan, Anil, et al.
Published: (2025)

The Rules-and-Facts Model for Simultaneous Generalization and Memorization in Neural Networks
by: Farné, Gabriele, et al.
Published: (2026)

A Random-Matrix Criterion for Initializing Gated Recurrent Neural Networks
by: Fioratti, Tommaso, et al.
Published: (2026)

Controlled Langevin Dynamics for Sampling of Feedforward Neural Networks Trained with Minibatches
by: Zambon, Alessandro, et al.
Published: (2026)

A Federated Many-to-One Hopfield model for associative Neural Networks
by: Alessandrelli, Andrea, et al.
Published: (2026)

Kernel Renormalization in Bayesian Deep Neural Networks: the Equivalent Wishart Ansatz in the Proportional Regime
by: Baglioni, Paolo, et al.
Published: (2026)

Siamese Neural Network for Label-Efficient Critical Phenomena Prediction in 3D Percolation Models
by: Wang, Shanshan, et al.
Published: (2025)

Statistical Physics of Deep Neural Networks: Generalization Capability, Beyond the Infinite Width, and Feature Learning
by: Ariosto, Sebastiano
Published: (2025)

Spin-Dependent Graph Neural Network Potential for Magnetic Materials
by: Yu, Hongyu, et al.
Published: (2022)

A Theory of Saddle Escape in Deep Nonlinear Networks
by: Rawal, Divit, et al.
Published: (2026)

Predicting and Interpreting Energy Barriers of Metallic Glasses with Graph Neural Networks
by: Li, Haoyu, et al.
Published: (2023)

Predictive Coding Graphs are a Superset of Feedforward Neural Networks
by: van Zwol, Björn
Published: (2026)

The Quantization Model of Neural Scaling
by: Michaud, Eric J., et al.
Published: (2023)

Explaining Neural Scaling Laws
by: Bahri, Yasaman, et al.
Published: (2021)

Neural Scaling Laws Rooted in the Data Distribution
by: Brill, Ari
Published: (2024)

A Dynamical Model of Neural Scaling Laws
by: Bordelon, Blake, et al.
Published: (2024)

How Feature Learning Can Improve Neural Scaling Laws
by: Bordelon, Blake, et al.
Published: (2024)

Exact Fixed-Point Constraints in Neural-ODEs with Provable Universality
by: Pacifico, Feliciano Giuseppe, et al.
Published: (2026)

Deep Learning as Neural Low-Degree Filtering: A Spectral Theory of Hierarchical Feature Learning
by: Dandi, Yatin, et al.
Published: (2026)

Transfer Learning in Infinite Width Feature Learning Networks
by: Lauditi, Clarissa, et al.
Published: (2025)

Dynamical Decoupling of Generalization and Overfitting in Large Two-Layer Networks
by: Montanari, Andrea, et al.
Published: (2025)

Natural Quantization of Neural Networks
by: Barney, Richard, et al.
Published: (2025)