Bridging Smoothness and Approximation: Theoretical Insights into Over-Smoothing in Graph Neural Networks
Fuente:
arXiv
Saved in:
| Main Authors: | Yang, Guangrui, Li, Jianfei, Li, Ming, Feng, Han, Zhou, Ding-Xuan |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Approximation analysis of CNNs from a feature extraction view
by: Li, Jianfei, et al.
Published: (2022)
by: Li, Jianfei, et al.
Published: (2022)
Sparse-Aware Neural Networks for Nonlinear Functionals: Mitigating the Exponential Dependence on Dimension
by: Li, Jianfei, et al.
Published: (2026)
by: Li, Jianfei, et al.
Published: (2026)
Deeper Insights into Deep Graph Convolutional Networks: Stability and Generalization
by: Yang, Guangrui, et al.
Published: (2024)
by: Yang, Guangrui, et al.
Published: (2024)
Rank Collapse Causes Over-Smoothing and Over-Correlation in Graph Neural Networks
by: Roth, Andreas, et al.
Published: (2023)
by: Roth, Andreas, et al.
Published: (2023)
Prompting a Pretrained Transformer Can Be a Universal Approximator
by: Petrov, Aleksandar, et al.
Published: (2024)
by: Petrov, Aleksandar, et al.
Published: (2024)
On Vanishing Gradients, Over-Smoothing, and Over-Squashing in GNNs: Bridging Recurrent and Graph Learning
by: Arroyo, Álvaro, et al.
Published: (2025)
by: Arroyo, Álvaro, et al.
Published: (2025)
Spherical Analysis of Learning Nonlinear Functionals
by: Yang, Zhenyu, et al.
Published: (2024)
by: Yang, Zhenyu, et al.
Published: (2024)
Fitting Auditory Filterbanks with Multiresolution Neural Networks
by: Lostanlen, Vincent, et al.
Published: (2023)
by: Lostanlen, Vincent, et al.
Published: (2023)
Principled Approaches for Extending Neural Architectures to Function Spaces for Operator Learning
by: Berner, Julius, et al.
Published: (2025)
by: Berner, Julius, et al.
Published: (2025)
Constructive Approximation under Carleman's Condition, with Applications to Smoothed Analysis
by: Koehler, Frederic, et al.
Published: (2025)
by: Koehler, Frederic, et al.
Published: (2025)
Universal Approximation of Nonlinear Operators and Their Derivatives
by: de Feo, Filippo
Published: (2026)
by: de Feo, Filippo
Published: (2026)
Approximation by Steklov Neural Network Operators
by: Karaman, S. N., et al.
Published: (2024)
by: Karaman, S. N., et al.
Published: (2024)
Axiomatization of Gradient Smoothing in Neural Networks
by: Zhou, Linjiang, et al.
Published: (2024)
by: Zhou, Linjiang, et al.
Published: (2024)
Rethinking Over-Smoothing in Graph Neural Networks: A Perspective from Anderson Localization
by: Ouyang, Kaichen
Published: (2025)
by: Ouyang, Kaichen
Published: (2025)
Kolmogorov--Arnold stability
by: Dzhenzher, Sviatoslav V., et al.
Published: (2025)
by: Dzhenzher, Sviatoslav V., et al.
Published: (2025)
Smoothed Distance Kernels for MMDs and Applications in Wasserstein Gradient Flows
by: Rux, Nicolaj, et al.
Published: (2025)
by: Rux, Nicolaj, et al.
Published: (2025)
Graph Rewiring in GNNs to Mitigate Over-Squashing and Over-Smoothing: A Survey
by: Attali, Hugo, et al.
Published: (2024)
by: Attali, Hugo, et al.
Published: (2024)
Graph Rewiring in GNNs to Mitigate Over-Squashing and Over-Smoothing: A Survey
by: Attali, Hugo, et al.
Published: (2026)
by: Attali, Hugo, et al.
Published: (2026)
Smooth Piecewise Cutting for Neural Operator to Handle Discontinuities and Sharp Transitions
by: Dang, Ha, et al.
Published: (2026)
by: Dang, Ha, et al.
Published: (2026)
Equipment Health Assessment: Time Series Analysis for Wind Turbine Performance
by: Backhus, Jana, et al.
Published: (2024)
by: Backhus, Jana, et al.
Published: (2024)
Topological Foundations of Reinforcement Learning
by: Kadurha, David Krame
Published: (2024)
by: Kadurha, David Krame
Published: (2024)
Balancing Graph Embedding Smoothness in Self-Supervised Learning via Information-Theoretic Decomposition
by: Jung, Heesoo, et al.
Published: (2025)
by: Jung, Heesoo, et al.
Published: (2025)
How Does the Smoothness Approximation Method Facilitate Generalization for Federated Adversarial Learning?
by: Ding, Wenjun, et al.
Published: (2024)
by: Ding, Wenjun, et al.
Published: (2024)
Quantitative Sobolev Approximation Bounds for Neural Operators with Empirical Validation on Burgers Equation
by: Hao, Nicole
Published: (2026)
by: Hao, Nicole
Published: (2026)
Theory-to-Practice Gap for Neural Networks and Neural Operators
by: Grohs, Philipp, et al.
Published: (2025)
by: Grohs, Philipp, et al.
Published: (2025)
Quasi-Framelets: Robust Graph Neural Networks via Adaptive Framelet Convolution
by: Yang, Mengxi, et al.
Published: (2022)
by: Yang, Mengxi, et al.
Published: (2022)
The Function Representation of Artificial Neural Network
by: Ma, Zhongkui
Published: (2019)
by: Ma, Zhongkui
Published: (2019)
Upper Approximation Bounds for Neural Oscillators
by: Huang, Zifeng, et al.
Published: (2025)
by: Huang, Zifeng, et al.
Published: (2025)
Polynomial Selection in Spectral Graph Neural Networks: An Error-Sum of Function Slices Approach
by: Li, Guoming, et al.
Published: (2024)
by: Li, Guoming, et al.
Published: (2024)
Smooth Min-Max Monotonic Networks
by: Igel, Christian
Published: (2023)
by: Igel, Christian
Published: (2023)
A Multiplicative Neural Network Architecture: Locality and Regularity of Approximation
by: Choi, Hee-Sun, et al.
Published: (2026)
by: Choi, Hee-Sun, et al.
Published: (2026)
Variational Learning Induces Adaptive Label Smoothing
by: Yang, Sin-Han, et al.
Published: (2025)
by: Yang, Sin-Han, et al.
Published: (2025)
Branching Strategies Based on Subgraph GNNs: A Study on Theoretical Promise versus Practical Reality
by: Zhou, Junru, et al.
Published: (2025)
by: Zhou, Junru, et al.
Published: (2025)
Horizon Activation Mapping for Neural Networks in Time Series Forecasting
by: Hans, Krupakar, et al.
Published: (2026)
by: Hans, Krupakar, et al.
Published: (2026)
Controlled Learning of Pointwise Nonlinearities in Neural-Network-Like Architectures
by: Unser, Michael, et al.
Published: (2024)
by: Unser, Michael, et al.
Published: (2024)
Learning Graph Node Embeddings by Smooth Pair Sampling
by: Kutzkov, Konstantin
Published: (2025)
by: Kutzkov, Konstantin
Published: (2025)
Graph-Instructed Neural Networks for parametric problems with varying boundary conditions
by: Della Santa, Francesco, et al.
Published: (2026)
by: Della Santa, Francesco, et al.
Published: (2026)
Convergence Analysis of Max-Min Exponential Neural Network Operators in Orlicz Space
by: Pradhan, Satyaranjan, et al.
Published: (2025)
by: Pradhan, Satyaranjan, et al.
Published: (2025)
Over-squashing in Spatiotemporal Graph Neural Networks
by: Marisca, Ivan, et al.
Published: (2025)
by: Marisca, Ivan, et al.
Published: (2025)
Quantitative Analysis of Molecular Transport in the Extracellular Space Using Physics-Informed Neural Network
by: Xie, Jiayi, et al.
Published: (2024)
by: Xie, Jiayi, et al.
Published: (2024)
Similar Items
-
Approximation analysis of CNNs from a feature extraction view
by: Li, Jianfei, et al.
Published: (2022) -
Sparse-Aware Neural Networks for Nonlinear Functionals: Mitigating the Exponential Dependence on Dimension
by: Li, Jianfei, et al.
Published: (2026) -
Deeper Insights into Deep Graph Convolutional Networks: Stability and Generalization
by: Yang, Guangrui, et al.
Published: (2024) -
Rank Collapse Causes Over-Smoothing and Over-Correlation in Graph Neural Networks
by: Roth, Andreas, et al.
Published: (2023) -
Prompting a Pretrained Transformer Can Be a Universal Approximator
by: Petrov, Aleksandar, et al.
Published: (2024)