Cover Image

Demystifying Oversmoothing in Attention-Based Graph Neural Networks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wu, Xinyi, Ajorlou, Amir, Wu, Zihui, Jadbabaie, Ali
Format:	Preprint
Published:	2023
Subjects:	Machine Learning Social and Information Networks
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Belief Samples Are All You Need For Social Learning
by: JafariNodeh, Mahyar, et al.
Published: (2024)

On the Role of Attention Masks and LayerNorm in Transformers
by: Wu, Xinyi, et al.
Published: (2024)

Stochastic Opinion Dynamics under Social Pressure in Arbitrary Networks
by: Tang, Jennifer, et al.
Published: (2023)

Demystifying Higher-Order Graph Neural Networks
by: Besta, Maciej, et al.
Published: (2024)

Mitigating Oversmoothing Through Reverse Process of GNNs for Heterophilic Graphs
by: Park, MoonJeong, et al.
Published: (2024)

Estimating True Beliefs in Opinion Dynamics with Social Pressure
by: Tang, Jennifer, et al.
Published: (2023)

Residual Connections and Normalization Can Provably Prevent Oversmoothing in GNNs
by: Scholkemper, Michael, et al.
Published: (2024)

Dynamic Graph with Similarity-Aware Attention Graph Neural Network for Recommender Systems
by: Senapati, Aadarsh, et al.
Published: (2026)

Self-Attention Empowered Graph Convolutional Network for Structure Learning and Node Embedding
by: Jiang, Mengying, et al.
Published: (2024)

Conditional Local Feature Encoding for Graph Neural Networks
by: Wang, Yongze, et al.
Published: (2024)

A Unified Graph Selective Prompt Learning for Graph Neural Networks
by: Jiang, Bo, et al.
Published: (2024)

GraphMU: Repairing Robustness of Graph Neural Networks via Machine Unlearning
by: Wu, Tao, et al.
Published: (2024)

Understanding the Robustness of Graph Neural Networks against Adversarial Attacks
by: Wu, Tao, et al.
Published: (2024)

Heterophily-Aware Graph Attention Network
by: Wang, Junfu, et al.
Published: (2023)

A Framework Based on Graph Cellular Automata for Similarity Evaluation in Urban Spatial Networks
by: Wu, Peiru, et al.
Published: (2025)

GISExplainer: On Explainability of Graph Neural Networks via Game-theoretic Interaction Subgraphs
by: Xian, Xingping, et al.
Published: (2024)

Incorporating Heterophily into Graph Neural Networks for Graph Classification
by: Yang, Jiayi, et al.
Published: (2022)

Forward Learning of Graph Neural Networks
by: Park, Namyong, et al.
Published: (2024)

Graph Neural Networks with Diverse Spectral Filtering
by: Guo, Jingwei, et al.
Published: (2023)

Disambiguated Node Classification with Graph Neural Networks
by: Zhao, Tianxiang, et al.
Published: (2024)

Heterogeneous Graph Neural Network on Semantic Tree
by: Guan, Mingyu, et al.
Published: (2024)

Feature Selection and Extraction for Graph Neural Networks
by: Acharya, Deepak Bhaskar, et al.
Published: (2019)

Heterophilous Distribution Propagation for Graph Neural Networks
by: Zheng, Zhuonan, et al.
Published: (2024)

Peer Disambiguation in Self-Reported Surveys using Graph Attention Networks
by: Srivastava, Ajitesh, et al.
Published: (2025)

What Is Missing In Homophily? Disentangling Graph Homophily For Graph Neural Networks
by: Zheng, Yilun, et al.
Published: (2024)

Towards Lightweight Graph Neural Network Search with Curriculum Graph Sparsification
by: Xie, Beini, et al.
Published: (2024)

Graph Neural Network Generalization with Gaussian Mixture Model Based Augmentation
by: Abbahaddou, Yassine, et al.
Published: (2024)

The Expressive Power of Graph Neural Networks: A Survey
by: Zhang, Bingxu, et al.
Published: (2023)

Manufacturing Service Capability Prediction with Graph Neural Networks
by: Li, Yunqing, et al.
Published: (2024)

Revisiting the Message Passing in Heterophilous Graph Neural Networks
by: Zheng, Zhuonan, et al.
Published: (2024)

Link Prediction with Physics-Inspired Graph Neural Networks
by: Di Francesco, Andrea Giuseppe, et al.
Published: (2024)

Using Time-Aware Graph Neural Networks to Predict Temporal Centralities in Dynamic Graphs
by: Heeg, Franziska, et al.
Published: (2023)

Graph Neural Networks can Recover the Hidden Features Solely from the Graph Structure
by: Sato, Ryoma
Published: (2023)

HetCAN: A Heterogeneous Graph Cascade Attention Network with Dual-Level Awareness
by: Zhao, Zeyuan, et al.
Published: (2023)

Transferability of Graph Neural Networks using Graphon and Sampling Theories
by: Neuman, A. Martina, et al.
Published: (2023)

Interactive Event Sifting using Bayesian Graph Neural Networks
by: Nascimento, José, et al.
Published: (2024)

GRAPHGINI: Fostering Individual and Group Fairness in Graph Neural Networks
by: Sirohi, Anuj Kumar, et al.
Published: (2024)

A Graph Neural Network deep-dive into successful counterattacks
by: Bekkers, Joris, et al.
Published: (2024)

PropEnc: A Property Encoder for Graph Neural Networks
by: Said, Anwar, et al.
Published: (2024)

How Universal Polynomial Bases Enhance Spectral Graph Neural Networks: Heterophily, Over-smoothing, and Over-squashing
by: Huang, Keke, et al.
Published: (2024)