Graph Rewiring in GNNs to Mitigate Over-Squashing and Over-Smoothing: A Survey

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Attali, Hugo, Buscaldi, Davide, Pernelle, Nathalie, Malliaros, Fragkiskos D.
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910181632245760
author Attali, Hugo
Buscaldi, Davide
Pernelle, Nathalie
Malliaros, Fragkiskos D.
author_facet Attali, Hugo
Buscaldi, Davide
Pernelle, Nathalie
Malliaros, Fragkiskos D.
contents Graph Neural Networks are powerful models for learning from graph-structured data, yet their effectiveness is often limited by two critical challenges: over-squashing, where information from distant nodes is excessively compressed, and over-smoothing, where repeated propagation makes node representations indistinguishable. Both phenomena stem from the interaction between message passing and the input topology, ultimately degrading information flow and limiting the performance of GNNs. In this survey, we examine graph rewiring techniques, a class of methods designed to modify the graph topology to enhance information propagation in GNNs. We provide a comprehensive review of state-of-the-art rewiring approaches, delving into their theoretical underpinnings, practical implementations, and performance trade-offs.
format Preprint
id arxiv_https___arxiv_org_abs_2411_17429
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Graph Rewiring in GNNs to Mitigate Over-Squashing and Over-Smoothing: A Survey
Attali, Hugo
Buscaldi, Davide
Pernelle, Nathalie
Malliaros, Fragkiskos D.
Machine Learning
Artificial Intelligence
Graph Neural Networks are powerful models for learning from graph-structured data, yet their effectiveness is often limited by two critical challenges: over-squashing, where information from distant nodes is excessively compressed, and over-smoothing, where repeated propagation makes node representations indistinguishable. Both phenomena stem from the interaction between message passing and the input topology, ultimately degrading information flow and limiting the performance of GNNs. In this survey, we examine graph rewiring techniques, a class of methods designed to modify the graph topology to enhance information propagation in GNNs. We provide a comprehensive review of state-of-the-art rewiring approaches, delving into their theoretical underpinnings, practical implementations, and performance trade-offs.
title Graph Rewiring in GNNs to Mitigate Over-Squashing and Over-Smoothing: A Survey
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2411.17429