PANDA: Expanded Width-Aware Message Passing Beyond Rewiring
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866911963219492864 |
|---|---|
| author | Choi, Jeongwhan Park, Sumin Wi, Hyowon Cho, Sung-Bae Park, Noseong |
| author_facet | Choi, Jeongwhan Park, Sumin Wi, Hyowon Cho, Sung-Bae Park, Noseong |
| contents | Recent research in the field of graph neural network (GNN) has identified a critical issue known as "over-squashing," resulting from the bottleneck phenomenon in graph structures, which impedes the propagation of long-range information. Prior works have proposed a variety of graph rewiring concepts that aim at optimizing the spatial or spectral properties of graphs to promote the signal propagation. However, such approaches inevitably deteriorate the original graph topology, which may lead to a distortion of information flow. To address this, we introduce an expanded width-aware (PANDA) message passing, a new message passing paradigm where nodes with high centrality, a potential source of over-squashing, are selectively expanded in width to encapsulate the growing influx of signals from distant nodes. Experimental results show that our method outperforms existing rewiring methods, suggesting that selectively expanding the hidden state of nodes can be a compelling alternative to graph rewiring for addressing the over-squashing. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_03671 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | PANDA: Expanded Width-Aware Message Passing Beyond Rewiring Choi, Jeongwhan Park, Sumin Wi, Hyowon Cho, Sung-Bae Park, Noseong Machine Learning Artificial Intelligence Recent research in the field of graph neural network (GNN) has identified a critical issue known as "over-squashing," resulting from the bottleneck phenomenon in graph structures, which impedes the propagation of long-range information. Prior works have proposed a variety of graph rewiring concepts that aim at optimizing the spatial or spectral properties of graphs to promote the signal propagation. However, such approaches inevitably deteriorate the original graph topology, which may lead to a distortion of information flow. To address this, we introduce an expanded width-aware (PANDA) message passing, a new message passing paradigm where nodes with high centrality, a potential source of over-squashing, are selectively expanded in width to encapsulate the growing influx of signals from distant nodes. Experimental results show that our method outperforms existing rewiring methods, suggesting that selectively expanding the hidden state of nodes can be a compelling alternative to graph rewiring for addressing the over-squashing. |
| title | PANDA: Expanded Width-Aware Message Passing Beyond Rewiring |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2406.03671 |