First-order PDES for Graph Neural Networks: Advection And Burgers Equation Models
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866913298499239936 |
|---|---|
| author | Qu, Yifan Krzysik, Oliver De Sterck, Hans Kara, Omer Ege |
| author_facet | Qu, Yifan Krzysik, Oliver De Sterck, Hans Kara, Omer Ege |
| contents | Graph Neural Networks (GNNs) have established themselves as the preferred methodology in a multitude of domains, ranging from computer vision to computational biology, especially in contexts where data inherently conform to graph structures. While many existing methods have endeavored to model GNNs using various techniques, a prevalent challenge they grapple with is the issue of over-smoothing. This paper presents new Graph Neural Network models that incorporate two first-order Partial Differential Equations (PDEs). These models do not increase complexity but effectively mitigate the over-smoothing problem. Our experimental findings highlight the capacity of our new PDE model to achieve comparable results with higher-order PDE models and fix the over-smoothing problem up to 64 layers. These results underscore the adaptability and versatility of GNNs, indicating that unconventional approaches can yield outcomes on par with established techniques. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_03081 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | First-order PDES for Graph Neural Networks: Advection And Burgers Equation Models Qu, Yifan Krzysik, Oliver De Sterck, Hans Kara, Omer Ege Machine Learning Numerical Analysis Graph Neural Networks (GNNs) have established themselves as the preferred methodology in a multitude of domains, ranging from computer vision to computational biology, especially in contexts where data inherently conform to graph structures. While many existing methods have endeavored to model GNNs using various techniques, a prevalent challenge they grapple with is the issue of over-smoothing. This paper presents new Graph Neural Network models that incorporate two first-order Partial Differential Equations (PDEs). These models do not increase complexity but effectively mitigate the over-smoothing problem. Our experimental findings highlight the capacity of our new PDE model to achieve comparable results with higher-order PDE models and fix the over-smoothing problem up to 64 layers. These results underscore the adaptability and versatility of GNNs, indicating that unconventional approaches can yield outcomes on par with established techniques. |
| title | First-order PDES for Graph Neural Networks: Advection And Burgers Equation Models |
| topic | Machine Learning Numerical Analysis |
| url | https://arxiv.org/abs/2404.03081 |