Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2410.09708 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910912902856704 |
|---|---|
| author | Yang, Jielong Ding, Rui Ji, Feng Wang, Hongbin Xie, Linbo |
| author_facet | Yang, Jielong Ding, Rui Ji, Feng Wang, Hongbin Xie, Linbo |
| contents | The performance of graph neural networks (GNNs) is susceptible to discrepancies between training and testing sample distributions. Prior studies have attempted to mitigating the impact of distribution shift by reconstructing node features during the testing phase without modifying the model parameters. However, these approaches lack theoretical analysis of the proximity between predictions and ground truth at test time. In this paper, we propose a novel node feature reconstruction method grounded in Lyapunov stability theory. Specifically, we model the GNN as a control system during the testing phase, considering node features as control variables. A neural controller that adheres to the Lyapunov stability criterion is then employed to reconstruct these node features, ensuring that the predictions progressively approach the ground truth at test time. We validate the effectiveness of our approach through extensive experiments across multiple datasets, demonstrating significant performance improvements. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_09708 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Control the GNN: Utilizing Neural Controller with Lyapunov Stability for Test-Time Feature Reconstruction Yang, Jielong Ding, Rui Ji, Feng Wang, Hongbin Xie, Linbo Machine Learning The performance of graph neural networks (GNNs) is susceptible to discrepancies between training and testing sample distributions. Prior studies have attempted to mitigating the impact of distribution shift by reconstructing node features during the testing phase without modifying the model parameters. However, these approaches lack theoretical analysis of the proximity between predictions and ground truth at test time. In this paper, we propose a novel node feature reconstruction method grounded in Lyapunov stability theory. Specifically, we model the GNN as a control system during the testing phase, considering node features as control variables. A neural controller that adheres to the Lyapunov stability criterion is then employed to reconstruct these node features, ensuring that the predictions progressively approach the ground truth at test time. We validate the effectiveness of our approach through extensive experiments across multiple datasets, demonstrating significant performance improvements. |
| title | Control the GNN: Utilizing Neural Controller with Lyapunov Stability for Test-Time Feature Reconstruction |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2410.09708 |