Higher-order Structure Boosts Link Prediction on Temporal Graphs

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Liu, Jingzhe, Hua, Zhigang, Xie, Yan, Li, Bingheng, Shomer, Harry, Song, Yu, Hassani, Kaveh, Tang, Jiliang
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913851281244160
author Liu, Jingzhe
Hua, Zhigang
Xie, Yan
Li, Bingheng
Shomer, Harry
Song, Yu
Hassani, Kaveh
Tang, Jiliang
author_facet Liu, Jingzhe
Hua, Zhigang
Xie, Yan
Li, Bingheng
Shomer, Harry
Song, Yu
Hassani, Kaveh
Tang, Jiliang
contents Temporal Graph Neural Networks (TGNNs) have gained growing attention for modeling and predicting structures in temporal graphs. However, existing TGNNs primarily focus on pairwise interactions while overlooking higher-order structures that are integral to link formation and evolution in real-world temporal graphs. Meanwhile, these models often suffer from efficiency bottlenecks, further limiting their expressive power. To tackle these challenges, we propose a Higher-order structure Temporal Graph Neural Network, which incorporates hypergraph representations into temporal graph learning. In particular, we develop an algorithm to identify the underlying higher-order structures, enhancing the model's ability to capture the group interactions. Furthermore, by aggregating multiple edge features into hyperedge representations, HTGN effectively reduces memory cost during training. We theoretically demonstrate the enhanced expressiveness of our approach and validate its effectiveness and efficiency through extensive experiments on various real-world temporal graphs. Experimental results show that HTGN achieves superior performance on dynamic link prediction while reducing memory costs by up to 50\% compared to existing methods.
format Preprint
id arxiv_https___arxiv_org_abs_2505_15746
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Higher-order Structure Boosts Link Prediction on Temporal Graphs
Liu, Jingzhe
Hua, Zhigang
Xie, Yan
Li, Bingheng
Shomer, Harry
Song, Yu
Hassani, Kaveh
Tang, Jiliang
Machine Learning
Artificial Intelligence
Temporal Graph Neural Networks (TGNNs) have gained growing attention for modeling and predicting structures in temporal graphs. However, existing TGNNs primarily focus on pairwise interactions while overlooking higher-order structures that are integral to link formation and evolution in real-world temporal graphs. Meanwhile, these models often suffer from efficiency bottlenecks, further limiting their expressive power. To tackle these challenges, we propose a Higher-order structure Temporal Graph Neural Network, which incorporates hypergraph representations into temporal graph learning. In particular, we develop an algorithm to identify the underlying higher-order structures, enhancing the model's ability to capture the group interactions. Furthermore, by aggregating multiple edge features into hyperedge representations, HTGN effectively reduces memory cost during training. We theoretically demonstrate the enhanced expressiveness of our approach and validate its effectiveness and efficiency through extensive experiments on various real-world temporal graphs. Experimental results show that HTGN achieves superior performance on dynamic link prediction while reducing memory costs by up to 50\% compared to existing methods.
title Higher-order Structure Boosts Link Prediction on Temporal Graphs
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2505.15746