OCN: Effectively Utilizing Higher-Order Common Neighbors for Better Link Prediction

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Juntong, Wang, Xiyuan, Zhang, Muhan
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910045479895040
author Wang, Juntong
Wang, Xiyuan
Zhang, Muhan
author_facet Wang, Juntong
Wang, Xiyuan
Zhang, Muhan
contents Common Neighbors (CNs) and their higher-order variants are important pairwise features widely used in state-of-the-art link prediction methods. However, existing methods often struggle with the repetition across different orders of CNs and fail to fully leverage their potential. We identify that these limitations stem from two key issues: redundancy and over-smoothing in high-order common neighbors. To address these challenges, we design orthogonalization to eliminate redundancy between different-order CNs and normalization to mitigate over-smoothing. By combining these two techniques, we propose Orthogonal Common Neighbor (OCN), a novel approach that significantly outperforms the strongest baselines by an average of 7.7\% on popular link prediction benchmarks. A thorough theoretical analysis is provided to support our method. Ablation studies also verify the effectiveness of our orthogonalization and normalization techniques. Code is available at: https://github.com/qingpingmo/OCN.
format Preprint
id arxiv_https___arxiv_org_abs_2505_19719
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle OCN: Effectively Utilizing Higher-Order Common Neighbors for Better Link Prediction
Wang, Juntong
Wang, Xiyuan
Zhang, Muhan
Machine Learning
Artificial Intelligence
Common Neighbors (CNs) and their higher-order variants are important pairwise features widely used in state-of-the-art link prediction methods. However, existing methods often struggle with the repetition across different orders of CNs and fail to fully leverage their potential. We identify that these limitations stem from two key issues: redundancy and over-smoothing in high-order common neighbors. To address these challenges, we design orthogonalization to eliminate redundancy between different-order CNs and normalization to mitigate over-smoothing. By combining these two techniques, we propose Orthogonal Common Neighbor (OCN), a novel approach that significantly outperforms the strongest baselines by an average of 7.7\% on popular link prediction benchmarks. A thorough theoretical analysis is provided to support our method. Ablation studies also verify the effectiveness of our orthogonalization and normalization techniques. Code is available at: https://github.com/qingpingmo/OCN.
title OCN: Effectively Utilizing Higher-Order Common Neighbors for Better Link Prediction
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2505.19719