Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2502.12777 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909694293966848 |
|---|---|
| author | Kalyani I, Bhargavi Mathi, A Rama Prasad Sett, Niladri |
| author_facet | Kalyani I, Bhargavi Mathi, A Rama Prasad Sett, Niladri |
| contents | Link prediction (LP) is an important problem in network science and machine learning research. The state-of-the-art LP methods are usually evaluated in a uniform setup, ignoring several factors associated with the data and application specific needs. We identify a number of such factors, such as, network-type, problem-type, geodesic distance between the end nodes and its distribution over the classes, nature and applicability of LP methods, class imbalance and its impact on early retrieval, evaluation metric, etc., and present an experimental setup which allows us to evaluate LP methods in a rigorous and controlled manner. We perform extensive experiments with a variety of LP methods over real network datasets in this controlled setup, and gather valuable insights on the interactions of these factors with the performance of LP through an array of carefully designed hypotheses. Following the insights, we provide recommendations to be followed as best practice for evaluating LP methods. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_12777 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Evaluating link prediction: New perspectives and recommendations Kalyani I, Bhargavi Mathi, A Rama Prasad Sett, Niladri Social and Information Networks Artificial Intelligence Link prediction (LP) is an important problem in network science and machine learning research. The state-of-the-art LP methods are usually evaluated in a uniform setup, ignoring several factors associated with the data and application specific needs. We identify a number of such factors, such as, network-type, problem-type, geodesic distance between the end nodes and its distribution over the classes, nature and applicability of LP methods, class imbalance and its impact on early retrieval, evaluation metric, etc., and present an experimental setup which allows us to evaluate LP methods in a rigorous and controlled manner. We perform extensive experiments with a variety of LP methods over real network datasets in this controlled setup, and gather valuable insights on the interactions of these factors with the performance of LP through an array of carefully designed hypotheses. Following the insights, we provide recommendations to be followed as best practice for evaluating LP methods. |
| title | Evaluating link prediction: New perspectives and recommendations |
| topic | Social and Information Networks Artificial Intelligence |
| url | https://arxiv.org/abs/2502.12777 |