Back to the Basics: Rethinking Issue-Commit Linking with LLM-Assisted Retrieval
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866911193672712192 |
|---|---|
| author | Huang, Huihui Widyasari, Ratnadira Zhang, Ting Irsan, Ivana Clairine Shi, Jieke Ang, Han Wei Liauw, Frank Ouh, Eng Lieh Shar, Lwin Khin Kang, Hong Jin Lo, David |
| author_facet | Huang, Huihui Widyasari, Ratnadira Zhang, Ting Irsan, Ivana Clairine Shi, Jieke Ang, Han Wei Liauw, Frank Ouh, Eng Lieh Shar, Lwin Khin Kang, Hong Jin Lo, David |
| contents | Issue-commit linking, which connects issues with commits that fix them, is crucial for software maintenance. Existing approaches have shown promise in automatically recovering these links. Evaluations of these techniques assess their ability to identify genuine links from plausible but false links. However, these evaluations overlook the fact that, in reality, when a repository has more commits, the presence of more plausible yet unrelated commits may interfere with the tool in differentiating the correct fix commits. To address this, we propose the Realistic Distribution Setting (RDS) and use it to construct a more realistic evaluation dataset that includes 20 open-source projects. By evaluating tools on this dataset, we observe that the performance of the state-of-the-art deep learning-based approach drops by more than half, while the traditional Information Retrieval method, VSM, outperforms it. Inspired by these observations, we propose EasyLink, which utilizes a vector database as a modern Information Retrieval technique. To address the long-standing problem of the semantic gap between issues and commits, EasyLink leverages a large language model to rerank the commits retrieved from the database. Under our evaluation, EasyLink achieves an average Precision@1 of 75.03\%, improving over the state-of-the-art by over four times. Additionally, this paper provides practical guidelines for advancing research in issue-commit link recovery. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_09199 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Back to the Basics: Rethinking Issue-Commit Linking with LLM-Assisted Retrieval Huang, Huihui Widyasari, Ratnadira Zhang, Ting Irsan, Ivana Clairine Shi, Jieke Ang, Han Wei Liauw, Frank Ouh, Eng Lieh Shar, Lwin Khin Kang, Hong Jin Lo, David Software Engineering Issue-commit linking, which connects issues with commits that fix them, is crucial for software maintenance. Existing approaches have shown promise in automatically recovering these links. Evaluations of these techniques assess their ability to identify genuine links from plausible but false links. However, these evaluations overlook the fact that, in reality, when a repository has more commits, the presence of more plausible yet unrelated commits may interfere with the tool in differentiating the correct fix commits. To address this, we propose the Realistic Distribution Setting (RDS) and use it to construct a more realistic evaluation dataset that includes 20 open-source projects. By evaluating tools on this dataset, we observe that the performance of the state-of-the-art deep learning-based approach drops by more than half, while the traditional Information Retrieval method, VSM, outperforms it. Inspired by these observations, we propose EasyLink, which utilizes a vector database as a modern Information Retrieval technique. To address the long-standing problem of the semantic gap between issues and commits, EasyLink leverages a large language model to rerank the commits retrieved from the database. Under our evaluation, EasyLink achieves an average Precision@1 of 75.03\%, improving over the state-of-the-art by over four times. Additionally, this paper provides practical guidelines for advancing research in issue-commit link recovery. |
| title | Back to the Basics: Rethinking Issue-Commit Linking with LLM-Assisted Retrieval |
| topic | Software Engineering |
| url | https://arxiv.org/abs/2507.09199 |