Survey and Improvement Strategies for Gene Prioritization with Large Language Models
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917907302187008 |
|---|---|
| author | Neeley, Matthew Qi, Guantong Wang, Guanchu Tang, Ruixiang Mao, Dongxue Liu, Chaozhong Pasupuleti, Sasidhar Yuan, Bo Xia, Fan Liu, Pengfei Liu, Zhandong Hu, Xia |
| author_facet | Neeley, Matthew Qi, Guantong Wang, Guanchu Tang, Ruixiang Mao, Dongxue Liu, Chaozhong Pasupuleti, Sasidhar Yuan, Bo Xia, Fan Liu, Pengfei Liu, Zhandong Hu, Xia |
| contents | Rare diseases are challenging to diagnose due to limited patient data and genetic diversity. Despite advances in variant prioritization, many cases remain undiagnosed. While large language models (LLMs) have performed well in medical exams, their effectiveness in diagnosing rare genetic diseases has not been assessed. To identify causal genes, we benchmarked various LLMs for gene prioritization. Using multi-agent and Human Phenotype Ontology (HPO) classification, we categorized patients based on phenotypes and solvability levels. As gene set size increased, LLM performance deteriorated, so we used a divide-and-conquer strategy to break the task into smaller subsets. At baseline, GPT-4 outperformed other LLMs, achieving near 30% accuracy in ranking causal genes correctly. The multi-agent and HPO approaches helped distinguish confidently solved cases from challenging ones, highlighting the importance of known gene-phenotype associations and phenotype specificity. We found that cases with specific phenotypes or clear associations were more accurately solved. However, we observed biases toward well-studied genes and input order sensitivity, which hindered gene prioritization. Our divide-and-conquer strategy improved accuracy by overcoming these biases. By utilizing HPO classification, novel multi-agent techniques, and our LLM strategy, we improved causal gene identification accuracy compared to our baseline evaluation. This approach streamlines rare disease diagnosis, facilitates reanalysis of unsolved cases, and accelerates gene discovery, supporting the development of targeted diagnostics and therapies. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_18794 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Survey and Improvement Strategies for Gene Prioritization with Large Language Models Neeley, Matthew Qi, Guantong Wang, Guanchu Tang, Ruixiang Mao, Dongxue Liu, Chaozhong Pasupuleti, Sasidhar Yuan, Bo Xia, Fan Liu, Pengfei Liu, Zhandong Hu, Xia Genomics Artificial Intelligence Rare diseases are challenging to diagnose due to limited patient data and genetic diversity. Despite advances in variant prioritization, many cases remain undiagnosed. While large language models (LLMs) have performed well in medical exams, their effectiveness in diagnosing rare genetic diseases has not been assessed. To identify causal genes, we benchmarked various LLMs for gene prioritization. Using multi-agent and Human Phenotype Ontology (HPO) classification, we categorized patients based on phenotypes and solvability levels. As gene set size increased, LLM performance deteriorated, so we used a divide-and-conquer strategy to break the task into smaller subsets. At baseline, GPT-4 outperformed other LLMs, achieving near 30% accuracy in ranking causal genes correctly. The multi-agent and HPO approaches helped distinguish confidently solved cases from challenging ones, highlighting the importance of known gene-phenotype associations and phenotype specificity. We found that cases with specific phenotypes or clear associations were more accurately solved. However, we observed biases toward well-studied genes and input order sensitivity, which hindered gene prioritization. Our divide-and-conquer strategy improved accuracy by overcoming these biases. By utilizing HPO classification, novel multi-agent techniques, and our LLM strategy, we improved causal gene identification accuracy compared to our baseline evaluation. This approach streamlines rare disease diagnosis, facilitates reanalysis of unsolved cases, and accelerates gene discovery, supporting the development of targeted diagnostics and therapies. |
| title | Survey and Improvement Strategies for Gene Prioritization with Large Language Models |
| topic | Genomics Artificial Intelligence |
| url | https://arxiv.org/abs/2501.18794 |