GeneAgent: Self-verification Language Agent for Gene Set Knowledge Discovery using Domain Databases
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866916259785867264 |
|---|---|
| author | Wang, Zhizheng Jin, Qiao Wei, Chih-Hsuan Tian, Shubo Lai, Po-Ting Zhu, Qingqing Day, Chi-Ping Ross, Christina Lu, Zhiyong |
| author_facet | Wang, Zhizheng Jin, Qiao Wei, Chih-Hsuan Tian, Shubo Lai, Po-Ting Zhu, Qingqing Day, Chi-Ping Ross, Christina Lu, Zhiyong |
| contents | Gene set knowledge discovery is essential for advancing human functional genomics. Recent studies have shown promising performance by harnessing the power of Large Language Models (LLMs) on this task. Nonetheless, their results are subject to several limitations common in LLMs such as hallucinations. In response, we present GeneAgent, a first-of-its-kind language agent featuring self-verification capability. It autonomously interacts with various biological databases and leverages relevant domain knowledge to improve accuracy and reduce hallucination occurrences. Benchmarking on 1,106 gene sets from different sources, GeneAgent consistently outperforms standard GPT-4 by a significant margin. Moreover, a detailed manual review confirms the effectiveness of the self-verification module in minimizing hallucinations and generating more reliable analytical narratives. To demonstrate its practical utility, we apply GeneAgent to seven novel gene sets derived from mouse B2905 melanoma cell lines, with expert evaluations showing that GeneAgent offers novel insights into gene functions and subsequently expedites knowledge discovery. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_16205 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | GeneAgent: Self-verification Language Agent for Gene Set Knowledge Discovery using Domain Databases Wang, Zhizheng Jin, Qiao Wei, Chih-Hsuan Tian, Shubo Lai, Po-Ting Zhu, Qingqing Day, Chi-Ping Ross, Christina Lu, Zhiyong Artificial Intelligence Computation and Language Gene set knowledge discovery is essential for advancing human functional genomics. Recent studies have shown promising performance by harnessing the power of Large Language Models (LLMs) on this task. Nonetheless, their results are subject to several limitations common in LLMs such as hallucinations. In response, we present GeneAgent, a first-of-its-kind language agent featuring self-verification capability. It autonomously interacts with various biological databases and leverages relevant domain knowledge to improve accuracy and reduce hallucination occurrences. Benchmarking on 1,106 gene sets from different sources, GeneAgent consistently outperforms standard GPT-4 by a significant margin. Moreover, a detailed manual review confirms the effectiveness of the self-verification module in minimizing hallucinations and generating more reliable analytical narratives. To demonstrate its practical utility, we apply GeneAgent to seven novel gene sets derived from mouse B2905 melanoma cell lines, with expert evaluations showing that GeneAgent offers novel insights into gene functions and subsequently expedites knowledge discovery. |
| title | GeneAgent: Self-verification Language Agent for Gene Set Knowledge Discovery using Domain Databases |
| topic | Artificial Intelligence Computation and Language |
| url | https://arxiv.org/abs/2405.16205 |