Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2507.16947 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909701472518144 |
|---|---|
| author | Korom, Robert Kiptinness, Sarah Adan, Najib Said, Kassim Ithuli, Catherine Rotich, Oliver Kimani, Boniface King'ori, Irene Kamau, Stellah Atemba, Elizabeth Aden, Muna Bowman, Preston Sharman, Michael Hicks, Rebecca Soskin Distler, Rebecca Heidecke, Johannes Arora, Rahul K. Singhal, Karan |
| author_facet | Korom, Robert Kiptinness, Sarah Adan, Najib Said, Kassim Ithuli, Catherine Rotich, Oliver Kimani, Boniface King'ori, Irene Kamau, Stellah Atemba, Elizabeth Aden, Muna Bowman, Preston Sharman, Michael Hicks, Rebecca Soskin Distler, Rebecca Heidecke, Johannes Arora, Rahul K. Singhal, Karan |
| contents | We evaluate the impact of large language model-based clinical decision support in live care. In partnership with Penda Health, a network of primary care clinics in Nairobi, Kenya, we studied AI Consult, a tool that serves as a safety net for clinicians by identifying potential documentation and clinical decision-making errors. AI Consult integrates into clinician workflows, activating only when needed and preserving clinician autonomy. We conducted a quality improvement study, comparing outcomes for 39,849 patient visits performed by clinicians with or without access to AI Consult across 15 clinics. Visits were rated by independent physicians to identify clinical errors. Clinicians with access to AI Consult made relatively fewer errors: 16% fewer diagnostic errors and 13% fewer treatment errors. In absolute terms, the introduction of AI Consult would avert diagnostic errors in 22,000 visits and treatment errors in 29,000 visits annually at Penda alone. In a survey of clinicians with AI Consult, all clinicians said that AI Consult improved the quality of care they delivered, with 75% saying the effect was "substantial". These results required a clinical workflow-aligned AI Consult implementation and active deployment to encourage clinician uptake. We hope this study demonstrates the potential for LLM-based clinical decision support tools to reduce errors in real-world settings and provides a practical framework for advancing responsible adoption. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_16947 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | AI-based Clinical Decision Support for Primary Care: A Real-World Study Korom, Robert Kiptinness, Sarah Adan, Najib Said, Kassim Ithuli, Catherine Rotich, Oliver Kimani, Boniface King'ori, Irene Kamau, Stellah Atemba, Elizabeth Aden, Muna Bowman, Preston Sharman, Michael Hicks, Rebecca Soskin Distler, Rebecca Heidecke, Johannes Arora, Rahul K. Singhal, Karan Computation and Language We evaluate the impact of large language model-based clinical decision support in live care. In partnership with Penda Health, a network of primary care clinics in Nairobi, Kenya, we studied AI Consult, a tool that serves as a safety net for clinicians by identifying potential documentation and clinical decision-making errors. AI Consult integrates into clinician workflows, activating only when needed and preserving clinician autonomy. We conducted a quality improvement study, comparing outcomes for 39,849 patient visits performed by clinicians with or without access to AI Consult across 15 clinics. Visits were rated by independent physicians to identify clinical errors. Clinicians with access to AI Consult made relatively fewer errors: 16% fewer diagnostic errors and 13% fewer treatment errors. In absolute terms, the introduction of AI Consult would avert diagnostic errors in 22,000 visits and treatment errors in 29,000 visits annually at Penda alone. In a survey of clinicians with AI Consult, all clinicians said that AI Consult improved the quality of care they delivered, with 75% saying the effect was "substantial". These results required a clinical workflow-aligned AI Consult implementation and active deployment to encourage clinician uptake. We hope this study demonstrates the potential for LLM-based clinical decision support tools to reduce errors in real-world settings and provides a practical framework for advancing responsible adoption. |
| title | AI-based Clinical Decision Support for Primary Care: A Real-World Study |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2507.16947 |