ChatGPT Solving Complex Kidney Transplant Cases: A Comparative Study With Human Respondents
Fuente:
Wiley Open Access
Salvato in:
| Autori principali: | , , , , , , , , , , , , , |
|---|---|
| Natura: | Artículo Open Access |
| Pubblicazione: |
Wiley
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1867011539040468992 |
|---|---|
| author | Michal A. Mankowski Ian S. Jaffe Jingzhi Xu Sunjae Bae Eric K. Oermann Yindalon Aphinyanaphongs Mara A. McAdams‐DeMarco Bonnie E. Lonze Babak J. Orandi Darren Stewart Macey Levan Allan Massie Sommer Gentry Dorry L. Segev |
| author_facet | Michal A. Mankowski Ian S. Jaffe Jingzhi Xu Sunjae Bae Eric K. Oermann Yindalon Aphinyanaphongs Mara A. McAdams‐DeMarco Bonnie E. Lonze Babak J. Orandi Darren Stewart Macey Levan Allan Massie Sommer Gentry Dorry L. Segev Michal A. Mankowski Ian S. Jaffe Jingzhi Xu Sunjae Bae Eric K. Oermann Yindalon Aphinyanaphongs Mara A. McAdams‐DeMarco Bonnie E. Lonze Babak J. Orandi Darren Stewart Macey Levan Allan Massie Sommer Gentry Dorry L. Segev |
| collection | Wiley Open Access |
| contents | ChatGPT Solving Complex Kidney Transplant Cases: A Comparative Study With Human Respondents Michal A. Mankowski Ian S. Jaffe Jingzhi Xu Sunjae Bae Eric K. Oermann Yindalon Aphinyanaphongs Mara A. McAdams‐DeMarco Bonnie E. Lonze Babak J. Orandi Darren Stewart Macey Levan Allan Massie Sommer Gentry Dorry L. Segev Clinical Transplantation ABSTRACTIntroductionChatGPT has shown the ability to answer clinical questions in general medicine but may be constrained by the specialized nature of kidney transplantation. Thus, it is important to explore how ChatGPT can be used in kidney transplantation and how its knowledge compares to human respondents.MethodsWe prompted ChatGPT versions 3.5, 4, and 4 Visual (4 V) with 12 multiple‐choice questions related to six kidney transplant cases from 2013 to 2015 American Society of Nephrology (ASN) fellowship program quizzes. We compared the performance of ChatGPT with US nephrology fellowship program directors, nephrology fellows, and the audience of the ASN's annual Kidney Week meeting.ResultsOverall, ChatGPT 4 V correctly answered 10 out of 12 questions, showing a performance level comparable to nephrology fellows (group majority correctly answered 9 of 12 questions) and training program directors (11 of 12). This surpassed ChatGPT 4 (7 of 12 correct) and 3.5 (5 of 12). All three ChatGPT versions failed to correctly answer questions where the consensus among human respondents was low.ConclusionEach iterative version of ChatGPT performed better than the prior version, with version 4 V achieving performance on par with nephrology fellows and training program directors. While it shows promise in understanding and answering kidney transplantation questions, ChatGPT should be seen as a complementary tool to human expertise rather than a replacement. 10.1111/ctr.15466 http://onlinelibrary.wiley.com/termsAndConditions#vor |
| doi_str_mv | 10.1111/ctr.15466 |
| format | Artículo Open Access |
| id | wiley_oa_10_1111_ctr_15466 |
| institution | Wiley Open Access |
| license_str_mv | http://onlinelibrary.wiley.com/termsAndConditions#vor |
| publishDate | 2024 |
| publisher | Wiley |
| record_format | wiley_oa |
| spellingShingle | ChatGPT Solving Complex Kidney Transplant Cases: A Comparative Study With Human Respondents Michal A. Mankowski Ian S. Jaffe Jingzhi Xu Sunjae Bae Eric K. Oermann Yindalon Aphinyanaphongs Mara A. McAdams‐DeMarco Bonnie E. Lonze Babak J. Orandi Darren Stewart Macey Levan Allan Massie Sommer Gentry Dorry L. Segev Clinical Transplantation ChatGPT Solving Complex Kidney Transplant Cases: A Comparative Study With Human Respondents Michal A. Mankowski Ian S. Jaffe Jingzhi Xu Sunjae Bae Eric K. Oermann Yindalon Aphinyanaphongs Mara A. McAdams‐DeMarco Bonnie E. Lonze Babak J. Orandi Darren Stewart Macey Levan Allan Massie Sommer Gentry Dorry L. Segev Clinical Transplantation ABSTRACTIntroductionChatGPT has shown the ability to answer clinical questions in general medicine but may be constrained by the specialized nature of kidney transplantation. Thus, it is important to explore how ChatGPT can be used in kidney transplantation and how its knowledge compares to human respondents.MethodsWe prompted ChatGPT versions 3.5, 4, and 4 Visual (4 V) with 12 multiple‐choice questions related to six kidney transplant cases from 2013 to 2015 American Society of Nephrology (ASN) fellowship program quizzes. We compared the performance of ChatGPT with US nephrology fellowship program directors, nephrology fellows, and the audience of the ASN's annual Kidney Week meeting.ResultsOverall, ChatGPT 4 V correctly answered 10 out of 12 questions, showing a performance level comparable to nephrology fellows (group majority correctly answered 9 of 12 questions) and training program directors (11 of 12). This surpassed ChatGPT 4 (7 of 12 correct) and 3.5 (5 of 12). All three ChatGPT versions failed to correctly answer questions where the consensus among human respondents was low.ConclusionEach iterative version of ChatGPT performed better than the prior version, with version 4 V achieving performance on par with nephrology fellows and training program directors. While it shows promise in understanding and answering kidney transplantation questions, ChatGPT should be seen as a complementary tool to human expertise rather than a replacement. 10.1111/ctr.15466 http://onlinelibrary.wiley.com/termsAndConditions#vor |
| title | ChatGPT Solving Complex Kidney Transplant Cases: A Comparative Study With Human Respondents |
| topic | Clinical Transplantation |
| url | https://onlinelibrary.wiley.com/doi/10.1111/ctr.15466 |