Conversational Assistants to support Heart Failure Patients: comparing a Neurosymbolic Architecture with ChatGPT
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866910918231719936 |
|---|---|
| author | Tayal, Anuja Salunke, Devika Di Eugenio, Barbara Allen-Meares, Paula Abril, Eulalia Puig Garcia, Olga Dickens, Carolyn Boyd, Andrew |
| author_facet | Tayal, Anuja Salunke, Devika Di Eugenio, Barbara Allen-Meares, Paula Abril, Eulalia Puig Garcia, Olga Dickens, Carolyn Boyd, Andrew |
| contents | Conversational assistants are becoming more and more popular, including in healthcare, partly because of the availability and capabilities of Large Language Models. There is a need for controlled, probing evaluations with real stakeholders which can highlight advantages and disadvantages of more traditional architectures and those based on generative AI. We present a within-group user study to compare two versions of a conversational assistant that allows heart failure patients to ask about salt content in food. One version of the system was developed in-house with a neurosymbolic architecture, and one is based on ChatGPT. The evaluation shows that the in-house system is more accurate, completes more tasks and is less verbose than the one based on ChatGPT; on the other hand, the one based on ChatGPT makes fewer speech errors and requires fewer clarifications to complete the task. Patients show no preference for one over the other. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_17753 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Conversational Assistants to support Heart Failure Patients: comparing a Neurosymbolic Architecture with ChatGPT Tayal, Anuja Salunke, Devika Di Eugenio, Barbara Allen-Meares, Paula Abril, Eulalia Puig Garcia, Olga Dickens, Carolyn Boyd, Andrew Computation and Language Conversational assistants are becoming more and more popular, including in healthcare, partly because of the availability and capabilities of Large Language Models. There is a need for controlled, probing evaluations with real stakeholders which can highlight advantages and disadvantages of more traditional architectures and those based on generative AI. We present a within-group user study to compare two versions of a conversational assistant that allows heart failure patients to ask about salt content in food. One version of the system was developed in-house with a neurosymbolic architecture, and one is based on ChatGPT. The evaluation shows that the in-house system is more accurate, completes more tasks and is less verbose than the one based on ChatGPT; on the other hand, the one based on ChatGPT makes fewer speech errors and requires fewer clarifications to complete the task. Patients show no preference for one over the other. |
| title | Conversational Assistants to support Heart Failure Patients: comparing a Neurosymbolic Architecture with ChatGPT |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2504.17753 |