Explainable cognitive decline detection in free dialogues with a Machine Learning approach based on pre-trained Large Language Models

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: de Arriba-Pérez, Francisco, García-Méndez, Silvia, Otero-Mosquera, Javier, González-Castaño, Francisco J.
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917828028792832
author de Arriba-Pérez, Francisco
García-Méndez, Silvia
Otero-Mosquera, Javier
González-Castaño, Francisco J.
author_facet de Arriba-Pérez, Francisco
García-Méndez, Silvia
Otero-Mosquera, Javier
González-Castaño, Francisco J.
contents Cognitive and neurological impairments are very common, but only a small proportion of affected individuals are diagnosed and treated, partly because of the high costs associated with frequent screening. Detecting pre-illness stages and analyzing the progression of neurological disorders through effective and efficient intelligent systems can be beneficial for timely diagnosis and early intervention. We propose using Large Language Models to extract features from free dialogues to detect cognitive decline. These features comprise high-level reasoning content-independent features (such as comprehension, decreased awareness, increased distraction, and memory problems). Our solution comprises (i) preprocessing, (ii) feature engineering via Natural Language Processing techniques and prompt engineering, (iii) feature analysis and selection to optimize performance, and (iv) classification, supported by automatic explainability. We also explore how to improve Chatgpt's direct cognitive impairment prediction capabilities using the best features in our models. Evaluation metrics obtained endorse the effectiveness of a mixed approach combining feature extraction with Chatgpt and a specialized Machine Learning model to detect cognitive decline within free-form conversational dialogues with older adults. Ultimately, our work may facilitate the development of an inexpensive, non-invasive, and rapid means of detecting and explaining cognitive decline.
format Preprint
id arxiv_https___arxiv_org_abs_2411_02036
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Explainable cognitive decline detection in free dialogues with a Machine Learning approach based on pre-trained Large Language Models
de Arriba-Pérez, Francisco
García-Méndez, Silvia
Otero-Mosquera, Javier
González-Castaño, Francisco J.
Computation and Language
Artificial Intelligence
Cognitive and neurological impairments are very common, but only a small proportion of affected individuals are diagnosed and treated, partly because of the high costs associated with frequent screening. Detecting pre-illness stages and analyzing the progression of neurological disorders through effective and efficient intelligent systems can be beneficial for timely diagnosis and early intervention. We propose using Large Language Models to extract features from free dialogues to detect cognitive decline. These features comprise high-level reasoning content-independent features (such as comprehension, decreased awareness, increased distraction, and memory problems). Our solution comprises (i) preprocessing, (ii) feature engineering via Natural Language Processing techniques and prompt engineering, (iii) feature analysis and selection to optimize performance, and (iv) classification, supported by automatic explainability. We also explore how to improve Chatgpt's direct cognitive impairment prediction capabilities using the best features in our models. Evaluation metrics obtained endorse the effectiveness of a mixed approach combining feature extraction with Chatgpt and a specialized Machine Learning model to detect cognitive decline within free-form conversational dialogues with older adults. Ultimately, our work may facilitate the development of an inexpensive, non-invasive, and rapid means of detecting and explaining cognitive decline.
title Explainable cognitive decline detection in free dialogues with a Machine Learning approach based on pre-trained Large Language Models
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2411.02036