Feasibility of Detecting Cognitive Impairment and Psychological Well-being among Older Adults Using Facial, Acoustic, Linguistic, and Cardiovascular Patterns Derived from Remote Conversations

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Mu, Xiaofan, Bibars, Merna, Seyedi, Salman, Zheng, Iris, Jiang, Zifan, Chen, Liu, Omofojoye, Bolaji, Hershenberg, Rachel, Levey, Allan I., Clifford, Gari D., Dodge, Hiroko H., Kwon, Hyeokhyen
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917068188680192
author Mu, Xiaofan
Bibars, Merna
Seyedi, Salman
Zheng, Iris
Jiang, Zifan
Chen, Liu
Omofojoye, Bolaji
Hershenberg, Rachel
Levey, Allan I.
Clifford, Gari D.
Dodge, Hiroko H.
Kwon, Hyeokhyen
author_facet Mu, Xiaofan
Bibars, Merna
Seyedi, Salman
Zheng, Iris
Jiang, Zifan
Chen, Liu
Omofojoye, Bolaji
Hershenberg, Rachel
Levey, Allan I.
Clifford, Gari D.
Dodge, Hiroko H.
Kwon, Hyeokhyen
contents The aging society urgently requires scalable methods to monitor cognitive decline and identify social and psychological factors indicative of dementia risk in older adults. Our machine learning (ML) models captured facial, acoustic, linguistic, and cardiovascular features from 39 older adults with normal cognition or Mild Cognitive Impairment (MCI), derived from remote video conversations and quantified their cognitive status, social isolation, neuroticism, and psychological well-being. Our model could distinguish Clinical Dementia Rating Scale (CDR) of 0.5 (vs. 0) with 0.77 area under the receiver operating characteristic curve (AUC), social isolation with 0.74 AUC, social satisfaction with 0.75 AUC, psychological well-being with 0.72 AUC, and negative affect with 0.74 AUC. Our feature importance analysis showed that speech and language patterns were useful for quantifying cognitive impairment, whereas facial expressions and cardiovascular patterns were useful for quantifying social and psychological well-being. Our bias analysis showed that the best-performing models for quantifying psychological well-being and cognitive states in older adults exhibited significant biases concerning their age, sex, disease condition, and education levels. Our comprehensive analysis shows the feasibility of monitoring the cognitive and psychological health of older adults, as well as the need for collecting largescale interview datasets of older adults to benefit from the latest advances in deep learning technologies to develop generalizable models across older adults with diverse demographic backgrounds and disease conditions.
format Preprint
id arxiv_https___arxiv_org_abs_2412_14194
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Feasibility of Detecting Cognitive Impairment and Psychological Well-being among Older Adults Using Facial, Acoustic, Linguistic, and Cardiovascular Patterns Derived from Remote Conversations
Mu, Xiaofan
Bibars, Merna
Seyedi, Salman
Zheng, Iris
Jiang, Zifan
Chen, Liu
Omofojoye, Bolaji
Hershenberg, Rachel
Levey, Allan I.
Clifford, Gari D.
Dodge, Hiroko H.
Kwon, Hyeokhyen
Human-Computer Interaction
Artificial Intelligence
The aging society urgently requires scalable methods to monitor cognitive decline and identify social and psychological factors indicative of dementia risk in older adults. Our machine learning (ML) models captured facial, acoustic, linguistic, and cardiovascular features from 39 older adults with normal cognition or Mild Cognitive Impairment (MCI), derived from remote video conversations and quantified their cognitive status, social isolation, neuroticism, and psychological well-being. Our model could distinguish Clinical Dementia Rating Scale (CDR) of 0.5 (vs. 0) with 0.77 area under the receiver operating characteristic curve (AUC), social isolation with 0.74 AUC, social satisfaction with 0.75 AUC, psychological well-being with 0.72 AUC, and negative affect with 0.74 AUC. Our feature importance analysis showed that speech and language patterns were useful for quantifying cognitive impairment, whereas facial expressions and cardiovascular patterns were useful for quantifying social and psychological well-being. Our bias analysis showed that the best-performing models for quantifying psychological well-being and cognitive states in older adults exhibited significant biases concerning their age, sex, disease condition, and education levels. Our comprehensive analysis shows the feasibility of monitoring the cognitive and psychological health of older adults, as well as the need for collecting largescale interview datasets of older adults to benefit from the latest advances in deep learning technologies to develop generalizable models across older adults with diverse demographic backgrounds and disease conditions.
title Feasibility of Detecting Cognitive Impairment and Psychological Well-being among Older Adults Using Facial, Acoustic, Linguistic, and Cardiovascular Patterns Derived from Remote Conversations
topic Human-Computer Interaction
Artificial Intelligence
url https://arxiv.org/abs/2412.14194