CogPic: A Multimodal Dataset for Early Cognitive Impairment Assessment via Picture Description Tasks
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915908834820096 |
|---|---|
| author | Wu, Liuyu Feng, Rui Li, Jie Xiang, Wentao Zhang, Yi Cao, Yin Song, Siyang Gu, Xiao Li, Jianqing Wang, Wei |
| author_facet | Wu, Liuyu Feng, Rui Li, Jie Xiang, Wentao Zhang, Yi Cao, Yin Song, Siyang Gu, Xiao Li, Jianqing Wang, Wei |
| contents | The automated evaluation of cognitive status utilizing multimedia technologies presents a promising frontier in early dementia diagnosis. However, the development of robust machine learning models for cognitive impairment detection is frequently hindered by the scarcity of large-scale, strictly synchronized, and clinically validated multimodal datasets. To bridge this critical gap, we introduce the CogPic database, a comprehensive multimodal benchmark meticulously designed for fine-grained cognitive impairment detection. The dataset comprises strictly synchronized audio, visual, and linguistic data continuously collected from 574 participants during a naturalistic picture description task. To establish highly reliable diagnostic ground truth, expert clinical neuropsychologists conducted exhaustive evaluations, stratifying participants into distinct cognitive groups through a comprehensive clinical consensus. Consequently, CogPic stands as the largest, most modality-rich, and most meticulously evaluated dataset of its kind to date. By conducting extensive benchmark experiments on the CogPic dataset, we establish an exceptionally robust, unbiased, and clinically generalizable foundation to propel future multimedia research in automated cognitive health assessment. Detailed information and access application procedures for our CogPic database are available at https://cogpic.github.io/. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_01626 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | CogPic: A Multimodal Dataset for Early Cognitive Impairment Assessment via Picture Description Tasks Wu, Liuyu Feng, Rui Li, Jie Xiang, Wentao Zhang, Yi Cao, Yin Song, Siyang Gu, Xiao Li, Jianqing Wang, Wei Databases The automated evaluation of cognitive status utilizing multimedia technologies presents a promising frontier in early dementia diagnosis. However, the development of robust machine learning models for cognitive impairment detection is frequently hindered by the scarcity of large-scale, strictly synchronized, and clinically validated multimodal datasets. To bridge this critical gap, we introduce the CogPic database, a comprehensive multimodal benchmark meticulously designed for fine-grained cognitive impairment detection. The dataset comprises strictly synchronized audio, visual, and linguistic data continuously collected from 574 participants during a naturalistic picture description task. To establish highly reliable diagnostic ground truth, expert clinical neuropsychologists conducted exhaustive evaluations, stratifying participants into distinct cognitive groups through a comprehensive clinical consensus. Consequently, CogPic stands as the largest, most modality-rich, and most meticulously evaluated dataset of its kind to date. By conducting extensive benchmark experiments on the CogPic dataset, we establish an exceptionally robust, unbiased, and clinically generalizable foundation to propel future multimedia research in automated cognitive health assessment. Detailed information and access application procedures for our CogPic database are available at https://cogpic.github.io/. |
| title | CogPic: A Multimodal Dataset for Early Cognitive Impairment Assessment via Picture Description Tasks |
| topic | Databases |
| url | https://arxiv.org/abs/2604.01626 |