Differential Mental Disorder Detection with Psychology-Inspired Multimodal Stimuli
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2026
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866918426338918400 |
|---|---|
| author | Zhou, Zhiyuan Wu, Jingjing Lei, Zhibo Guo, Junyu Yu, Zhongcheng Chu, Yuqi Zhang, Xiaowei Zhao, Qiqi Wang, Qi Hao, Shijie Guo, Yanrong Hong, Richang |
| author_facet | Zhou, Zhiyuan Wu, Jingjing Lei, Zhibo Guo, Junyu Yu, Zhongcheng Chu, Yuqi Zhang, Xiaowei Zhao, Qiqi Wang, Qi Hao, Shijie Guo, Yanrong Hong, Richang |
| contents | Differential diagnosis of mental disorders remains a fundamental challenge in real-world clinical practice, where multiple conditions often exhibit overlapping symptoms. However, most existing public datasets are developed under single-disorder settings and rely on limited data elicitation paradigms, restricting their ability to capture disorder-specific patterns. In this work, we investigate differential mental disorder detection through psychology-inspired multimodal stimuli, designed to elicit diverse emotional, cognitive, and behavioral responses grounded in findings from experimental psychology. Based on this paradigm, we collect a large-scale multimodal mental health dataset (MMH) covering depression, anxiety, and schizophrenia, with all diagnostic labels clinically verified by licensed psychiatrists. To effectively model the heterogeneous signals induced by diverse elicitation tasks, we further propose a paradigm-aware multimodal framework that leverages inter-disorder differences prior knowledge as prompt-guided semantic descriptions to capture task-specific affective and interaction contexts for multimodal representation learning in the new differential mental disorder detection task. Extensive experiments show that our framework consistently outperforms existing baselines, underscoring the value of psychology-inspired stimulus design for differential mental disorder detection. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_02798 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Differential Mental Disorder Detection with Psychology-Inspired Multimodal Stimuli Zhou, Zhiyuan Wu, Jingjing Lei, Zhibo Guo, Junyu Yu, Zhongcheng Chu, Yuqi Zhang, Xiaowei Zhao, Qiqi Wang, Qi Hao, Shijie Guo, Yanrong Hong, Richang Multimedia Differential diagnosis of mental disorders remains a fundamental challenge in real-world clinical practice, where multiple conditions often exhibit overlapping symptoms. However, most existing public datasets are developed under single-disorder settings and rely on limited data elicitation paradigms, restricting their ability to capture disorder-specific patterns. In this work, we investigate differential mental disorder detection through psychology-inspired multimodal stimuli, designed to elicit diverse emotional, cognitive, and behavioral responses grounded in findings from experimental psychology. Based on this paradigm, we collect a large-scale multimodal mental health dataset (MMH) covering depression, anxiety, and schizophrenia, with all diagnostic labels clinically verified by licensed psychiatrists. To effectively model the heterogeneous signals induced by diverse elicitation tasks, we further propose a paradigm-aware multimodal framework that leverages inter-disorder differences prior knowledge as prompt-guided semantic descriptions to capture task-specific affective and interaction contexts for multimodal representation learning in the new differential mental disorder detection task. Extensive experiments show that our framework consistently outperforms existing baselines, underscoring the value of psychology-inspired stimulus design for differential mental disorder detection. |
| title | Differential Mental Disorder Detection with Psychology-Inspired Multimodal Stimuli |
| topic | Multimedia |
| url | https://arxiv.org/abs/2604.02798 |