Saved in:
Bibliographic Details
Main Authors: Liu, Yin-Long, Li, Yuanchao, Feng, Rui, He, Liu, Chen, Jia-Xin, Wang, Yi-Ming, Chen, Yu-Ang, Peng, Yan-Han, Yuan, Jia-Hong, Ling, Zhen-Hua
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2505.19446
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908380496396288
author Liu, Yin-Long
Li, Yuanchao
Feng, Rui
He, Liu
Chen, Jia-Xin
Wang, Yi-Ming
Chen, Yu-Ang
Peng, Yan-Han
Yuan, Jia-Hong
Ling, Zhen-Hua
author_facet Liu, Yin-Long
Li, Yuanchao
Feng, Rui
He, Liu
Chen, Jia-Xin
Wang, Yi-Ming
Chen, Yu-Ang
Peng, Yan-Han
Yuan, Jia-Hong
Ling, Zhen-Hua
contents This paper presents our submission to the PROCESS Challenge 2025, focusing on spontaneous speech analysis for early dementia detection. For the three-class classification task (Healthy Control, Mild Cognitive Impairment, and Dementia), we propose a cascaded binary classification framework that fine-tunes pre-trained language models and incorporates pause encoding to better capture disfluencies. This design streamlines multi-class classification and addresses class imbalance by restructuring the decision process. For the Mini-Mental State Examination score regression task, we develop an enhanced multimodal fusion system that combines diverse acoustic and linguistic features. Separate regression models are trained on individual feature sets, with ensemble learning applied through score averaging. Experimental results on the test set outperform the baselines provided by the organizers in both tasks, demonstrating the robustness and effectiveness of our approach.
format Preprint
id arxiv_https___arxiv_org_abs_2505_19446
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Leveraging Cascaded Binary Classification and Multimodal Fusion for Dementia Detection through Spontaneous Speech
Liu, Yin-Long
Li, Yuanchao
Feng, Rui
He, Liu
Chen, Jia-Xin
Wang, Yi-Ming
Chen, Yu-Ang
Peng, Yan-Han
Yuan, Jia-Hong
Ling, Zhen-Hua
Audio and Speech Processing
This paper presents our submission to the PROCESS Challenge 2025, focusing on spontaneous speech analysis for early dementia detection. For the three-class classification task (Healthy Control, Mild Cognitive Impairment, and Dementia), we propose a cascaded binary classification framework that fine-tunes pre-trained language models and incorporates pause encoding to better capture disfluencies. This design streamlines multi-class classification and addresses class imbalance by restructuring the decision process. For the Mini-Mental State Examination score regression task, we develop an enhanced multimodal fusion system that combines diverse acoustic and linguistic features. Separate regression models are trained on individual feature sets, with ensemble learning applied through score averaging. Experimental results on the test set outperform the baselines provided by the organizers in both tasks, demonstrating the robustness and effectiveness of our approach.
title Leveraging Cascaded Binary Classification and Multimodal Fusion for Dementia Detection through Spontaneous Speech
topic Audio and Speech Processing
url https://arxiv.org/abs/2505.19446