Saved in:
Bibliographic Details
Main Authors: Wang, Jianzong, Li, Pengcheng, Zhang, Xulong, Cheng, Ning, Xiao, Jing
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2403.05000
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917653687304192
author Wang, Jianzong
Li, Pengcheng
Zhang, Xulong
Cheng, Ning
Xiao, Jing
author_facet Wang, Jianzong
Li, Pengcheng
Zhang, Xulong
Cheng, Ning
Xiao, Jing
contents Intent is defined for understanding spoken language in existing works. Both textual features and acoustic features involved in medical speech contain intent, which is important for symptomatic diagnosis. In this paper, we propose a medical speech classification model named DRSC that automatically learns to disentangle intent and content representations from textual-acoustic data for classification. The intent representations of the text domain and the Mel-spectrogram domain are extracted via intent encoders, and then the reconstructed text feature and the Mel-spectrogram feature are obtained through two exchanges. After combining the intent from two domains into a joint representation, the integrated intent representation is fed into a decision layer for classification. Experimental results show that our model obtains an average accuracy rate of 95% in detecting 25 different medical symptoms.
format Preprint
id arxiv_https___arxiv_org_abs_2403_05000
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Medical Speech Symptoms Classification via Disentangled Representation
Wang, Jianzong
Li, Pengcheng
Zhang, Xulong
Cheng, Ning
Xiao, Jing
Artificial Intelligence
Intent is defined for understanding spoken language in existing works. Both textual features and acoustic features involved in medical speech contain intent, which is important for symptomatic diagnosis. In this paper, we propose a medical speech classification model named DRSC that automatically learns to disentangle intent and content representations from textual-acoustic data for classification. The intent representations of the text domain and the Mel-spectrogram domain are extracted via intent encoders, and then the reconstructed text feature and the Mel-spectrogram feature are obtained through two exchanges. After combining the intent from two domains into a joint representation, the integrated intent representation is fed into a decision layer for classification. Experimental results show that our model obtains an average accuracy rate of 95% in detecting 25 different medical symptoms.
title Medical Speech Symptoms Classification via Disentangled Representation
topic Artificial Intelligence
url https://arxiv.org/abs/2403.05000