Exploring In-Context Learning Capabilities of ChatGPT for Pathological Speech Detection

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Amiri, Mahdi, Shahreza, Hatef Otroshi, Kodrasi, Ina
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866915219179044864
author Amiri, Mahdi
Shahreza, Hatef Otroshi
Kodrasi, Ina
author_facet Amiri, Mahdi
Shahreza, Hatef Otroshi
Kodrasi, Ina
contents Automatic pathological speech detection approaches have shown promising results, gaining attention as potential diagnostic tools alongside costly traditional methods. While these approaches can achieve high accuracy, their lack of interpretability limits their applicability in clinical practice. In this paper, we investigate the use of multimodal Large Language Models (LLMs), specifically ChatGPT-4o, for automatic pathological speech detection in a few-shot in-context learning setting. Experimental results show that this approach not only delivers promising performance but also provides explanations for its decisions, enhancing model interpretability. To further understand its effectiveness, we conduct an ablation study to analyze the impact of different factors, such as input type and system prompts, on the final results. Our findings highlight the potential of multimodal LLMs for further exploration and advancement in automatic pathological speech detection.
format Preprint
id arxiv_https___arxiv_org_abs_2503_23873
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Exploring In-Context Learning Capabilities of ChatGPT for Pathological Speech Detection
Amiri, Mahdi
Shahreza, Hatef Otroshi
Kodrasi, Ina
Audio and Speech Processing
Sound
Automatic pathological speech detection approaches have shown promising results, gaining attention as potential diagnostic tools alongside costly traditional methods. While these approaches can achieve high accuracy, their lack of interpretability limits their applicability in clinical practice. In this paper, we investigate the use of multimodal Large Language Models (LLMs), specifically ChatGPT-4o, for automatic pathological speech detection in a few-shot in-context learning setting. Experimental results show that this approach not only delivers promising performance but also provides explanations for its decisions, enhancing model interpretability. To further understand its effectiveness, we conduct an ablation study to analyze the impact of different factors, such as input type and system prompts, on the final results. Our findings highlight the potential of multimodal LLMs for further exploration and advancement in automatic pathological speech detection.
title Exploring In-Context Learning Capabilities of ChatGPT for Pathological Speech Detection
topic Audio and Speech Processing
Sound
url https://arxiv.org/abs/2503.23873