Benchmarking Speech Systems for Frontline Health Conversations: The DISPLACE-M Challenge

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: E, Dhanya, Meena, Ankita, Nanivadekar, Manas, A, Noumida, Azad, Victor, Shenoy, Ashwini Nagaraj, Chowdhuri, Pratik Roy, Banga, Shobhit, Chhabra, Vanshika, Bhat, Chitralekha, Kalluri, Shareef babu, Chetupalli, Srikanth Raj, Vijayasenan, Deepu, Ganapathy, Sriram
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915836777725952
author E, Dhanya
Meena, Ankita
Nanivadekar, Manas
A, Noumida
Azad, Victor
Shenoy, Ashwini Nagaraj
Chowdhuri, Pratik Roy
Banga, Shobhit
Chhabra, Vanshika
Bhat, Chitralekha
Kalluri, Shareef babu
Chetupalli, Srikanth Raj
Vijayasenan, Deepu
Ganapathy, Sriram
author_facet E, Dhanya
Meena, Ankita
Nanivadekar, Manas
A, Noumida
Azad, Victor
Shenoy, Ashwini Nagaraj
Chowdhuri, Pratik Roy
Banga, Shobhit
Chhabra, Vanshika
Bhat, Chitralekha
Kalluri, Shareef babu
Chetupalli, Srikanth Raj
Vijayasenan, Deepu
Ganapathy, Sriram
contents The DIarization and Speech Processing for LAnguage understanding in Conversational Environments - Medical (DISPLACE-M) challenge introduces a conversational AI benchmark for understanding goal-oriented, real-world medical dialogues. The challenge addresses multi-speaker interactions between frontline health workers and care seekers, characterized by spontaneous, noisy and overlapping speech. As part of the challenge, medical conversational dataset comprising 40 hours of development and 15 hours of blind evaluation recordings was released. We provided baseline systems across 4 tasks - speaker diarization, automatic speech recognition, topic identification and dialogue summarization - to enable consistent benchmarking. System performance is evaluated using diarization error rate (DER), time-constrained minimum-permutation word error rate (tcpWER) and ROUGE-L. This paper describes the Phase-I evaluation - data, tasks and baseline systems - along with the summary of the evaluation results.
format Preprint
id arxiv_https___arxiv_org_abs_2603_02813
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Benchmarking Speech Systems for Frontline Health Conversations: The DISPLACE-M Challenge
E, Dhanya
Meena, Ankita
Nanivadekar, Manas
A, Noumida
Azad, Victor
Shenoy, Ashwini Nagaraj
Chowdhuri, Pratik Roy
Banga, Shobhit
Chhabra, Vanshika
Bhat, Chitralekha
Kalluri, Shareef babu
Chetupalli, Srikanth Raj
Vijayasenan, Deepu
Ganapathy, Sriram
Audio and Speech Processing
The DIarization and Speech Processing for LAnguage understanding in Conversational Environments - Medical (DISPLACE-M) challenge introduces a conversational AI benchmark for understanding goal-oriented, real-world medical dialogues. The challenge addresses multi-speaker interactions between frontline health workers and care seekers, characterized by spontaneous, noisy and overlapping speech. As part of the challenge, medical conversational dataset comprising 40 hours of development and 15 hours of blind evaluation recordings was released. We provided baseline systems across 4 tasks - speaker diarization, automatic speech recognition, topic identification and dialogue summarization - to enable consistent benchmarking. System performance is evaluated using diarization error rate (DER), time-constrained minimum-permutation word error rate (tcpWER) and ROUGE-L. This paper describes the Phase-I evaluation - data, tasks and baseline systems - along with the summary of the evaluation results.
title Benchmarking Speech Systems for Frontline Health Conversations: The DISPLACE-M Challenge
topic Audio and Speech Processing
url https://arxiv.org/abs/2603.02813