SCDiar: a streaming diarization system based on speaker change detection and speech recognition

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zheng, Naijun, Wan, Xucheng, Liu, Kai, Huan, Zhou
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915125992095744
author Zheng, Naijun
Wan, Xucheng
Liu, Kai
Huan, Zhou
author_facet Zheng, Naijun
Wan, Xucheng
Liu, Kai
Huan, Zhou
contents In hours-long meeting scenarios, real-time speech stream often struggles with achieving accurate speaker diarization, commonly leading to speaker identification and speaker count errors. To address this challenge, we propose SCDiar, a system that operates on speech segments, split at the token level by a speaker change detection (SCD) module. Building on these segments, we introduce several enhancements to efficiently select the best available segment for each speaker. These improvements lead to significant gains across various benchmarks. Notably, on real-world meeting data involving more than ten participants, SCDiar outperforms previous systems by up to 53.6\% in accuracy, substantially narrowing the performance gap between online and offline systems.
format Preprint
id arxiv_https___arxiv_org_abs_2501_16641
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle SCDiar: a streaming diarization system based on speaker change detection and speech recognition
Zheng, Naijun
Wan, Xucheng
Liu, Kai
Huan, Zhou
Audio and Speech Processing
Human-Computer Interaction
Sound
In hours-long meeting scenarios, real-time speech stream often struggles with achieving accurate speaker diarization, commonly leading to speaker identification and speaker count errors. To address this challenge, we propose SCDiar, a system that operates on speech segments, split at the token level by a speaker change detection (SCD) module. Building on these segments, we introduce several enhancements to efficiently select the best available segment for each speaker. These improvements lead to significant gains across various benchmarks. Notably, on real-world meeting data involving more than ten participants, SCDiar outperforms previous systems by up to 53.6\% in accuracy, substantially narrowing the performance gap between online and offline systems.
title SCDiar: a streaming diarization system based on speaker change detection and speech recognition
topic Audio and Speech Processing
Human-Computer Interaction
Sound
url https://arxiv.org/abs/2501.16641