Saved in:
Bibliographic Details
Main Authors: Han, Jiangyu, Wang, Ruoyu, Masuyama, Yoshiki, Delcroix, Marc, Rohdin, Johan, Du, Jun, Burget, Lukas
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2510.14551
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • Self-supervised models such as WavLM have demonstrated strong performance for neural speaker diarization. However, these models are typically pre-trained on single-channel recordings, limiting their effectiveness in multi-channel scenarios. Existing diarization systems built on these models often rely on DOVER-Lap to combine outputs from individual channels. Although effective, this approach incurs substantial computational overhead and fails to fully exploit spatial information. In this work, building on DiariZen, a pipeline that combines WavLM-based local endto-end neural diarization with speaker embedding clustering, we introduce a lightweight approach to make pre-trained WavLM spatially aware by inserting channel communication modules into the early layers. Our method is agnostic to both the number of microphone channels and array topologies, ensuring broad applicability. We further propose to fuse multi-channel speaker embeddings by leveraging spatial attention weights. Evaluations on five public datasets show consistent improvements over single-channel baselines and demonstrate superior performance and efficiency compared with DOVER-Lap. Our source code is publicly available at https://github.com/BUTSpeechFIT/DiariZen.