Loose coupling of spectral and spatial models for multi-channel diarization and enhancement of meetings in dynamic environments
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866908782285553664 |
|---|---|
| author | Meise, Adrian Cord-Landwehr, Tobias Boeddeker, Christoph Delcroix, Marc Nakatani, Tomohiro Haeb-Umbach, Reinhold |
| author_facet | Meise, Adrian Cord-Landwehr, Tobias Boeddeker, Christoph Delcroix, Marc Nakatani, Tomohiro Haeb-Umbach, Reinhold |
| contents | Sound capture by microphone arrays opens the possibility to exploit spatial, in addition to spectral, information for diarization and signal enhancement, two important tasks in meeting transcription. However, there is no one-to-one mapping of positions in space to speakers if speakers move. Here, we address this by proposing a novel joint spatial and spectral mixture model, whose two submodels are loosely coupled by modeling the relationship between speaker and position index probabilistically. Thus, spatial and spectral information can be jointly exploited, while at the same time allowing for speakers speaking from different positions. Experiments on the LibriCSS data set with simulated speaker position changes show great improvements over tightly coupled subsystems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_16077 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Loose coupling of spectral and spatial models for multi-channel diarization and enhancement of meetings in dynamic environments Meise, Adrian Cord-Landwehr, Tobias Boeddeker, Christoph Delcroix, Marc Nakatani, Tomohiro Haeb-Umbach, Reinhold Audio and Speech Processing Sound capture by microphone arrays opens the possibility to exploit spatial, in addition to spectral, information for diarization and signal enhancement, two important tasks in meeting transcription. However, there is no one-to-one mapping of positions in space to speakers if speakers move. Here, we address this by proposing a novel joint spatial and spectral mixture model, whose two submodels are loosely coupled by modeling the relationship between speaker and position index probabilistically. Thus, spatial and spectral information can be jointly exploited, while at the same time allowing for speakers speaking from different positions. Experiments on the LibriCSS data set with simulated speaker position changes show great improvements over tightly coupled subsystems. |
| title | Loose coupling of spectral and spatial models for multi-channel diarization and enhancement of meetings in dynamic environments |
| topic | Audio and Speech Processing |
| url | https://arxiv.org/abs/2601.16077 |