Imagen de Portada

Integrating Audio, Visual, and Semantic Information for Enhanced Multimodal Speaker Diarization

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Cheng, Luyao, Wang, Hui, Zheng, Siqi, Chen, Yafeng, Huang, Rongjie, Zhang, Qinglin, Chen, Qian, Li, Xihao
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Computer Vision and Pattern Recognition Sound Audio and Speech Processing
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Improving Speaker Diarization using Semantic Information: Joint Pairwise Constraints Propagation
por: Cheng, Luyao, et al.
Publicado: (2023)

3D-Speaker-Toolkit: An Open-Source Toolkit for Multimodal Speaker Verification and Diarization
por: Chen, Yafeng, et al.
Publicado: (2024)

Self-Distillation Prototypes Network: Learning Robust Speaker Representations without Supervision
por: Chen, Yafeng, et al.
Publicado: (2024)

Self-Distillation Prototypes Network: Learning Robust Speaker Representations without Supervision
por: Chen, Yafeng, et al.
Publicado: (2023)

Quality-Aware End-to-End Audio-Visual Neural Speaker Diarization
por: He, Mao-Kui, et al.
Publicado: (2024)

USED: Universal Speaker Extraction and Diarization
por: Ao, Junyi, et al.
Publicado: (2023)

The Multimodal Information Based Speech Processing (MISP) 2025 Challenge: Audio-Visual Diarization and Recognition
por: Gao, Ming, et al.
Publicado: (2025)

AudioLCM: Text-to-Audio Generation with Latent Consistency Models
por: Liu, Huadai, et al.
Publicado: (2024)

Pretraining Multi-Speaker Identification for Neural Speaker Diarization
por: Horiguchi, Shota, et al.
Publicado: (2025)

Audio-Visual Speaker Diarization: Current Databases, Approaches and Challenges
por: Mingote, Victoria, et al.
Publicado: (2024)

Exploring Text-Queried Sound Event Detection with Audio Source Separation
por: Yin, Han, et al.
Publicado: (2024)

Streaming Sortformer: Speaker Cache-Based Online Speaker Diarization with Arrival-Time Ordering
por: Medennikov, Ivan, et al.
Publicado: (2025)

Leveraging Self-Supervised Learning for Speaker Diarization
por: Han, Jiangyu, et al.
Publicado: (2024)

Mamba-based Segmentation Model for Speaker Diarization
por: Plaquet, Alexis, et al.
Publicado: (2024)

Can We Really Repurpose Multi-Speaker ASR Corpus for Speaker Diarization?
por: Horiguchi, Shota, et al.
Publicado: (2025)

Speaker Embeddings With Weakly Supervised Voice Activity Detection For Efficient Speaker Diarization
por: Thienpondt, Jenthe, et al.
Publicado: (2024)

Overlap-Adaptive Hybrid Speaker Diarization and ASR-Aware Observation Addition for MISP 2025 Challenge
por: Huang, Shangkun, et al.
Publicado: (2025)

Incorporating Spatial Cues in Modular Speaker Diarization for Multi-channel Multi-party Meetings
por: Wang, Ruoyu, et al.
Publicado: (2024)

Do End-to-End Neural Diarization Attractors Need to Encode Speaker Characteristic Information?
por: Zhang, Lin, et al.
Publicado: (2024)

Audio-Visual Target Speaker Extraction with Reverse Selective Auditory Attention
por: Tao, Ruijie, et al.
Publicado: (2024)

Uncertainty Quantification in Machine Learning for Joint Speaker Diarization and Identification
por: McKnight, Simon W., et al.
Publicado: (2023)

Online Audio-Visual Autoregressive Speaker Extraction
por: Pan, Zexu, et al.
Publicado: (2025)

DiarizationLM: Speaker Diarization Post-Processing with Large Language Models
por: Wang, Quan, et al.
Publicado: (2024)

TS-SEP: Joint Diarization and Separation Conditioned on Estimated Speaker Embeddings
por: Boeddeker, Christoph, et al.
Publicado: (2023)

Joint Training of Speaker Embedding Extractor, Speech and Overlap Detection for Diarization
por: Pálka, Petr, et al.
Publicado: (2024)

AISHELL-5: The First Open-Source In-Car Multi-Channel Multi-Speaker Speech Dataset for Automatic Speech Diarization and Recognition
por: Dai, Yuhang, et al.
Publicado: (2025)

End-to-End Joint ASR and Speaker Role Diarization with Child-Adult Interactions
por: Xu, Anfeng, et al.
Publicado: (2026)

Bengali-Loop: Community Benchmarks for Long-Form Bangla ASR and Speaker Diarization
por: Tabib, H. M. Shadman, et al.
Publicado: (2026)

AV-SSAN: Audio-Visual Selective DoA Estimation through Explicit Multi-Band Semantic-Spatial Alignment
por: Chen, Yu, et al.
Publicado: (2025)

DiCoW: Diarization-Conditioned Whisper for Target Speaker Automatic Speech Recognition
por: Polok, Alexander, et al.
Publicado: (2024)

DiariST: Streaming Speech Translation with Speaker Diarization
por: Yang, Mu, et al.
Publicado: (2023)

Audio-Visual Speaker Tracking: Progress, Challenges, and Future Directions
por: Zhao, Jinzheng, et al.
Publicado: (2023)

Utilizing Speaker Profiles for Impersonation Audio Detection
por: Gu, Hao, et al.
Publicado: (2024)

DiariZen Explained: A Tutorial for the Open Source State-of-the-Art Speaker Diarization Pipeline
por: Raghav, Nikhil
Publicado: (2026)

Dynamic Frequency-Adaptive Knowledge Distillation for Speech Enhancement
por: Yuan, Xihao, et al.
Publicado: (2025)

FlashAudio: Rectified Flows for Fast and High-Fidelity Text-to-Audio Generation
por: Liu, Huadai, et al.
Publicado: (2024)

Continuous Target Speech Extraction: Enhancing Personalized Diarization and Extraction on Complex Recordings
por: Zhao, He, et al.
Publicado: (2024)

SaD: A Scenario-Aware Discriminator for Speech Enhancement
por: Yuan, Xihao, et al.
Publicado: (2025)

Investigating Confidence Estimation Measures for Speaker Diarization
por: Chowdhury, Anurag, et al.
Publicado: (2024)

Multi-Stage Speaker Diarization for Noisy Classrooms
por: Khan, Ali Sartaz, et al.
Publicado: (2025)