Copertina

WhisperFlow: speech foundation models in real time

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Wang, Rongxiang, Xu, Zhiming, Lin, Felix Xiaozhu
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Sound Audio and Speech Processing
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Probing mental health information in speech foundation models
di: de Gennes, Marc, et al.
Pubblicazione: (2024)

An interpretable speech foundation model for depression detection by revealing prediction-relevant acoustic features from long speech
di: Deng, Qingkun, et al.
Pubblicazione: (2024)

Safeguarding Privacy in Edge Speech Understanding with Tiny Foundation Models
di: Benazir, Afsara, et al.
Pubblicazione: (2025)

Can Whisper perform speech-based in-context learning?
di: Wang, Siyin, et al.
Pubblicazione: (2023)

Whisper-PMFA: Partial Multi-Scale Feature Aggregation for Speaker Verification using Whisper Models
di: Zhao, Yiyang, et al.
Pubblicazione: (2024)

FlowW2N: Whispered-to-Normal Speech Conversion via Flow-Matching
di: Ritter-Gutierrez, Fabian, et al.
Pubblicazione: (2026)

Whisper-SV: Adapting Whisper for Low-data-resource Speaker Verification
di: Zhang, Li, et al.
Pubblicazione: (2024)

M2R-Whisper: Multi-stage and Multi-scale Retrieval Augmentation for Enhancing Whisper
di: Zhou, Jiaming, et al.
Pubblicazione: (2024)

SQ-Whisper: Speaker-Querying based Whisper Model for Target-Speaker ASR
di: Guo, Pengcheng, et al.
Pubblicazione: (2024)

Robust fine-tuning of speech recognition models via model merging: application to disordered speech
di: Ducorroy, Alexandre, et al.
Pubblicazione: (2025)

DualSep: A Light-weight dual-encoder convolutional recurrent network for real-time in-car speech separation
di: Wang, Ziqian, et al.
Pubblicazione: (2024)

Target Speaker ASR with Whisper
di: Polok, Alexander, et al.
Pubblicazione: (2024)

Improving Whispered Speech Recognition Performance using Pseudo-whispered based Data Augmentation
di: Lin, Zhaofeng, et al.
Pubblicazione: (2023)

Graph-based multi-Feature fusion method for speech emotion recognition
di: Liu, Xueyu, et al.
Pubblicazione: (2024)

Moshi: a speech-text foundation model for real-time dialogue
di: Défossez, Alexandre, et al.
Pubblicazione: (2024)

A Study on Incorporating Whisper for Robust Speech Assessment
di: Zezario, Ryandhimas E., et al.
Pubblicazione: (2023)

Simul-Whisper: Attention-Guided Streaming Whisper with Truncation Detection
di: Wang, Haoyu, et al.
Pubblicazione: (2024)

WhispEar: A Bi-directional Framework for Scaling Whispered Speech Conversion via Pseudo-Parallel Whisper Generation
di: Fang, Zihao, et al.
Pubblicazione: (2026)

Multichannel blind speech source separation with a disjoint constraint source model
di: Wang, Jianyu, et al.
Pubblicazione: (2024)

Prompting Whisper for Joint Speech Transcription and Diarization
di: Zamyrova, Mariia, et al.
Pubblicazione: (2026)

Probing Whisper for Dysarthric Speech in Detection and Assessment
di: Yue, Zhengjun, et al.
Pubblicazione: (2025)

BFA: Real-time Multilingual Text-to-speech Forced Alignment
di: Rehman, Abdul, et al.
Pubblicazione: (2025)

Speech Intelligibility Assessment with Uncertainty-Aware Whisper Embeddings and sLSTM
di: Zezario, Ryandhimas E., et al.
Pubblicazione: (2025)

A Self-Training Approach for Whisper to Enhance Long Dysarthric Speech Recognition
di: Wang, Shiyao, et al.
Pubblicazione: (2025)

GDiffuSE: Diffusion-based speech enhancement with noise model guidance
di: Yanir, Efrayim, et al.
Pubblicazione: (2025)

Leveraging Self-Supervised Models for Automatic Whispered Speech Recognition
di: Farhadipour, Aref, et al.
Pubblicazione: (2024)

Sparsely Shared LoRA on Whisper for Child Speech Recognition
di: Liu, Wei, et al.
Pubblicazione: (2023)

Improving Rare-Word Recognition of Whisper in Zero-Shot Settings
di: Jogi, Yash, et al.
Pubblicazione: (2025)

Exploiting Music Source Separation for Automatic Lyrics Transcription with Whisper
di: Syed, Jaza, et al.
Pubblicazione: (2025)

Determined blind source separation via modeling adjacent frequency band correlations in speech signals
di: Wang, Jianyu, et al.
Pubblicazione: (2025)

Towards noise-robust speech inversion through multi-task learning with speech enhancement
di: Tabatabaee, Saba, et al.
Pubblicazione: (2026)

Towards a generalized monaural and binaural auditory model for psychoacoustics and speech intelligibility
di: Biberger, Thomas, et al.
Pubblicazione: (2021)

Language model integration based on memory control for sequence to sequence speech recognition
di: Cho, Jaejin, et al.
Pubblicazione: (2018)

Phoneme-based speech recognition driven by large language models and sampling marginalization
di: Ma, Te, et al.
Pubblicazione: (2025)

Single-channel speech enhancement by using psychoacoustical model inspired fusion framework
di: Samui, Suman
Pubblicazione: (2022)

Adapting Whisper for Streaming Speech Recognition via Two-Pass Decoding
di: Zhou, Haoran, et al.
Pubblicazione: (2025)

State-Space Models in Efficient Whispered and Multi-dialect Speech Recognition
di: Farhadipour, Aref, et al.
Pubblicazione: (2025)

On the relationship between speech and hearing
di: Umesh, Srinivasan, et al.
Pubblicazione: (2024)

Distilling a speech and music encoder with task arithmetic
di: Ritter-Gutierrez, Fabian, et al.
Pubblicazione: (2025)

WavJEPA: Semantic learning unlocks robust audio foundation models for raw waveforms
di: Yuksel, Goksenin, et al.
Pubblicazione: (2025)