Pre-Trained Foundation Model representations to uncover Breathing patterns in Speech
Fuente:
arXiv
Guardado en:
| Autores principales: | Mitra, Vikramjit, Chatterjee, Anirban, Zhai, Ke, Weng, Helen, Hill, Ayuko, Hay, Nicole, Webb, Christopher, Cheng, Jamie, Azemi, Erdrin |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
Modeling speech emotion with label variance and analyzing performance across speakers and unseen acoustic conditions
por: Mitra, Vikramjit, et al.
Publicado: (2025)
por: Mitra, Vikramjit, et al.
Publicado: (2025)
Model-driven Heart Rate Estimation and Heart Murmur Detection based on Phonocardiogram
por: Nie, Jingping, et al.
Publicado: (2024)
por: Nie, Jingping, et al.
Publicado: (2024)
Foundation Model Hidden Representations for Heart Rate Estimation from Auscultation
por: Nie, Jingping, et al.
Publicado: (2025)
por: Nie, Jingping, et al.
Publicado: (2025)
Switchboard-Affect: Emotion Perception Labels from Conversational Speech
por: Romana, Amrit, et al.
Publicado: (2025)
por: Romana, Amrit, et al.
Publicado: (2025)
Frame-Wise Breath Detection with Self-Training: An Exploration of Enhancing Breath Naturalness in Text-to-Speech
por: Yang, Dong, et al.
Publicado: (2024)
por: Yang, Dong, et al.
Publicado: (2024)
Exploring Prediction Targets in Masked Pre-Training for Speech Foundation Models
por: Chen, Li-Wei, et al.
Publicado: (2024)
por: Chen, Li-Wei, et al.
Publicado: (2024)
Voice Quality Dimensions as Interpretable Primitives for Speaking Style for Atypical Speech and Affect
por: Narain, Jaya, et al.
Publicado: (2025)
por: Narain, Jaya, et al.
Publicado: (2025)
Target Speech Extraction with Pre-trained AV-HuBERT and Mask-And-Recover Strategy
por: Wu, Wenxuan, et al.
Publicado: (2024)
por: Wu, Wenxuan, et al.
Publicado: (2024)
Robust Semantic Communications for Speech Transmission
por: Weng, Zhenzi, et al.
Publicado: (2024)
por: Weng, Zhenzi, et al.
Publicado: (2024)
On Speech Pre-emphasis as a Simple and Inexpensive Method to Boost Speech Enhancement
por: López-Espejo, Iván, et al.
Publicado: (2024)
por: López-Espejo, Iván, et al.
Publicado: (2024)
Large Model Empowered Streaming Speech Semantic Communications
por: Weng, Zhenzi, et al.
Publicado: (2025)
por: Weng, Zhenzi, et al.
Publicado: (2025)
Every Breath You Don't Take: Deepfake Speech Detection Using Breath
por: Layton, Seth, et al.
Publicado: (2024)
por: Layton, Seth, et al.
Publicado: (2024)
Leveraging LLMs for Scalable Non-intrusive Speech Quality Assessment
por: Cumlin, Fredrik, et al.
Publicado: (2025)
por: Cumlin, Fredrik, et al.
Publicado: (2025)
Adapting Speech Foundation Models for Unified Multimodal Speech Recognition with Large Language Models
por: Zhang, Jing-Xuan, et al.
Publicado: (2025)
por: Zhang, Jing-Xuan, et al.
Publicado: (2025)
On-the-fly Routing for Zero-shot MoE Speaker Adaptation of Speech Foundation Models for Dysarthric Speech Recognition
por: HU, Shujie, et al.
Publicado: (2025)
por: HU, Shujie, et al.
Publicado: (2025)
Balancing Speech Understanding and Generation Using Continual Pre-training for Codec-based Speech LLM
por: Shi, Jiatong, et al.
Publicado: (2025)
por: Shi, Jiatong, et al.
Publicado: (2025)
HYFuse: Aligning Heterogeneous Speech Pre-Trained Representations in Hyperbolic Space for Speech Emotion Recognition
por: Phukan, Orchid Chetia, et al.
Publicado: (2025)
por: Phukan, Orchid Chetia, et al.
Publicado: (2025)
Activation Steering for Accent Adaptation in Speech Foundation Models
por: Sun, Jinuo, et al.
Publicado: (2026)
por: Sun, Jinuo, et al.
Publicado: (2026)
Structured Speaker-Deficiency Adaptation of Foundation Models for Dysarthric and Elderly Speech Recognition
por: Hu, Shujie, et al.
Publicado: (2024)
por: Hu, Shujie, et al.
Publicado: (2024)
Multivariate Probabilistic Assessment of Speech Quality
por: Cumlin, Fredrik, et al.
Publicado: (2025)
por: Cumlin, Fredrik, et al.
Publicado: (2025)
Context-Driven Dynamic Pruning for Large Speech Foundation Models
por: Someki, Masao, et al.
Publicado: (2025)
por: Someki, Masao, et al.
Publicado: (2025)
Exploring Speech Foundation Models for Speaker Diarization Across Lifespan
por: Xu, Anfeng, et al.
Publicado: (2026)
por: Xu, Anfeng, et al.
Publicado: (2026)
End-to-End Speech Recognition with Pre-trained Masked Language Model
por: Higuchi, Yosuke, et al.
Publicado: (2024)
por: Higuchi, Yosuke, et al.
Publicado: (2024)
BreathNet: Generalizable Audio Deepfake Detection via Breath-Cue-Guided Feature Refinement
por: Ye, Zhe, et al.
Publicado: (2026)
por: Ye, Zhe, et al.
Publicado: (2026)
Exploiting Foundation Models and Speech Enhancement for Parkinson's Disease Detection from Speech in Real-World Operative Conditions
por: La Quatra, Moreno, et al.
Publicado: (2024)
por: La Quatra, Moreno, et al.
Publicado: (2024)
A Pre-training Framework that Encodes Noise Information for Speech Quality Assessment
por: Sultana, Subrina, et al.
Publicado: (2024)
por: Sultana, Subrina, et al.
Publicado: (2024)
Towards Fine-Grained and Multi-Granular Contrastive Language-Speech Pre-training
por: Yang, Yifan, et al.
Publicado: (2026)
por: Yang, Yifan, et al.
Publicado: (2026)
StyleSpeech: Parameter-efficient Fine Tuning for Pre-trained Controllable Text-to-Speech
por: Lou, Haowei, et al.
Publicado: (2024)
por: Lou, Haowei, et al.
Publicado: (2024)
Using Speech Foundational Models in Loss Functions for Hearing Aid Speech Enhancement
por: Sutherland, Robert, et al.
Publicado: (2024)
por: Sutherland, Robert, et al.
Publicado: (2024)
Generative Speech Foundation Model Pretraining for High-Quality Speech Extraction and Restoration
por: Ku, Pin-Jui, et al.
Publicado: (2024)
por: Ku, Pin-Jui, et al.
Publicado: (2024)
SA-WavLM: Speaker-Aware Self-Supervised Pre-training for Mixture Speech
por: Lin, Jingru, et al.
Publicado: (2024)
por: Lin, Jingru, et al.
Publicado: (2024)
E-BATS: Efficient Backpropagation-Free Test-Time Adaptation for Speech Foundation Models
por: Dong, Jiaheng, et al.
Publicado: (2025)
por: Dong, Jiaheng, et al.
Publicado: (2025)
Impairments are Clustered in Latents of Deep Neural Network-based Speech Quality Models
por: Cumlin, Fredrik, et al.
Publicado: (2025)
por: Cumlin, Fredrik, et al.
Publicado: (2025)
Prosody Labeling with Phoneme-BERT and Speech Foundation Models
por: Koriyama, Tomoki
Publicado: (2025)
por: Koriyama, Tomoki
Publicado: (2025)
Rethinking Cross-Corpus Speech Emotion Recognition Benchmarking: Are Paralinguistic Pre-Trained Representations Sufficient?
por: Phukan, Orchid Chetia, et al.
Publicado: (2025)
por: Phukan, Orchid Chetia, et al.
Publicado: (2025)
Heterogeneity over Homogeneity: Investigating Multilingual Speech Pre-Trained Models for Detecting Audio Deepfake
por: Phukan, Orchid Chetia, et al.
Publicado: (2024)
por: Phukan, Orchid Chetia, et al.
Publicado: (2024)
Vox-Profile: A Speech Foundation Model Benchmark for Characterizing Diverse Speaker and Speech Traits
por: Feng, Tiantian, et al.
Publicado: (2025)
por: Feng, Tiantian, et al.
Publicado: (2025)
Speaker Disentanglement of Speech Pre-trained Model Based on Interpretability
por: Zhu, Xiaoxu, et al.
Publicado: (2025)
por: Zhu, Xiaoxu, et al.
Publicado: (2025)
Self-Supervised Speech Quality Assessment (S3QA): Leveraging Speech Foundation Models for a Scalable Speech Quality Metric
por: Ogg, Mattson, et al.
Publicado: (2025)
por: Ogg, Mattson, et al.
Publicado: (2025)
Speaker-Conditioned Phrase Break Prediction for Text-to-Speech with Phoneme-Level Pre-trained Language Model
por: Yang, Dong, et al.
Publicado: (2025)
por: Yang, Dong, et al.
Publicado: (2025)
Ejemplares similares
-
Modeling speech emotion with label variance and analyzing performance across speakers and unseen acoustic conditions
por: Mitra, Vikramjit, et al.
Publicado: (2025) -
Model-driven Heart Rate Estimation and Heart Murmur Detection based on Phonocardiogram
por: Nie, Jingping, et al.
Publicado: (2024) -
Foundation Model Hidden Representations for Heart Rate Estimation from Auscultation
por: Nie, Jingping, et al.
Publicado: (2025) -
Switchboard-Affect: Emotion Perception Labels from Conversational Speech
por: Romana, Amrit, et al.
Publicado: (2025) -
Frame-Wise Breath Detection with Self-Training: An Exploration of Enhancing Breath Naturalness in Text-to-Speech
por: Yang, Dong, et al.
Publicado: (2024)