Image de couverture de livre

Which Evaluation for Which Model? A Taxonomy for Speech Model Assessment

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	de Seyssel, Maureen, Dhekane, Eeshan Gunesh
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language Audio and Speech Processing
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

EmphAssess : a Prosodic Benchmark on Assessing Emphasis Transfer in Speech-to-Speech Models
par: de Seyssel, Maureen, et autres
Publié: (2023)

Leveraging Audio-Visual Data to Reduce the Multilingual Gap in Self-Supervised Speech Models
par: Blandón, María Andrea Cruz, et autres
Publié: (2025)

Which Prosodic Features Matter Most for Pragmatics?
par: Ward, Nigel G., et autres
Publié: (2024)

Closing the Gap Between Text and Speech Understanding in LLMs
par: Cuervo, Santiago, et autres
Publié: (2025)

Towards Probing Speech-Specific Risks in Large Multimodal Models: A Taxonomy, Benchmark, and Insights
par: Yang, Hao, et autres
Publié: (2024)

Speech-IFEval: Evaluating Instruction-Following and Quantifying Catastrophic Forgetting in Speech-Aware Language Models
par: Lu, Ke-Han, et autres
Publié: (2025)

Evaluation of LLMs in Speech is Often Flawed: Test Set Contamination in Large Language Models for Speech Recognition
par: Tseng, Yuan, et autres
Publié: (2025)

Evaluating Emotion Recognition in Spoken Language Models on Emotionally Incongruent Speech
par: Corrêa, Pedro, et autres
Publié: (2025)

A Large-Scale Evaluation of Speech Foundation Models
par: Yang, Shu-wen, et autres
Publié: (2024)

S2S-Arena: Evaluating Paralinguistic Instruction Following in Speech-to-Speech Models
par: Jiang, Feng, et autres
Publié: (2025)

Spoken Stereoset: On Evaluating Social Bias Toward Speaker in Speech Large Language Models
par: Lin, Yi-Cheng, et autres
Publié: (2024)

Comparison of End-to-end Speech Assessment Models for the NOCASA 2025 Challenge
par: Žavoronkov, Aleksei, et autres
Publié: (2025)

On the Evaluation of Speech Foundation Models for Spoken Language Understanding
par: Arora, Siddhant, et autres
Publié: (2024)

Enhancing Indonesian Automatic Speech Recognition: Evaluating Multilingual Models with Diverse Speech Variabilities
par: Adila, Aulia, et autres
Publié: (2024)

Calibration-Reasoning Framework for Descriptive Speech Quality Assessment
par: Kostenok, Elizaveta, et autres
Publié: (2026)

Assessment of L2 Oral Proficiency using Speech Large Language Models
par: Ma, Rao, et autres
Publié: (2025)

MultiPA: A Multi-task Speech Pronunciation Assessment Model for Open Response Scenarios
par: Chen, Yu-Wen, et autres
Publié: (2023)

Towards Efficient Speech-Text Jointly Decoding within One Speech Language Model
par: Wu, Haibin, et autres
Publié: (2025)

Speech Recognition Model Improves Text-to-Speech Synthesis using Fine-Grained Reward
par: Wang, Guansu, et autres
Publié: (2025)

DeSTA: Enhancing Speech Language Models through Descriptive Speech-Text Alignment
par: Lu, Ke-Han, et autres
Publié: (2024)

Non-native Children's Automatic Speech Assessment Challenge (NOCASA)
par: Getman, Yaroslav, et autres
Publié: (2025)

SpeechColab Leaderboard: An Open-Source Platform for Automatic Speech Recognition Evaluation
par: Du, Jiayu, et autres
Publié: (2024)

A Large Dataset of Spontaneous Speech with the Accent Spoken in São Paulo for Automatic Speech Recognition Evaluation
par: Lima, Rodrigo, et autres
Publié: (2024)

POWSM: A Phonetic Open Whisper-Style Speech Foundation Model
par: Li, Chin-Jou, et autres
Publié: (2025)

Training and Inference Efficiency of Encoder-Decoder Speech Models
par: Żelasko, Piotr, et autres
Publié: (2025)

Scaling Spoken Language Models with Syllabic Speech Tokenization
par: Lee, Nicholas, et autres
Publié: (2025)

Audio Large Language Models Can Be Descriptive Speech Quality Evaluators
par: Chen, Chen, et autres
Publié: (2025)

Enabling Auditory Large Language Models for Automatic Speech Quality Evaluation
par: Wang, Siyin, et autres
Publié: (2024)

SpeechCaps: Advancing Instruction-Based Universal Speech Models with Multi-Talker Speaking Style Captioning
par: Huang, Chien-yu, et autres
Publié: (2024)

Dolphin: A Large-Scale Automatic Speech Recognition Model for Eastern Languages
par: Meng, Yangyang, et autres
Publié: (2025)

MARS6: A Small and Robust Hierarchical-Codec Text-to-Speech Model
par: Baas, Matthew, et autres
Publié: (2025)

Evaluating Speech-to-Text x LLM x Text-to-Speech Combinations for AI Interview Systems
par: Allbert, Rumi, et autres
Publié: (2025)

What do Speech Foundation Models Learn? Analysis and Applications
par: Pasad, Ankita
Publié: (2025)

Self-Supervised Models of Speech Infer Universal Articulatory Kinematics
par: Cho, Cheol Jun, et autres
Publié: (2023)

Multi-stage Large Language Model Correction for Speech Recognition
par: Pu, Jie, et autres
Publié: (2023)

Robust Speech and Natural Language Processing Models for Depression Screening
par: Lu, Y., et autres
Publié: (2024)

SALM-Duplex: Efficient and Direct Duplex Modeling for Speech-to-Speech Language Model
par: Hu, Ke, et autres
Publié: (2025)

SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models
par: Zhang, Xin, et autres
Publié: (2023)

TTS-PRISM: A Perceptual Reasoning and Interpretable Speech Model for Fine-Grained Diagnosis
par: Wang, Xi, et autres
Publié: (2026)

Multilingual Dysarthric Speech Assessment Using Universal Phone Recognition and Language-Specific Phonemic Contrast Modeling
par: Yeo, Eunjung, et autres
Publié: (2026)