Image de couverture de livre

Streaming Speech-to-Text Translation with a SpeechLLM

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Parcollet, Titouan, Zhang, Shucong, Zheng, Xianrui, van Dalen, Rogier C.
Format:	Preprint
Publié:	2026
Sujets:	Computation and Language Artificial Intelligence Audio and Speech Processing
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Benchmarking Rotary Position Embeddings for Automatic Speech Recognition
par: Zhang, Shucong, et autres
Publié: (2025)

Linear-Complexity Self-Supervised Learning for Speech Processing
par: Zhang, Shucong, et autres
Publié: (2024)

Linear Time Complexity Conformers with SummaryMixing for Streaming Speech Recognition
par: Parcollet, Titouan, et autres
Publié: (2024)

SummaryMixing: A Linear-Complexity Alternative to Self-Attention for Speech Recognition and Understanding
par: Parcollet, Titouan, et autres
Publié: (2023)

Evaluation of LLMs in Speech is Often Flawed: Test Set Contamination in Large Language Models for Speech Recognition
par: Tseng, Yuan, et autres
Publié: (2025)

Loquacious Set: 25,000 Hours of Transcribed and Diverse English Speech Recognition Data for Research and Commercial Use
par: Parcollet, Titouan, et autres
Publié: (2025)

Robust Unsupervised Adaptation of a Speech Recogniser Using Entropy Minimisation and Speaker Codes
par: van Dalen, Rogier C., et autres
Publié: (2025)

Conversational Speech Reveals Structural Robustness Failures in SpeechLLM Backbones
par: Teleki, Maria, et autres
Publié: (2025)

Analyzing Speech Unit Selection for Textless Speech-to-Speech Translation
par: Duret, Jarod, et autres
Publié: (2024)

Better Pseudo-labeling with Multi-ASR Fusion and Error Correction by SpeechLLM
par: Prakash, Jeena, et autres
Publié: (2025)

StreamSpeech: Simultaneous Speech-to-Speech Translation with Multi-task Learning
par: Zhang, Shaolei, et autres
Publié: (2024)

StreamAtt: Direct Streaming Speech-to-Text Translation with Attention-based Audio History Selection
par: Papi, Sara, et autres
Publié: (2024)

Rubric-Guided Fine-tuning of SpeechLLMs for Multi-Aspect, Multi-Rater L2 Reading-Speech Assessment
par: Parikh, Aditya Kamlesh, et autres
Publié: (2026)

Efficient Streaming LLM for Speech Recognition
par: Jia, Junteng, et autres
Publié: (2024)

Leveraging Speech PTM, Text LLM, and Emotional TTS for Speech Emotion Recognition
par: Ma, Ziyang, et autres
Publié: (2023)

Do Bias Benchmarks Generalise? Evidence from Voice-based Evaluation of Gender Bias in SpeechLLMs
par: Satish, Shree Harsha Bokkahalli, et autres
Publié: (2025)

Phonology-Guided Speech-to-Speech Translation for African Languages
par: Ochieng, Peter, et autres
Publié: (2024)

LeBenchmark 2.0: a Standardized, Replicable and Enhanced Framework for Self-supervised Representations of French Speech
par: Parcollet, Titouan, et autres
Publié: (2023)

EmoVoice: LLM-based Emotional Text-To-Speech Model with Freestyle Text Prompting
par: Yang, Guanrou, et autres
Publié: (2025)

Speech ReaLLM -- Real-time Streaming Speech Recognition with Multimodal LLMs by Teaching the Flow of Time
par: Seide, Frank, et autres
Publié: (2024)

What Makes a Good Speech Tokenizer for LLM-Centric Speech Generation? A Systematic Study
par: Fan, Xiaoran, et autres
Publié: (2025)

Leveraging Unit Language Guidance to Advance Speech Modeling in Textless Speech-to-Speech Translation
par: Zhang, Yuhao, et autres
Publié: (2025)

SimulU: Training-free Policy for Long-form Simultaneous Speech-to-Speech Translation
par: Djanibekov, Amirbek, et autres
Publié: (2026)

A Non-autoregressive Generation Framework for End-to-End Simultaneous Speech-to-Speech Translation
par: Ma, Zhengrui, et autres
Publié: (2024)

Streaming Speaker Change Detection and Gender Classification for Transducer-Based Multi-Talker Speech Translation
par: Wang, Peidong, et autres
Publié: (2025)

SeamlessExpressiveLM: Speech Language Model for Expressive Speech-to-Speech Translation with Chain-of-Thought
par: Gong, Hongyu, et autres
Publié: (2024)

MoVE: Translating Laughter and Tears via Mixture of Vocalization Experts in Speech-to-Speech Translation
par: Chen, Szu-Chi, et autres
Publié: (2026)

How "Real" is Your Real-Time Simultaneous Speech-to-Text Translation System?
par: Papi, Sara, et autres
Publié: (2024)

Seamless Dysfluent Speech Text Alignment for Disordered Speech Analysis
par: Ye, Zongli, et autres
Publié: (2025)

TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation
par: Le, Chenyang, et autres
Publié: (2024)

Closing the Gap Between Text and Speech Understanding in LLMs
par: Cuervo, Santiago, et autres
Publié: (2025)

Towards Early Prediction of Self-Supervised Speech Model Performance
par: Whetten, Ryan, et autres
Publié: (2025)

LLaMA-Omni2: LLM-based Real-time Spoken Chatbot with Autoregressive Streaming Speech Synthesis
par: Fang, Qingkai, et autres
Publié: (2025)

Adaptive Inner Speech-Text Alignment for LLM-based Speech Translation
par: Liu, Henglyu, et autres
Publié: (2025)

PHRASED: Phrase Dictionary Biasing for Speech Translation
par: Wang, Peidong, et autres
Publié: (2025)

Length Aware Speech Translation for Video Dubbing
par: Chadha, Harveen Singh, et autres
Publié: (2025)

When End-to-End is Overkill: Rethinking Cascaded Speech-to-Text Translation
par: Min, Anna, et autres
Publié: (2025)

A Unified Speech LLM for Diarization and Speech Recognition in Multilingual Conversations
par: Saengthong, Phurich, et autres
Publié: (2025)

Neural networks for Text-to-Speech evaluation
par: Trofimenko, Ilya, et autres
Publié: (2026)

The Voice Behind the Words: Quantifying Intersectional Bias in SpeechLLMs
par: Satish, Shree Harsha Bokkahalli, et autres
Publié: (2026)