Copertina

VocalNet: Speech LLM with Multi-Token Prediction for Faster and High-Quality Generation

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Wang, Yuhao, Liu, Heyang, Cheng, Ziyang, Wu, Ronghua, Gu, Qunshan, Wang, Yanfeng, Wang, Yu
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computation and Language Artificial Intelligence Sound Audio and Speech Processing
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

SOVA-Bench: Benchmarking the Speech Conversation Ability for LLM-based Voice Assistant
di: Hou, Yixuan, et al.
Pubblicazione: (2025)

VocalNet-MDM: Accelerating Streaming Speech LLM via Self-Distilled Masked Diffusion Modeling
di: Cheng, Ziyang, et al.
Pubblicazione: (2026)

VocalNet-M2: Advancing Low-Latency Spoken Language Modeling via Integrated Multi-Codebook Tokenization and Multi-Token Prediction
di: Wang, Yuhao, et al.
Pubblicazione: (2025)

Post-decoder Biasing for End-to-End Speech Recognition of Multi-turn Medical Interview
di: Liu, Heyang, et al.
Pubblicazione: (2024)

Faster Speech-LLaMA Inference with Multi-token Prediction
di: Raj, Desh, et al.
Pubblicazione: (2024)

SpeechLLM-as-Judges: Towards General and Interpretable Speech Quality Evaluation
di: Wang, Hui, et al.
Pubblicazione: (2025)

DualSpeechLM: Towards Unified Speech Understanding and Generation via Dual Speech Token Modeling with Large Language Models
di: Wang, Yuanyuan, et al.
Pubblicazione: (2025)

NV-Bench: Benchmark of Nonverbal Vocalization Synthesis for Expressive Text-to-Speech Generation
di: Ni, Qinke, et al.
Pubblicazione: (2026)

dLLM-ASR: A Faster Diffusion LLM-based Framework for Speech Recognition
di: Tian, Wenjie, et al.
Pubblicazione: (2026)

Combined Generative and Predictive Modeling for Speech Super-resolution
di: Wang, Heming, et al.
Pubblicazione: (2024)

Mel-RoFormer for Vocal Separation and Vocal Melody Transcription
di: Wang, Ju-Chiang, et al.
Pubblicazione: (2024)

Analysis of Self-Supervised Speech Models on Children's Speech and Infant Vocalizations
di: Li, Jialu, et al.
Pubblicazione: (2024)

Seed-TTS: A Family of High-Quality Versatile Speech Generation Models
di: Anastassiou, Philip, et al.
Pubblicazione: (2024)

Generative Speech Foundation Model Pretraining for High-Quality Speech Extraction and Restoration
di: Ku, Pin-Jui, et al.
Pubblicazione: (2024)

Evaluating Text-to-Speech Synthesis from a Large Discrete Token-based Speech Language Model
di: Wang, Siyang, et al.
Pubblicazione: (2024)

HAM-TTS: Hierarchical Acoustic Modeling for Token-Based Zero-Shot Text-to-Speech with Model and Data Scaling
di: Wang, Chunhui, et al.
Pubblicazione: (2024)

Decoding Linguistic Representations of Human Brain
di: Wang, Yu, et al.
Pubblicazione: (2024)

The VoiceMOS Challenge 2024: Beyond Speech Quality Prediction
di: Huang, Wen-Chin, et al.
Pubblicazione: (2024)

GAP-URGENet: A Generative-Predictive Fusion Framework for Universal Speech Enhancement
di: Rong, Xiaobin, et al.
Pubblicazione: (2026)

Acoustic BPE for Speech Generation with Discrete Tokens
di: Shen, Feiyu, et al.
Pubblicazione: (2023)

MNV-17: A High-Quality Performative Mandarin Dataset for Nonverbal Vocalization Recognition in Speech
di: Mai, Jialong, et al.
Pubblicazione: (2025)

Improving Speech Enhancement with Multi-Metric Supervision from Learned Quality Assessment
di: Wang, Wei, et al.
Pubblicazione: (2025)

Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech Tokens
di: Wang, Xinsheng, et al.
Pubblicazione: (2025)

FLY-TTS: Fast, Lightweight and High-Quality End-to-End Text-to-Speech Synthesis
di: Guo, Yinlin, et al.
Pubblicazione: (2024)

SpeechFake: A Large-Scale Multilingual Speech Deepfake Dataset Incorporating Cutting-Edge Generation Methods
di: Huang, Wen, et al.
Pubblicazione: (2025)

Towards an End-to-End Framework for Invasive Brain Signal Decoding with Large Language Models
di: Feng, Sheng, et al.
Pubblicazione: (2024)

DialoSpeech: Dual-Speaker Dialogue Generation with LLM and Flow Matching
di: Xie, Hanke, et al.
Pubblicazione: (2025)

Multi-Step Prediction and Control of Hierarchical Emotion Distribution in Text-to-Speech Synthesis
di: Inoue, Sho, et al.
Pubblicazione: (2025)

EffectiveASR: A Single-Step Non-Autoregressive Mandarin Speech Recognition Architecture with High Accuracy and Inference Speed
di: Zhuang, Ziyang, et al.
Pubblicazione: (2024)

MTP-S2UT: Enhancing Speech-to-Speech Translation Quality with Multi-token Prediction
di: Wang, Jianjin, et al.
Pubblicazione: (2025)

SpeechRefiner: Towards Perceptual Quality Refinement for Front-End Algorithms
di: Li, Sirui, et al.
Pubblicazione: (2025)

Phone-purity Guided Discrete Tokens for Dysarthric Speech Recognition
di: Wang, Huimeng, et al.
Pubblicazione: (2025)

Word-Level Emotional Expression Control in Zero-Shot Text-to-Speech Synthesis
di: Wang, Tianrui, et al.
Pubblicazione: (2025)

Confidence-based Filtering for Speech Dataset Curation with Generative Speech Enhancement Using Discrete Tokens
di: Yamauchi, Kazuki, et al.
Pubblicazione: (2026)

Rethinking Discrete Speech Representation Tokens for Accent Generation
di: Zhong, Jinzuomu, et al.
Pubblicazione: (2026)

Progressive Residual Extraction based Pre-training for Speech Representation Learning
di: Wang, Tianrui, et al.
Pubblicazione: (2024)

Mobile Recording Device Recognition Based Cross-Scale and Multi-Level Representation Learning
di: Zeng, Chunyan, et al.
Pubblicazione: (2024)

Vision-Integrated High-Quality Neural Speech Coding
di: Guo, Yao, et al.
Pubblicazione: (2025)

Low-latency Speech Enhancement via Speech Token Generation
di: Xue, Huaying, et al.
Pubblicazione: (2023)

Unsupervised Multi-channel Speech Dereverberation via Diffusion
di: Wu, Yulun, et al.
Pubblicazione: (2025)