Imagen de Portada

Investigating Neural Audio Codecs for Speech Language Model-Based Speech Generation

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Li, Jiaqi, Wang, Dongmei, Wang, Xiaofei, Qian, Yao, Zhou, Long, Liu, Shujie, Yousefi, Midia, Li, Canrun, Tsai, Chung-Hsien, Xiao, Zhen, Liu, Yanqing, Chen, Junkun, Zhao, Sheng, Li, Jinyu, Wu, Zhizheng, Zeng, Michael
Formato:	Preprint
Publicado:	2024
Materias:	Sound Audio and Speech Processing
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Isochrony-Controlled Speech-to-Text Translation: A study on translating from Sino-Tibetan to Indo-European Languages
por: Yousefi, Midia, et al.
Publicado: (2024)

TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation
por: Le, Chenyang, et al.
Publicado: (2024)

Total-Duration-Aware Duration Modeling for Text-to-Speech Systems
por: Eskimez, Sefik Emre, et al.
Publicado: (2024)

DualCodec: A Low-Frame-Rate, Semantically-Enhanced Neural Audio Codec for Speech Generation
por: Li, Jiaqi, et al.
Publicado: (2025)

Laugh Now Cry Later: Controlling Time-Varying Emotional States of Flow-Matching-Based Zero-Shot Text-to-Speech
por: Wu, Haibin, et al.
Publicado: (2024)

CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations
por: Zhang, Leying, et al.
Publicado: (2024)

VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers
por: Chen, Sanyuan, et al.
Publicado: (2024)

TaDiCodec: Text-aware Diffusion Speech Tokenizer for Speech Language Modeling
por: Wang, Yuancheng, et al.
Publicado: (2025)

A Unified Neural Codec Language Model for Selective Editable Text to Speech Generation
por: Pei, Hanchen, et al.
Publicado: (2026)

SpeechX: Neural Codec Language Model as a Versatile Speech Transformer
por: Wang, Xiaofei, et al.
Publicado: (2023)

Pseudo-Autoregressive Neural Codec Language Models for Efficient Zero-Shot Text-to-Speech Synthesis
por: Yang, Yifan, et al.
Publicado: (2025)

Closing the Modality Reasoning Gap for Speech Large Language Models
por: Wang, Chaoren, et al.
Publicado: (2026)

Making Flow-Matching-Based Zero-Shot Text-to-Speech Laugh as You Like
por: Kanda, Naoyuki, et al.
Publicado: (2024)

Spectral Codecs: Improving Non-Autoregressive Speech Synthesis with Spectrogram-Based Audio Codecs
por: Langman, Ryan, et al.
Publicado: (2024)

Position: Towards Responsible Evaluation for Text-to-Speech
por: Yang, Yifan, et al.
Publicado: (2025)

E2 TTS: Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTS
por: Eskimez, Sefik Emre, et al.
Publicado: (2024)

Continuous Speech Tokens Makes LLMs Robust Multi-Modality Learners
por: Yuan, Ze, et al.
Publicado: (2024)

DiariST: Streaming Speech Translation with Speaker Diarization
por: Yang, Mu, et al.
Publicado: (2023)

Autoregressive Speech Synthesis without Vector Quantization
por: Meng, Lingwei, et al.
Publicado: (2024)

Single-Codec: Single-Codebook Speech Codec towards High-Performance Speech Generation
por: Li, Hanzhao, et al.
Publicado: (2024)

V2SFlow: Video-to-Speech Generation with Speech Decomposition and Rectified Flow
por: Choi, Jeongsoo, et al.
Publicado: (2024)

Boosting Large Language Model for Speech Synthesis: An Empirical Study
por: Hao, Hongkun, et al.
Publicado: (2023)

NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models
por: Ju, Zeqian, et al.
Publicado: (2024)

ESPnet-Codec: Comprehensive Training and Evaluation of Neural Codecs for Audio, Music, and Speech
por: Shi, Jiatong, et al.
Publicado: (2024)

AlignFormer: Modality Matching Can Achieve Better Zero-shot Instruction-Following Speech-LLM
por: Fan, Ruchao, et al.
Publicado: (2024)

MSR-Codec: A Low-Bitrate Multi-Stream Residual Codec for High-Fidelity Speech Generation with Information Disentanglement
por: Li, Jingyu, et al.
Publicado: (2025)

Next Tokens Denoising for Speech Synthesis
por: Liu, Yanqing, et al.
Publicado: (2025)

Speech Separation using Neural Audio Codecs with Embedding Loss
por: Yip, Jia Qi, et al.
Publicado: (2024)

Debatts: Zero-Shot Debating Text-to-Speech Synthesis
por: Huang, Yiqiao, et al.
Publicado: (2024)

Profile-Error-Tolerant Target-Speaker Voice Activity Detection
por: Wang, Dongmei, et al.
Publicado: (2023)

Soft Language Identification for Language-Agnostic Many-to-One End-to-End Speech Translation
por: Wang, Peidong, et al.
Publicado: (2024)

PURE Codec: Progressive Unfolding of Residual Entropy for Speech Codec Learning
por: Shi, Jiatong, et al.
Publicado: (2025)

VALL-E R: Robust and Efficient Zero-Shot Text-to-Speech Synthesis via Monotonic Alignment
por: Han, Bing, et al.
Publicado: (2024)

Amphion: An Open-Source Audio, Music and Speech Generation Toolkit
por: Zhang, Xueyao, et al.
Publicado: (2023)

Advanced Long-Content Speech Recognition With Factorized Neural Transducer
por: Gong, Xun, et al.
Publicado: (2024)

Interleaved Speech-Text Language Models for Simple Streaming Text-to-Speech Synthesis
por: Yang, Yifan, et al.
Publicado: (2024)

Audio Codec Augmentation for Robust Collaborative Watermarking of Speech Synthesis
por: Juvela, Lauri, et al.
Publicado: (2024)

LongCat-Audio-Codec: An Audio Tokenizer and Detokenizer Solution Designed for Speech Large Language Models
por: Zhao, Xiaohan, et al.
Publicado: (2025)

StreamMel: Real-Time Zero-shot Text-to-Speech via Interleaved Continuous Autoregressive Modeling
por: Wang, Hui, et al.
Publicado: (2025)

SpeechLLM-as-Judges: Towards General and Interpretable Speech Quality Evaluation
por: Wang, Hui, et al.
Publicado: (2025)