Image de couverture de livre

Analysing the Language of Neural Audio Codecs

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Park, Joonyong, Takamichi, Shinnosuke, Chan, David M., Kando, Shunsuke, Saito, Yuki, Saruwatari, Hiroshi
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language Audio and Speech Processing
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Exploring the Effect of Segmentation and Vocabulary Size on Speech Tokenization for Speech Language Models
par: Kando, Shunsuke, et autres
Publié: (2025)

BigCodec: Pushing the Limits of Low-Bitrate Neural Speech Codec
par: Xin, Detai, et autres
Publié: (2024)

J-CHAT: Japanese Large-scale Spoken Dialogue Corpus for Spoken Dialogue Language Modeling
par: Nakata, Wataru, et autres
Publié: (2024)

Cross-Dialect Text-To-Speech in Pitch-Accent Language Incorporating Multi-Dialect Phoneme-Level BERT
par: Yamauchi, Kazuki, et autres
Publié: (2024)

Analytic Study of Text-Free Speech Synthesis for Raw Audio using a Self-Supervised Learning Model
par: Park, Joonyong, et autres
Publié: (2024)

MixedG2P-T5: G2P-free Speech Synthesis for Mixed-script texts using Speech Self-Supervised Learning and Language Model
par: Park, Joonyong, et autres
Publié: (2025)

RELATE: Subjective evaluation dataset for automatic evaluation of relevance between text and audio
par: Kanamori, Yusuke, et autres
Publié: (2025)

SaSLaW: Dialogue Speech Corpus with Audio-visual Egocentric Information Toward Environment-adaptive Dialogue Speech Synthesis
par: Take, Osamu, et autres
Publié: (2024)

Spatial Voice Conversion: Voice Conversion Preserving Spatial Information and Non-target Signals
par: Seki, Kentaro, et autres
Publié: (2024)

Building speech corpus with diverse voice characteristics for its prompt-based representation
par: Watanabe, Aya, et autres
Publié: (2024)

JVNV: A Corpus of Japanese Emotional Speech with Verbal Content and Nonverbal Expressions
par: Xin, Detai, et autres
Publié: (2023)

Active Learning for Text-to-Speech Synthesis with Informative Sample Collection
par: Seki, Kentaro, et autres
Publié: (2025)

Noise-Robust Voice Conversion by Conditional Denoising Training Using Latent Variables of Recording Quality and Environment
par: Igarashi, Takuto, et autres
Publié: (2024)

SRC4VC: Smartphone-Recorded Corpus for Voice Conversion Benchmark
par: Saito, Yuki, et autres
Publié: (2024)

AnimeScore: A Preference-Based Dataset and Framework for Evaluating Anime-Like Speech Style
par: Park, Joonyong, et autres
Publié: (2026)

A Pilot Study of GSLM-based Simulation of Foreign Accentuation Only Using Native Speech Corpora
par: Onda, Kentaro, et autres
Publié: (2024)

RALL-E: Robust Codec Language Modeling with Chain-of-Thought Prompting for Text-to-Speech Synthesis
par: Xin, Detai, et autres
Publié: (2024)

YODAS: Youtube-Oriented Dataset for Audio and Speech
par: Li, Xinjian, et autres
Publié: (2024)

Drum-to-Vocal Percussion Sound Conversion and Its Evaluation Methodology
par: Nobukawa, Rinka, et autres
Publié: (2025)

DNN-based ensemble singing voice synthesis with interactions between singers
par: Hyodo, Hiroaki, et autres
Publié: (2024)

SpeechBERTScore: Reference-Aware Automatic Evaluation of Speech Generation Leveraging NLP Evaluation Metrics
par: Saeki, Takaaki, et autres
Publié: (2024)

Codec2Vec: Self-Supervised Speech Representation Learning Using Neural Speech Codecs
par: Tseng, Wei-Cheng, et autres
Publié: (2025)

AudioBERTScore: Objective Evaluation of Environmental Sound Synthesis Based on Similarity of Audio embedding Sequences
par: Kishi, Minoru, et autres
Publié: (2025)

JaCappella Corpus: A Japanese a Cappella Vocal Ensemble Corpus
par: Nakamura, Tomohiko, et autres
Publié: (2022)

DialogueSidon: Recovering Full-Duplex Dialogue Tracks from In-the-Wild Dialogue Audio
par: Nakata, Wataru, et autres
Publié: (2026)

STACodec: Semantic Token Assignment for Balancing Acoustic Fidelity and Semantic Information in Audio Codecs
par: Zhang, Kaiyuan, et autres
Publié: (2026)

Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model
par: Ye, Zhen, et autres
Publié: (2024)

Pseudo-Autoregressive Neural Codec Language Models for Efficient Zero-Shot Text-to-Speech Synthesis
par: Yang, Yifan, et autres
Publié: (2025)

Sidon: Fast and Robust Open-Source Multilingual Speech Restoration for Large-scale Dataset Cleansing
par: Nakata, Wataru, et autres
Publié: (2025)

Geneses: Unified Generative Speech Enhancement and Separation
par: Asai, Kohei, et autres
Publié: (2026)

Causal Speech Enhancement with Predicting Semantics based on Quantized Self-supervised Learning Features
par: Tsunoo, Emiru, et autres
Publié: (2024)

EmoSSLSphere: Multilingual Emotional Speech Synthesis with Spherical Vectors and Discrete Speech Tokens
par: Park, Joonyong, et autres
Publié: (2025)

Improving Audio Codec-based Zero-Shot Text-to-Speech Synthesis with Multi-Modal Context and Large Language Model
par: Xue, Jinlong, et autres
Publié: (2024)

CLAIR-A: Leveraging Large Language Models to Judge Audio Captions
par: Wu, Tsung-Han, et autres
Publié: (2024)

Speaker-Conditioned Phrase Break Prediction for Text-to-Speech with Phoneme-Level Pre-trained Language Model
par: Yang, Dong, et autres
Publié: (2025)

Hyperbolic Embeddings for Order-Aware Classification of Audio Effect Chains
par: Wada, Aogu, et autres
Publié: (2025)

FuseCodec: Semantic-Contextual Fusion and Supervision for Neural Codecs
par: Ahasan, Md Mubtasim, et autres
Publié: (2025)

Bringing Interpretability to Neural Audio Codecs
par: Sadok, Samir, et autres
Publié: (2025)

Human-CLAP: Human-perception-based contrastive language-audio pretraining
par: Takano, Taisei, et autres
Publié: (2025)

VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers
par: Chen, Sanyuan, et autres
Publié: (2024)