Copertina

NEST-RQ: Next Token Prediction for Speech Self-Supervised Pre-Training

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Han, Minglun, Bai, Ye, Shen, Chen, Huang, Youjia, Huang, Mingkun, Lin, Zehua, Dong, Linhao, Lu, Lu, Wang, Yuxuan
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Audio and Speech Processing Artificial Intelligence Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Self-Supervised Singing Voice Pre-Training towards Speech-to-Singing Conversion
di: Li, Ruiqi, et al.
Pubblicazione: (2024)

OMAR-RQ: Open Music Audio Representation Model Trained with Multi-Feature Masked Token Prediction
di: Alonso-Jiménez, Pablo, et al.
Pubblicazione: (2025)

BiRQ: Bi-Level Self-Labeling Random Quantization for Self-Supervised Speech Recognition
di: Jiang, Liuyuan, et al.
Pubblicazione: (2025)

NEST: Self-supervised Fast Conformer as All-purpose Seasoning to Speech Processing Tasks
di: Huang, He, et al.
Pubblicazione: (2024)

Seed-ASR: Understanding Diverse Speech and Contexts with LLM-based Speech Recognition
di: Bai, Ye, et al.
Pubblicazione: (2024)

Comparison of Self-Supervised Speech Pre-Training Methods on Flemish Dutch
di: Poncelet, Jakob, et al.
Pubblicazione: (2021)

M-BEST-RQ: A Multi-Channel Speech Foundation Model for Smart Glasses
di: Yang, Yufeng, et al.
Pubblicazione: (2024)

SA-SOT: Speaker-Aware Serialized Output Training for Multi-Talker ASR
di: Fan, Zhiyun, et al.
Pubblicazione: (2024)

Exploring Prediction Targets in Masked Pre-Training for Speech Foundation Models
di: Chen, Li-Wei, et al.
Pubblicazione: (2024)

SA-WavLM: Speaker-Aware Self-Supervised Pre-training for Mixture Speech
di: Lin, Jingru, et al.
Pubblicazione: (2024)

Adaptive Federated Fine-Tuning of Self-Supervised Speech Representations
di: Guo, Xin, et al.
Pubblicazione: (2026)

Speech Token Prediction via Compressed-to-fine Language Modeling for Speech Generation
di: Liu, Wenrui, et al.
Pubblicazione: (2025)

Comparing Self-Supervised Learning Models Pre-Trained on Human Speech and Animal Vocalizations for Bioacoustics Processing
di: Sarkar, Eklavya, et al.
Pubblicazione: (2025)

Text-guided HuBERT: Self-Supervised Speech Pre-training via Generative Adversarial Networks
di: Ma, Duo, et al.
Pubblicazione: (2024)

Investigating Zero-Shot Generalizability on Mandarin-English Code-Switched ASR and Speech-to-text Translation of Recent Foundation Models with Self-Supervision and Weak Supervision
di: Yang, Chih-Kai, et al.
Pubblicazione: (2023)

A Study of Data Selection Strategies for Pre-training Self-Supervised Speech Models
di: Whetten, Ryan, et al.
Pubblicazione: (2026)

Multilingual Zero Resource Speech Recognition Base on Self-Supervise Pre-Trained Acoustic Models
di: Wang, Haoyu, et al.
Pubblicazione: (2022)

Next Tokens Denoising for Speech Synthesis
di: Liu, Yanqing, et al.
Pubblicazione: (2025)

Accent Normalization Using Self-Supervised Discrete Tokens with Non-Parallel Data
di: Bai, Qibing, et al.
Pubblicazione: (2025)

Low-latency Speech Enhancement via Speech Token Generation
di: Xue, Huaying, et al.
Pubblicazione: (2023)

Rethinking Mamba in Speech Processing by Self-Supervised Models
di: Zhang, Xiangyu, et al.
Pubblicazione: (2024)

Comparing Unsupervised and Supervised Semantic Speech Tokens: A Case Study of Child ASR
di: Shi, Mohan, et al.
Pubblicazione: (2025)

HYFuse: Aligning Heterogeneous Speech Pre-Trained Representations in Hyperbolic Space for Speech Emotion Recognition
di: Phukan, Orchid Chetia, et al.
Pubblicazione: (2025)

Self-Supervised Speech Quality Assessment (S3QA): Leveraging Speech Foundation Models for a Scalable Speech Quality Metric
di: Ogg, Mattson, et al.
Pubblicazione: (2025)

Emotion-Coherent Speech Data Augmentation and Self-Supervised Contrastive Style Training for Enhancing Kids's Story Speech Synthesis
di: Chung, Raymond
Pubblicazione: (2026)

Discrete Diffusion for Generative Modeling of Text-Aligned Speech Tokens
di: Ku, Pin-Jui, et al.
Pubblicazione: (2025)

Hybrid Pruning: In-Situ Compression of Self-Supervised Speech Models for Speaker Verification and Anti-Spoofing
di: Peng, Junyi, et al.
Pubblicazione: (2025)

Ambisonizer: Neural Upmixing as Spherical Harmonics Generation
di: Zang, Yongyi, et al.
Pubblicazione: (2024)

Speaker-Conditioned Phrase Break Prediction for Text-to-Speech with Phoneme-Level Pre-trained Language Model
di: Yang, Dong, et al.
Pubblicazione: (2025)

Analysis of Self-Supervised Speech Models on Children's Speech and Infant Vocalizations
di: Li, Jialu, et al.
Pubblicazione: (2024)

Multilingual Speech Recognition Using Discrete Tokens with a Two-step Training Strategy
di: Li, Zehan, et al.
Pubblicazione: (2025)

Large Language Model Guided Decoding for Self-Supervised Speech Recognition
di: Cohen, Eyal, et al.
Pubblicazione: (2025)

Generative Audio Language Modeling with Continuous-valued Tokens and Masked Next-Token Prediction
di: Yang, Shu-wen, et al.
Pubblicazione: (2025)

CodeSep: Low-Bitrate Codec-Driven Speech Separation with Base-Token Disentanglement and Auxiliary-Token Serial Prediction
di: Du, Hui-Peng, et al.
Pubblicazione: (2026)

Textless Streaming Speech-to-Speech Translation using Semantic Speech Tokens
di: Zhao, Jinzheng, et al.
Pubblicazione: (2024)

Acoustic BPE for Speech Generation with Discrete Tokens
di: Shen, Feiyu, et al.
Pubblicazione: (2023)

SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models
di: Zhang, Xin, et al.
Pubblicazione: (2023)

Cyclostationarity Analysis as a Complement to Self-Supervised Representations for Speech Deepfake Detection
di: Hanilçi, Cemal, et al.
Pubblicazione: (2026)

Synergistic Effects of Knowledge Distillation and Structured Pruning for Self-Supervised Speech Models
di: C, Shiva Kumar, et al.
Pubblicazione: (2025)

Fast Word Error Rate Estimation Using Self-Supervised Representations for Speech and Text
di: Park, Chanho, et al.
Pubblicazione: (2023)