Image de couverture de livre

Chunk Based Speech Pre-training with High Resolution Finite Scalar Quantization

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Tang, Yun, Tseng, Cindy
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language Sound Audio and Speech Processing
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Scaling Speech-Text Pre-training with Synthetic Interleaved Data
par: Zeng, Aohan, et autres
Publié: (2024)

Generative Pre-trained Speech Language Model with Efficient Hierarchical Transformer
par: Zhu, Yongxin, et autres
Publié: (2024)

Robust and Efficient Autoregressive Speech Synthesis with Dynamic Chunk-wise Prediction Policy
par: Li, Bohan, et autres
Publié: (2025)

UniWav: Towards Unified Pre-training for Speech Representation Learning and Generation
par: Liu, Alexander H., et autres
Publié: (2025)

BLSP-KD: Bootstrapping Language-Speech Pre-training via Knowledge Distillation
par: Wang, Chen, et autres
Publié: (2024)

Bridging Speech and Text: Enhancing ASR with Pinyin-to-Character Pre-training in LLMs
par: Yuhang, Yang, et autres
Publié: (2024)

Fine-grained Speech Sentiment Analysis in Chinese Psychological Support Hotlines Based on Large-scale Pre-trained Model
par: Chen, Zhonglong, et autres
Publié: (2024)

BLSP: Bootstrapping Language-Speech Pre-training via Behavior Alignment of Continuation Writing
par: Wang, Chen, et autres
Publié: (2023)

SSCFormer: Push the Limit of Chunk-wise Conformer for Streaming ASR Using Sequentially Sampled Chunks and Chunked Causal Convolution
par: Wang, Fangyuan, et autres
Publié: (2022)

Attentive Merging of Hidden Embeddings from Pre-trained Speech Model for Anti-spoofing Detection
par: Pan, Zihan, et autres
Publié: (2024)

MFSN: Multi-perspective Fusion Search Network For Pre-training Knowledge in Speech Emotion Recognition
par: Sun, Haiyang, et autres
Publié: (2023)

Autoregressive Speech Synthesis without Vector Quantization
par: Meng, Lingwei, et autres
Publié: (2024)

Zero-Shot vs. Few-Shot Multi-Speaker TTS Using Pre-trained Czech SpeechT5 Model
par: Lehečka, Jan, et autres
Publié: (2024)

Low-Resourced Speech Recognition for Iu Mien Language via Weakly-Supervised Phoneme-based Multilingual Pre-training
par: Dong, Lukuan, et autres
Publié: (2024)

Generative Pre-training for Speech with Flow Matching
par: Liu, Alexander H., et autres
Publié: (2023)

SimpleSpeech 2: Towards Simple and Efficient Text-to-Speech with Flow-based Scalar Latent Transformer Diffusion Models
par: Yang, Dongchao, et autres
Publié: (2024)

Multilingual Zero Resource Speech Recognition Base on Self-Supervise Pre-Trained Acoustic Models
par: Wang, Haoyu, et autres
Publié: (2022)

DQ-Data2vec: Decoupling Quantization for Multilingual Speech Recognition
par: Shao, Qijie, et autres
Publié: (2025)

DQ-Whisper: Joint Distillation and Quantization for Efficient Multilingual Speech Recognition
par: Shao, Hang, et autres
Publié: (2023)

Loquacious Set: 25,000 Hours of Transcribed and Diverse English Speech Recognition Data for Research and Commercial Use
par: Parcollet, Titouan, et autres
Publié: (2025)

High-Fidelity Simultaneous Speech-To-Speech Translation
par: Labiausse, Tom, et autres
Publié: (2025)

MFLA: Monotonic Finite Look-ahead Attention for Streaming Speech Recognition
par: Xia, Yinfeng, et autres
Publié: (2025)

TASTE: Text-Aligned Speech Tokenization and Embedding for Spoken Language Modeling
par: Tseng, Liang-Hsuan, et autres
Publié: (2025)

BiRQ: Bi-Level Self-Labeling Random Quantization for Self-Supervised Speech Recognition
par: Jiang, Liuyuan, et autres
Publié: (2025)

Are Transformers in Pre-trained LM A Good ASR Encoder? An Empirical Study
par: An, Keyu, et autres
Publié: (2024)

Transducer Consistency Regularization for Speech to Text Applications
par: Tseng, Cindy, et autres
Publié: (2024)

GenDistiller: Distilling Pre-trained Language Models based on an Autoregressive Generative Model
par: Gao, Yingying, et autres
Publié: (2024)

ChunkFormer: Masked Chunking Conformer For Long-Form Speech Transcription
par: Le, Khanh, et autres
Publié: (2025)

Effective Context in Neural Speech Models
par: Meng, Yen, et autres
Publié: (2025)

Exploring Effective Distillation of Self-Supervised Speech Models for Automatic Speech Recognition
par: Wang, Yujin, et autres
Publié: (2022)

Enhancing Few-shot Keyword Spotting Performance through Pre-Trained Self-supervised Speech Models
par: Gok, Alican, et autres
Publié: (2025)

InSerter: Speech Instruction Following with Unsupervised Interleaved Pre-training
par: Wang, Dingdong, et autres
Publié: (2025)

Speaker Disentanglement of Speech Pre-trained Model Based on Interpretability
par: Zhu, Xiaoxu, et autres
Publié: (2025)

Spectrogram Patch Codec: A 2D Block-Quantized VQ-VAE and HiFi-GAN for Neural Speech Coding
par: Chary, Luis Felipe, et autres
Publié: (2025)

FASA: a Flexible and Automatic Speech Aligner for Extracting High-quality Aligned Children Speech Data
par: Liu, Dancheng, et autres
Publié: (2024)

Improving Audio-Visual Speech Recognition by Lip-Subword Correlation Based Visual Pre-training and Cross-Modal Fusion Encoder
par: Dai, Yusheng, et autres
Publié: (2023)

From Statistical Methods to Pre-Trained Models; A Survey on Automatic Speech Recognition for Resource Scarce Urdu Language
par: Sharif, Muhammad, et autres
Publié: (2024)

Low Frame-rate Speech Codec: a Codec Designed for Fast High-quality Speech LLM Training and Inference
par: Casanova, Edresson, et autres
Publié: (2024)

Frontend Token Enhancement for Token-Based Speech Recognition
par: Ashihara, Takanori, et autres
Publié: (2026)

Probing for Phonology in Self-Supervised Speech Representations: A Case Study on Accent Perception
par: Venkateswaran, Nitin, et autres
Publié: (2025)