Imagen de Portada

Braille-to-Speech Generator: Audio Generation Based on Joint Fine-Tuning of CLIP and Fastspeech2

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Xu, Chun, Sun, En-Wei
Formato:	Preprint
Publicado:	2024
Materias:	Sound Computation and Language Audio and Speech Processing
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

DeSTA2.5-Audio: Toward General-Purpose Large Audio Language Model with Self-Generated Cross-Modal Alignment
por: Lu, Ke-Han, et al.
Publicado: (2025)

Diffusion-Based Speech Enhancement with Joint Generative and Predictive Decoders
por: Shi, Hao, et al.
Publicado: (2023)

What Are They Doing? Joint Audio-Speech Co-Reasoning
por: Wang, Yingzhi, et al.
Publicado: (2024)

AzeroS: Extending LLM to Speech with Self-Generated Instruction-Free Tuning
por: Shao, Yiwen, et al.
Publicado: (2025)

Ming-UniAudio: Speech LLM for Joint Understanding, Generation and Editing with Unified Representation
por: Yan, Canxiang, et al.
Publicado: (2025)

Speech-Copilot: Leveraging Large Language Models for Speech Processing via Task Decomposition, Modularization, and Program Generation
por: Kuan, Chun-Yi, et al.
Publicado: (2024)

Cross-Utterance Conditioned VAE for Speech Generation
por: Li, Yang, et al.
Publicado: (2023)

WavMark: Watermarking for Audio Generation
por: Chen, Guangyu, et al.
Publicado: (2023)

AudioJudge: Understanding What Works in Large Audio Model Based Speech Evaluation
por: Manakul, Potsawee, et al.
Publicado: (2025)

SAKURA: On the Multi-hop Reasoning of Large Audio-Language Models Based on Speech and Audio Information
por: Yang, Chih-Kai, et al.
Publicado: (2025)

SpeechCLIP+: Self-supervised multi-task representation learning for speech via CLIP and speech-image data
por: Wang, Hsuan-Fu, et al.
Publicado: (2024)

Probing Audio-Generation Capabilities of Text-Based Language Models
por: Anbazhagan, Arjun Prasaath, et al.
Publicado: (2025)

Unified Pathological Speech Analysis with Prompt Tuning
por: Yang, Fei, et al.
Publicado: (2024)

Guided by the Plan: Enhancing Faithful Autoregressive Text-to-Audio Generation with Guided Decoding
por: Wang, Juncheng, et al.
Publicado: (2026)

Acquiring Pronunciation Knowledge from Transcribed Speech Audio via Multi-task Learning
por: Sun, Siqi, et al.
Publicado: (2024)

Baichuan-Audio: A Unified Framework for End-to-End Speech Interaction
por: Li, Tianpeng, et al.
Publicado: (2025)

XLAVS-R: Cross-Lingual Audio-Visual Speech Representation Learning for Noise-Robust Speech Perception
por: Han, HyoJung, et al.
Publicado: (2024)

DeSTA2: Developing Instruction-Following Speech Language Model Without Speech Instruction-Tuning Data
por: Lu, Ke-Han, et al.
Publicado: (2024)

YODAS: Youtube-Oriented Dataset for Audio and Speech
por: Li, Xinjian, et al.
Publicado: (2024)

Classification of Spontaneous and Scripted Speech for Multilingual Audio
por: Elisha, Shahar, et al.
Publicado: (2024)

SAGE: Spliced-Audio Generated Data for Enhancing Foundational Models in Low-Resource Arabic-English Code-Switched Speech Recognition
por: Farooq, Muhammad Umar, et al.
Publicado: (2025)

SpeechAlign: Aligning Speech Generation to Human Preferences
por: Zhang, Dong, et al.
Publicado: (2024)

Conversational Speech Recognition by Learning Audio-textual Cross-modal Contextual Representation
por: Wei, Kun, et al.
Publicado: (2023)

DQ-Whisper: Joint Distillation and Quantization for Efficient Multilingual Speech Recognition
por: Shao, Hang, et al.
Publicado: (2023)

SEAL: Speech Embedding Alignment Learning for Speech Large Language Model with Retrieval-Augmented Generation
por: Sun, Chunyu, et al.
Publicado: (2025)

Fine-Tuning Large Multimodal Models for Automatic Pronunciation Assessment
por: Wang, Ke, et al.
Publicado: (2025)

Joint Automatic Speech Recognition And Structure Learning For Better Speech Understanding
por: Hu, Jiliang, et al.
Publicado: (2025)

Beyond Classification: Towards Speech Emotion Reasoning with Multitask AudioLLMs
por: Zhang, Wenyu, et al.
Publicado: (2025)

Jointly Fine-Tuning "BERT-like" Self Supervised Models to Improve Multimodal Speech Emotion Recognition
por: Siriwardhana, Shamane, et al.
Publicado: (2020)

SpeechGPT-Gen: Scaling Chain-of-Information Speech Generation
por: Zhang, Dong, et al.
Publicado: (2024)

Lightweight Audio Segmentation for Long-form Speech Translation
por: Lee, Jaesong, et al.
Publicado: (2024)

USAD: Universal Speech and Audio Representation via Distillation
por: Chang, Heng-Jui, et al.
Publicado: (2025)

Exploring Fine-Tuning of Large Audio Language Models for Spoken Language Understanding under Limited Speech Data
por: Choi, Youngwon, et al.
Publicado: (2025)

Generative Expressive Conversational Speech Synthesis
por: Liu, Rui, et al.
Publicado: (2024)

AV2Wav: Diffusion-Based Re-synthesis from Continuous Self-supervised Features for Audio-Visual Speech Enhancement
por: Chou, Ju-Chieh, et al.
Publicado: (2023)

Improving Multilingual Speech Models on ML-SUPERB 2.0: Fine-tuning with Data Augmentation and LID-Aware CTC
por: Wang, Qingzheng, et al.
Publicado: (2025)

Generative Pre-trained Speech Language Model with Efficient Hierarchical Transformer
por: Zhu, Yongxin, et al.
Publicado: (2024)

FELLE: Autoregressive Speech Synthesis with Token-Wise Coarse-to-Fine Flow Matching
por: Wang, Hui, et al.
Publicado: (2025)

Can Large Audio-Language Models Truly Hear? Tackling Hallucinations with Multi-Task Assessment and Stepwise Audio Reasoning
por: Kuan, Chun-Yi, et al.
Publicado: (2024)

Generalized Multilingual Text-to-Speech Generation with Language-Aware Style Adaptation
por: Lou, Haowei, et al.
Publicado: (2025)