Imagen de Portada

Cross-Modal Denoising: A Novel Training Paradigm for Enhancing Speech-Image Retrieval

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Zhou, Lifeng, Li, Yuke, Deng, Rui, Yang, Yuting, Zhu, Haoqi
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language Sound Audio and Speech Processing
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Coarse-to-fine Alignment Makes Better Speech-image Retrieval
por: Zhou, Lifeng, et al.
Publicado: (2024)

BLR-MoE: Boosted Language-Routing Mixture of Experts for Domain-Robust Multilingual E2E ASR
por: Ma, Guodong, et al.
Publicado: (2025)

Zero-Shot End-to-End Spoken Language Understanding via Cross-Modal Selective Self-Training
por: He, Jianfeng, et al.
Publicado: (2023)

HarmoniFuse: A Component-Selective and Prompt-Adaptive Framework for Multi-Task Speech Language Modeling
por: Si, Yuke, et al.
Publicado: (2025)

Next Tokens Denoising for Speech Synthesis
por: Liu, Yanqing, et al.
Publicado: (2025)

Enhancing Multimodal Emotion Recognition through Multi-Granularity Cross-Modal Alignment
por: Wang, Xuechen, et al.
Publicado: (2024)

Cross-Utterance Conditioned VAE for Speech Generation
por: Li, Yang, et al.
Publicado: (2023)

CIF-T: A Novel CIF-based Transducer Architecture for Automatic Speech Recognition
por: Zhang, Tian-Hao, et al.
Publicado: (2023)

Improving Audio Codec-based Zero-Shot Text-to-Speech Synthesis with Multi-Modal Context and Large Language Model
por: Xue, Jinlong, et al.
Publicado: (2024)

Speech Denoising with Auditory Models
por: Saddler, Mark R., et al.
Publicado: (2020)

SEAL: Speech Embedding Alignment Learning for Speech Large Language Model with Retrieval-Augmented Generation
por: Sun, Chunyu, et al.
Publicado: (2025)

FleSpeech: Flexibly Controllable Speech Generation with Various Prompts
por: Li, Hanzhao, et al.
Publicado: (2025)

DiffAR: Denoising Diffusion Autoregressive Model for Raw Speech Waveform Generation
por: Benita, Roi, et al.
Publicado: (2023)

Closing the Modality Reasoning Gap for Speech Large Language Models
por: Wang, Chaoren, et al.
Publicado: (2026)

Scheduled Interleaved Speech-Text Training for Speech-to-Speech Translation with LLMs
por: Futami, Hayato, et al.
Publicado: (2025)

Teaching Audio Models to Reason: A Unified Framework for Source- and Layer-wise Distillation
por: Yang, Runyan, et al.
Publicado: (2025)

Transcript-Prompted Whisper with Dictionary-Enhanced Decoding for Japanese Speech Annotation
por: Hu, Rui, et al.
Publicado: (2025)

Cross-lingual Embedding Clustering for Hierarchical Softmax in Low-Resource Multilingual Speech Recognition
por: Yang, Zhengdong, et al.
Publicado: (2025)

Enhancing Generalization of Speech Large Language Models with Multi-Task Behavior Imitation and Speech-Text Interleaving
por: Xie, Jingran, et al.
Publicado: (2025)

The DKU System for Multi-Speaker Automatic Speech Recognition in MLC-SLM Challenge
por: Lin, Yuke, et al.
Publicado: (2025)

SSR: Alignment-Aware Modality Connector for Speech Language Models
por: Tan, Weiting, et al.
Publicado: (2024)

MTP-S2UT: Enhancing Speech-to-Speech Translation Quality with Multi-token Prediction
por: Wang, Jianjin, et al.
Publicado: (2025)

Speechless: Speech Instruction Training Without Speech for Low Resource Languages
por: Dao, Alan, et al.
Publicado: (2025)

SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models
por: Zhang, Xin, et al.
Publicado: (2023)

Representation Purification for End-to-End Speech Translation
por: Zhang, Chengwei, et al.
Publicado: (2024)

SimulS2S-LLM: Unlocking Simultaneous Inference of Speech LLMs for Speech-to-Speech Translation
por: Deng, Keqi, et al.
Publicado: (2025)

Retrieval-Augmented Speech Recognition Approach for Domain Challenges
por: Shen, Peng, et al.
Publicado: (2025)

Boosting Multi-Speaker Expressive Speech Synthesis with Semi-supervised Contrastive Learning
por: Zhu, Xinfa, et al.
Publicado: (2023)

The NeurIPS 2023 Machine Learning for Audio Workshop: Affective Audio Benchmarks and Novel Data
por: Baird, Alice, et al.
Publicado: (2024)

Enhancing Few-shot Keyword Spotting Performance through Pre-Trained Self-supervised Speech Models
por: Gok, Alican, et al.
Publicado: (2025)

Speech-to-Text Translation with Phoneme-Augmented CoT: Enhancing Cross-Lingual Transfer in Low-Resource Scenarios
por: Gállego, Gerard I., et al.
Publicado: (2025)

Self-Powered LLM Modality Expansion for Large Speech-Text Models
por: Yu, Tengfei, et al.
Publicado: (2024)

PolySpeech: Exploring Unified Multitask Speech Models for Competitiveness with Single-task Models
por: Yang, Runyan, et al.
Publicado: (2024)

Boosting Large Language Model for Speech Synthesis: An Empirical Study
por: Hao, Hongkun, et al.
Publicado: (2023)

Emphasis Rendering for Conversational Text-to-Speech with Multi-modal Multi-scale Context Modeling
por: Liu, Rui, et al.
Publicado: (2024)

SpeechAlign: Aligning Speech Generation to Human Preferences
por: Zhang, Dong, et al.
Publicado: (2024)

TI-ASU: Toward Robust Automatic Speech Understanding through Text-to-speech Imputation Against Missing Speech Modality
por: Feng, Tiantian, et al.
Publicado: (2024)

Generative Expressive Conversational Speech Synthesis
por: Liu, Rui, et al.
Publicado: (2024)

Enhancing Kurdish Text-to-Speech with Native Corpus Training: A High-Quality WaveGlow Vocoder Approach
por: Abdullah, Abdulhady Abas, et al.
Publicado: (2024)

Diffusion Gaussian Mixture Audio Denoise
por: Wang, Pu, et al.
Publicado: (2024)