Image de couverture de livre

Enhancing Retrieval-Augmented Audio Captioning with Generation-Assisted Multimodal Querying and Progressive Learning

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Changin, Choi, Sungjun, Lim, Wonjong, Rhee
Format:	Preprint
Publié:	2024
Sujets:	Sound Artificial Intelligence Audio and Speech Processing
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

DRCap: Decoding CLAP Latents with Retrieval-Augmented Generation for Zero-shot Audio Captioning
par: Li, Xiquan, et autres
Publié: (2024)

RECAP: Retrieval-Augmented Audio Captioning
par: Ghosh, Sreyan, et autres
Publié: (2023)

Expanding on EnCLAP with Auxiliary Retrieval Model for Automated Audio Captioning
par: Kim, Jaeyeon, et autres
Publié: (2024)

Retrieval-Augmented Audio Deepfake Detection
par: Kang, Zuheng, et autres
Publié: (2024)

Retrieval-Augmented Text-to-Audio Generation
par: Yuan, Yi, et autres
Publié: (2023)

Performance Improvement of Language-Queried Audio Source Separation Based on Caption Augmentation From Large Language Models for DCASE Challenge 2024 Task 9
par: Lee, Do Hyun, et autres
Publié: (2024)

FusionAudio-1.2M: Towards Fine-grained Audio Captioning with Multimodal Contextual Fusion
par: Chen, Shunian, et autres
Publié: (2025)

WavRAG: Audio-Integrated Retrieval Augmented Generation for Spoken Dialogue Models
par: Chen, Yifu, et autres
Publié: (2025)

EnCLAP: Combining Neural Audio Codec and Audio-Text Joint Embedding for Automated Audio Captioning
par: Kim, Jaeyeon, et autres
Publié: (2024)

Evaluating Hallucinations in Audio-Visual Multimodal LLMs with Spoken Queries under Diverse Acoustic Conditions
par: Park, Hansol, et autres
Publié: (2025)

Towards Generating Diverse Audio Captions via Adversarial Training
par: Mei, Xinhao, et autres
Publié: (2022)

EnCLAP++: Analyzing the EnCLAP Framework for Optimizing Automated Audio Captioning Performance
par: Kim, Jaeyeon, et autres
Publié: (2024)

MMVA: Multimodal Matching Based on Valence and Arousal across Images, Music, and Musical Captions
par: Choi, Suhwan, et autres
Publié: (2025)

PodEval: A Multimodal Evaluation Framework for Podcast Audio Generation
par: Xiao, Yujia, et autres
Publié: (2025)

BrewCLIP: A Bifurcated Representation Learning Framework for Audio-Visual Retrieval
par: Lu, Zhenyu, et autres
Publié: (2024)

Task-Specific Audio Coding for Machines: Machine-Learned Latent Features Are Codes for That Machine
par: Kuznetsova, Anastasia, et autres
Publié: (2025)

Augmentation through Laundering Attacks for Audio Spoof Detection
par: Ali, Hashim, et autres
Publié: (2024)

ModalityMirror: Improving Audio Classification in Modality Heterogeneity Federated Learning with Multimodal Distillation
par: Feng, Tiantian, et autres
Publié: (2024)

LAVCap: LLM-based Audio-Visual Captioning using Optimal Transport
par: Rho, Kyeongha, et autres
Publié: (2025)

Practical and Reproducible Symbolic Music Generation by Large Language Models with Structural Embeddings
par: Rhyu, Seungyeon, et autres
Publié: (2024)

Revisiting Deep Audio-Text Retrieval Through the Lens of Transportation
par: Luong, Manh, et autres
Publié: (2024)

Audio Codec Augmentation for Robust Collaborative Watermarking of Speech Synthesis
par: Juvela, Lauri, et autres
Publié: (2024)

Audio-Guided Fusion Techniques for Multimodal Emotion Analysis
par: Shi, Pujin, et autres
Publié: (2024)

GEC-RAG: Improving Generative Error Correction via Retrieval-Augmented Generation for Automatic Speech Recognition Systems
par: Robatian, Amin, et autres
Publié: (2025)

AudioTurbo: Fast Text-to-Audio Generation with Rectified Diffusion
par: Zhao, Junqi, et autres
Publié: (2025)

DreamAudio: Customized Text-to-Audio Generation with Diffusion Models
par: Yuan, Yi, et autres
Publié: (2025)

PIAST: A Multimodal Piano Dataset with Audio, Symbolic and Text
par: Bang, Hayeon, et autres
Publié: (2024)

UniverSR: Unified and Versatile Audio Super-Resolution via Vocoder-Free Flow Matching
par: Choi, Woongjib, et autres
Publié: (2025)

Text Prompt is Not Enough: Sound Event Enhanced Prompt Adapter for Target Style Audio Generation
par: Xiong, Chenxu, et autres
Publié: (2024)

MixAssist: An Audio-Language Dataset for Co-Creative AI Assistance in Music Mixing
par: Clemens, Michael, et autres
Publié: (2025)

SLAM-AAC: Enhancing Audio Captioning with Paraphrasing Augmentation and CLAP-Refine through LLMs
par: Chen, Wenxi, et autres
Publié: (2024)

Learning Frame-Wise Emotion Intensity for Audio-Driven Talking-Head Generation
par: Xu, Jingyi, et autres
Publié: (2024)

Audio Mamba: Bidirectional State Space Model for Audio Representation Learning
par: Erol, Mehmet Hamza, et autres
Publié: (2024)

ATRI: Mitigating Multilingual Audio Text Retrieval Inconsistencies by Reducing Data Distribution Errors
par: Yin, Yuguo, et autres
Publié: (2025)

PhaseCoder: Microphone Geometry-Agnostic Spatial Audio Understanding for Multimodal LLMs
par: Dementyev, Artem, et autres
Publié: (2026)

From Contrast to Commonality: Audio Commonality Captioning for Enhanced Audio-Text Cross-modal Understanding in Multimodal LLMs
par: Jia, Yuhang, et autres
Publié: (2025)

CoLLAP: Contrastive Long-form Language-Audio Pretraining with Musical Temporal Structure Augmentation
par: Wu, Junda, et autres
Publié: (2024)

Audio Explanation Synthesis with Generative Foundation Models
par: Akman, Alican, et autres
Publié: (2024)

ViSAGe: Video-to-Spatial Audio Generation
par: Kim, Jaeyeon, et autres
Publié: (2025)

Multimodal Laryngoscopic Video Analysis for Assisted Diagnosis of Vocal Fold Paralysis
par: Zhang, Yucong, et autres
Publié: (2024)