Image de couverture de livre

Zero-Effort Image-to-Music Generation: An Interpretable RAG-based VLM Approach

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Zhao, Zijian, Jin, Dian, Zhou, Zijing
Format:	Preprint
Publié:	2025
Sujets:	Sound Artificial Intelligence Multimedia Audio and Speech Processing
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

MusicMagus: Zero-Shot Text-to-Music Editing via Diffusion Models
par: Zhang, Yixiao, et autres
Publié: (2024)

Leveraging Pre-Trained Autoencoders for Interpretable Prototype Learning of Music Audio
par: Alonso-Jiménez, Pablo, et autres
Publié: (2024)

GVMGen: A General Video-to-Music Generation Model with Hierarchical Attentions
par: Zuo, Heda, et autres
Publié: (2025)

Frechet Music Distance: A Metric For Generative Symbolic Music Evaluation
par: Retkowski, Jan, et autres
Publié: (2024)

MMVA: Multimodal Matching Based on Valence and Arousal across Images, Music, and Musical Captions
par: Choi, Suhwan, et autres
Publié: (2025)

MusER: Musical Element-Based Regularization for Generating Symbolic Music with Emotion
par: Ji, Shulei, et autres
Publié: (2023)

Towards Assessing Data Replication in Music Generation with Music Similarity Metrics on Raw Audio
par: Batlle-Roca, Roser, et autres
Publié: (2024)

Automatic Stage Lighting Control: Is it a Rule-Driven Process or Generative Task?
par: Zhao, Zijian, et autres
Publié: (2025)

GACA-DiT: Diffusion-based Dance-to-Music Generation with Genre-Adaptive Rhythm and Context-Aware Alignment
par: Wang, Jinting, et autres
Publié: (2025)

BandCondiNet: Parallel Transformers-based Conditional Popular Music Generation with Multi-View Features
par: Luo, Jing, et autres
Publié: (2024)

YuE: Scaling Open Foundation Models for Long-Form Music Generation
par: Yuan, Ruibin, et autres
Publié: (2025)

Controllable Video-to-Music Generation with Multiple Time-Varying Conditions
par: Wu, Junxian, et autres
Publié: (2025)

Analyzable Chain-of-Musical-Thought Prompting for High-Fidelity Music Generation
par: Lam, Max W. Y., et autres
Publié: (2025)

Exploring Classical Piano Performance Generation with Expressive Music Variational AutoEncoder
par: Luo, Jing, et autres
Publié: (2025)

A Survey of Foundation Models for Music Understanding
par: Li, Wenjun, et autres
Publié: (2024)

CoComposer: LLM Multi-agent Collaborative Music Composition
par: Xing, Peiwen, et autres
Publié: (2025)

From Sound to Sight: Towards AI-authored Music Videos
par: Vitasovic, Leo, et autres
Publié: (2025)

ONOTE: Benchmarking Omnimodal Notation Processing for Expert-level Music Intelligence
par: Ma, Menghe, et autres
Publié: (2026)

Cross-Modal Learning for Music-to-Music-Video Description Generation
par: Mao, Zhuoyuan, et autres
Publié: (2025)

SteerMusic: Enhanced Musical Consistency for Zero-shot Text-guided and Personalized Music Editing
par: Niu, Xinlei, et autres
Publié: (2025)

Generative AI for Music and Audio
par: Dong, Hao-Wen
Publié: (2024)

Dance-to-Music Generation with Encoder-based Textual Inversion
par: Li, Sifei, et autres
Publié: (2024)

MusRec: Zero-Shot Text-to-Music Editing via Rectified Flow and Diffusion Transformers
par: Boudaghi, Ali, et autres
Publié: (2025)

A Multi-Stream Fusion Approach with One-Class Learning for Audio-Visual Deepfake Detection
par: Lee, Kyungbok, et autres
Publié: (2024)

DeepResonance: Enhancing Multimodal Music Understanding via Music-centric Multi-way Instruction Tuning
par: Mao, Zhuoyuan, et autres
Publié: (2025)

Embedding Alignment in Code Generation for Audio
par: Kouteili, Sam, et autres
Publié: (2025)

Retrieval-Augmented Text-to-Audio Generation
par: Yuan, Yi, et autres
Publié: (2023)

Flexible Control in Symbolic Music Generation via Musical Metadata
par: Han, Sangjun, et autres
Publié: (2024)

LPIPS-AttnWav2Lip: Generic Audio-Driven lip synchronization for Talking Head Generation in the Wild
par: Chen, Zhipeng, et autres
Publié: (2026)

Unveiling Visual Biases in Audio-Visual Localization Benchmarks
par: Chen, Liangyu, et autres
Publié: (2024)

On the Design of Diffusion-based Neural Speech Codecs
par: Foti, Pietro, et autres
Publié: (2025)

Emotion-Aware Speech Generation with Character-Specific Voices for Comics
par: Qian, Zhiwen, et autres
Publié: (2025)

Towards Generating Diverse Audio Captions via Adversarial Training
par: Mei, Xinhao, et autres
Publié: (2022)

LAVCap: LLM-based Audio-Visual Captioning using Optimal Transport
par: Rho, Kyeongha, et autres
Publié: (2025)

Segment-Factorized Full-Song Generation on Symbolic Piano Music
par: Chen, Ping-Yi, et autres
Publié: (2025)

Disentangling Score Content and Performance Style for Joint Piano Rendering and Transcription
par: Zeng, Wei, et autres
Publié: (2025)

Listening and Seeing Again: Generative Error Correction for Audio-Visual Speech Recognition
par: Liu, Rui, et autres
Publié: (2025)

Leveraging Pre-trained AudioLDM for Sound Generation: A Benchmark Study
par: Yuan, Yi, et autres
Publié: (2023)

FreeAudio: Training-Free Timing Planning for Controllable Long-Form Text-to-Audio Generation
par: Jiang, Yuxuan, et autres
Publié: (2025)

Model-Guided Dual-Role Alignment for High-Fidelity Open-Domain Video-to-Audio Generation
par: Zhang, Kang, et autres
Publié: (2025)