Imagen de Portada

A Survey on Music Generation from Single-Modal, Cross-Modal, and Multi-Modal Perspectives

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Li, Shuyu, Ji, Shulei, Wang, Zihao, Wu, Songruoyao, Yu, Jiaxing, Zhang, Kejun
Formato:	Preprint
Publicado:	2025
Materias:	Sound Artificial Intelligence Multimedia
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

A Comprehensive Survey on Generative AI for Video-to-Music Generation
por: Ji, Shulei, et al.
Publicado: (2025)

Diff-V2M: A Hierarchical Conditional Diffusion Model with Explicit Rhythmic Modeling for Video-to-Music Generation
por: Ji, Shulei, et al.
Publicado: (2025)

Cross-Modal Learning for Music-to-Music-Video Description Generation
por: Mao, Zhuoyuan, et al.
Publicado: (2025)

EigeNet: Geometry-Informed Multi-Modal Learning for Few-shot Novel View RIR Prediction
por: Jing, Chong, et al.
Publicado: (2026)

MusER: Musical Element-Based Regularization for Generating Symbolic Music with Emotion
por: Ji, Shulei, et al.
Publicado: (2023)

AMB-DSGDN: Adaptive Modality-Balanced Dynamic Semantic Graph Differential Network for Multimodal Emotion Recognition
por: Wang, Yunsheng, et al.
Publicado: (2026)

FISHER: A Foundation Model for Multi-Modal Industrial Signal Comprehensive Representation
por: Fan, Pingyi, et al.
Publicado: (2025)

Sync-TVA: A Graph-Attention Framework for Multimodal Emotion Recognition with Cross-Modal Fusion
por: Deng, Zeyu, et al.
Publicado: (2025)

A Survey on Cross-Modal Interaction Between Music and Multimodal Data
por: Li, Sifei, et al.
Publicado: (2025)

Early Joint Learning of Emotion Information Makes MultiModal Model Understand You Better
por: Ge, Mengying, et al.
Publicado: (2024)

Sequence-to-Sequence Multi-Modal Speech In-Painting
por: Elyaderani, Mahsa Kadkhodaei, et al.
Publicado: (2024)

Enhancing Modal Fusion by Alignment and Label Matching for Multimodal Emotion Recognition
por: Li, Qifei, et al.
Publicado: (2024)

Whispering LLaMA: A Cross-Modal Generative Error Correction Framework for Speech Recognition
por: Radhakrishnan, Srijith, et al.
Publicado: (2023)

Music Arena: Live Evaluation for Text-to-Music
por: Kim, Yonghyun, et al.
Publicado: (2025)

MusicSwarm: Biologically Inspired Intelligence for Music Composition
por: Buehler, Markus J.
Publicado: (2025)

Amadeus: Autoregressive Model with Bidirectional Attribute Modelling for Symbolic Music
por: Su, Hongju, et al.
Publicado: (2025)

Robust Multi-Modal Speech In-Painting: A Sequence-to-Sequence Approach
por: Elyaderani, Mahsa Kadkhodaei, et al.
Publicado: (2024)

DiFlowDubber: Discrete Flow Matching for Automated Video Dubbing via Cross-Modal Alignment and Synchronization
por: Nguyen, Ngoc-Son, et al.
Publicado: (2026)

Memo2496: Expert-Annotated Dataset and Dual-View Adaptive Framework for Music Emotion Recognition
por: Li, Qilin, et al.
Publicado: (2025)

A Survey of Foundation Models for Music Understanding
por: Li, Wenjun, et al.
Publicado: (2024)

Seeing Sound, Hearing Sight: Uncovering Modality Bias and Conflict of AI models in Sound Localization
por: Jia, Yanhao, et al.
Publicado: (2025)

Iterative Residual Cross-Attention Mechanism: An Integrated Approach for Audio-Visual Navigation Tasks
por: Zhang, Hailong, et al.
Publicado: (2025)

UniSRCodec: Unified and Low-Bitrate Single Codebook Codec with Sub-Band Reconstruction
por: Zhang, Zhisheng, et al.
Publicado: (2026)

MotionBeat: Motion-Aligned Music Representation via Embodied Contrastive Learning and Bar-Equivariant Contact-Aware Encoding
por: Wang, Xuanchen, et al.
Publicado: (2025)

MusicAIR: A Multimodal AI Music Generation Framework Powered by an Algorithm-Driven Core
por: Liao, Callie C., et al.
Publicado: (2025)

Contextual Cross-Modal Attention for Audio-Visual Deepfake Detection and Localization
por: Katamneni, Vinaya Sree, et al.
Publicado: (2024)

Music for All: Representational Bias and Cross-Cultural Adaptability of Music Generation Models
por: Mehta, Atharva, et al.
Publicado: (2025)

Start from Video-Music Retrieval: An Inter-Intra Modal Loss for Cross Modal Retrieval
por: Chen, Zeyu, et al.
Publicado: (2024)

Let the Model Learn to Feel: Mode-Guided Tonality Injection for Symbolic Music Emotion Recognition
por: Xia, Haiying, et al.
Publicado: (2025)

YuE: Scaling Open Foundation Models for Long-Form Music Generation
por: Yuan, Ruibin, et al.
Publicado: (2025)

MTAVG-Bench 2.0: Diagnosing Failure Modes of Cinematic Expressiveness in Multi-Talker Audio-Video Generation
por: Li, Haitian, et al.
Publicado: (2026)

SongGLM: Lyric-to-Melody Generation with 2D Alignment Encoding and Multi-Task Pre-Training
por: Yu, Jiaxing, et al.
Publicado: (2024)

Controllable Video-to-Music Generation with Multiple Time-Varying Conditions
por: Wu, Junxian, et al.
Publicado: (2025)

Live Music Diffusion Models: Efficient Fine-Tuning and Post-Training of Interactive Diffusion Music Generators
por: Novack, Zachary, et al.
Publicado: (2026)

HDA-SELD: Hierarchical Cross-Modal Distillation with Multi-Level Data Augmentation for Low-Resource Audio-Visual Sound Event Localization and Detection
por: Wang, Qing, et al.
Publicado: (2025)

SynthGuard: An Open Platform for Detecting AI-Generated Multimedia with Multimodal LLMs
por: Desai, Shail, et al.
Publicado: (2025)

MetaBGM: Dynamic Soundtrack Transformation For Continuous Multi-Scene Experiences With Ambient Awareness And Personalization
por: Liu, Haoxuan, et al.
Publicado: (2024)

GVMGen: A General Video-to-Music Generation Model with Hierarchical Attentions
por: Zuo, Heda, et al.
Publicado: (2025)

Frechet Music Distance: A Metric For Generative Symbolic Music Evaluation
por: Retkowski, Jan, et al.
Publicado: (2024)

GACA-DiT: Diffusion-based Dance-to-Music Generation with Genre-Adaptive Rhythm and Context-Aware Alignment
por: Wang, Jinting, et al.
Publicado: (2025)