Cover Image

Video2Music: Suitable Music Generation from Videos using an Affective Multimodal Transformer model

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Kang, Jaeyong, Poria, Soujanya, Herremans, Dorien
Format:	Preprint
Published:	2023
Subjects:	Sound Artificial Intelligence Audio and Speech Processing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Towards Unified Music Emotion Recognition across Dimensional and Categorical Models
by: Kang, Jaeyong, et al.
Published: (2025)

Are We There Yet? A Brief Survey of Music Emotion Prediction Datasets, Models and Outstanding Challenges
by: Kang, Jaeyong, et al.
Published: (2024)

Aligning Generative Music AI with Human Preferences: Methods and Challenges
by: Herremans, Dorien, et al.
Published: (2025)

BandCondiNet: Parallel Transformers-based Conditional Popular Music Generation with Multi-View Features
by: Luo, Jing, et al.
Published: (2024)

MelodySim: Measuring Melody-aware Music Similarity for Plagiarism Detection
by: Lu, Tongyu, et al.
Published: (2025)

Text2midi: Generating Symbolic Music from Captions
by: Bhandari, Keshav, et al.
Published: (2024)

ImprovNet -- Generating Controllable Musical Improvisations with Iterative Corruption Refinement
by: Bhandari, Keshav, et al.
Published: (2025)

Natural Language Processing Methods for Symbolic Music Generation and Information Retrieval: a Survey
by: Le, Dinh-Viet-Toan, et al.
Published: (2024)

A Domain-Knowledge-Inspired Music Embedding Space and a Novel Attention Mechanism for Symbolic Music Modeling
by: Guo, Z., et al.
Published: (2022)

MIRFLEX: Music Information Retrieval Feature Library for Extraction
by: Chopra, Anuradha, et al.
Published: (2024)

Text2midi-InferAlign: Improving Symbolic Music Generation with Inference-Time Alignment
by: Roy, Abhinaba, et al.
Published: (2025)

Mustango: Toward Controllable Text-to-Music Generation
by: Melechovsky, Jan, et al.
Published: (2023)

DiffRoll: Diffusion-based Generative Music Transcription with Unsupervised Pretraining Capability
by: Cheuk, Kin Wai, et al.
Published: (2022)

DART: Disentanglement of Accent and Speaker Representation in Multispeaker Text-to-Speech
by: Melechovsky, Jan, et al.
Published: (2024)

MMT-BERT: Chord-aware Symbolic Music Generation Based on Multitrack Music Transformer and MusicBERT
by: Zhu, Jinlong, et al.
Published: (2024)

Segment Transformer: AI-Generated Music Detection via Music Structural Analysis
by: Kim, Yumin, et al.
Published: (2025)

Controllable Video-to-Music Generation with Multiple Time-Varying Conditions
by: Wu, Junxian, et al.
Published: (2025)

GVMGen: A General Video-to-Music Generation Model with Hierarchical Attentions
by: Zuo, Heda, et al.
Published: (2025)

MMVA: Multimodal Matching Based on Valence and Arousal across Images, Music, and Musical Captions
by: Choi, Suhwan, et al.
Published: (2025)

The NES Video-Music Database: A Dataset of Symbolic Video Game Music Paired with Gameplay Videos
by: Cardoso, Igor, et al.
Published: (2024)

Cross-Modal Learning for Music-to-Music-Video Description Generation
by: Mao, Zhuoyuan, et al.
Published: (2025)

Leveraging LLM Embeddings for Cross Dataset Label Alignment and Zero Shot Music Emotion Prediction
by: Liu, Renhang, et al.
Published: (2024)

NarraScore: Bridging Visual Narrative and Musical Dynamics via Hierarchical Affective Control
by: Wen, Yufan, et al.
Published: (2026)

LadderSym: A Multimodal Interleaved Transformer for Music Practice Error Detection
by: Chou, Benjamin Shiue-Hal, et al.
Published: (2025)

Diff-V2M: A Hierarchical Conditional Diffusion Model with Explicit Rhythmic Modeling for Video-to-Music Generation
by: Ji, Shulei, et al.
Published: (2025)

MuPT: A Generative Symbolic Music Pretrained Transformer
by: Qu, Xingwei, et al.
Published: (2024)

Quality-aware Masked Diffusion Transformer for Enhanced Music Generation
by: Li, Chang, et al.
Published: (2024)

Detecting Music Performance Errors with Transformers
by: Chou, Benjamin Shiue-Hal, et al.
Published: (2025)

MusicFlow: Cascaded Flow Matching for Text Guided Music Generation
by: Prajwal, K R, et al.
Published: (2024)

Arabic Music Classification and Generation using Deep Learning
by: Elshaarawy, Mohamed, et al.
Published: (2024)

YNote: A Novel Music Notation for Fine-Tuning LLMs in Music Generation
by: Lu, Shao-Chien, et al.
Published: (2025)

A Novel Bi-LSTM And Transformer Architecture For Generating Tabla Music
by: Mayya, Roopa, et al.
Published: (2024)

Melody-Guided Music Generation
by: Wei, Shaopeng, et al.
Published: (2024)

From Sound to Sight: Towards AI-authored Music Videos
by: Vitasovic, Leo, et al.
Published: (2025)

Bob's Confetti: Phonetic Memorization Attacks in Music and Video Generation
by: Roh, Jaechul, et al.
Published: (2025)

The Music Maestro or The Musically Challenged, A Massive Music Evaluation Benchmark for Large Language Models
by: Li, Jiajia, et al.
Published: (2024)

Expressive Music Data Processing and Generation
by: Liu, Jingwei
Published: (2025)

NotaGen: Advancing Musicality in Symbolic Music Generation with Large Language Model Training Paradigms
by: Wang, Yashan, et al.
Published: (2025)

MusicLIME: Explainable Multimodal Music Understanding
by: Sotirou, Theodoros, et al.
Published: (2024)

MusiConGen: Rhythm and Chord Control for Transformer-Based Text-to-Music Generation
by: Lan, Yun-Han, et al.
Published: (2024)