Image de couverture de livre

VidMusician: Video-to-Music Generation with Semantic-Rhythmic Alignment via Hierarchical Visual Features

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Li, Sifei, Yang, Binxin, Yin, Chunji, Sun, Chong, Zhang, Yuxin, Dong, Weiming, Li, Chen
Format:	Preprint
Publié:	2024
Sujets:	Sound Audio and Speech Processing
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Music Style Transfer with Time-Varying Inversion of Diffusion Models
par: Li, Sifei, et autres
Publié: (2024)

Dance-to-Music Generation with Encoder-based Textual Inversion
par: Li, Sifei, et autres
Publié: (2024)

MuVi: Video-to-Music Generation with Semantic Alignment and Rhythmic Synchronization
par: Li, Ruiqi, et autres
Publié: (2024)

Rhythmic Foley: A Framework For Seamless Audio-Visual Alignment In Video-to-Audio Synthesis
par: Huang, Zhiqi, et autres
Publié: (2024)

A Survey on Cross-Modal Interaction Between Music and Multimodal Data
par: Li, Sifei, et autres
Publié: (2025)

Diff-V2M: A Hierarchical Conditional Diffusion Model with Explicit Rhythmic Modeling for Video-to-Music Generation
par: Ji, Shulei, et autres
Publié: (2025)

VidTune: Creating Video Soundtracks with Generative Music and Contextual Thumbnails
par: Huh, Mina, et autres
Publié: (2026)

TinyMusician: On-Device Music Generation with Knowledge Distillation and Mixed Precision Quantization
par: Wang, Hainan, et autres
Publié: (2025)

STA-V2A: Video-to-Audio Generation with Semantic and Temporal Alignment
par: Ren, Yong, et autres
Publié: (2024)

Video-to-Audio Generation with Fine-grained Temporal Semantics
par: Hu, Yuchen, et autres
Publié: (2024)

Transcribing Rhythmic Patterns of the Guitar Track in Polyphonic Music
par: Lukoianov, Aleksandr, et autres
Publié: (2025)

MusicMamba: A Dual-Feature Modeling Approach for Generating Chinese Traditional Music with Modal Precision
par: Chen, Jiatao, et autres
Publié: (2024)

VMAS: Video-to-Music Generation via Semantic Alignment in Web Music Videos
par: Lin, Yan-Bo, et autres
Publié: (2024)

Combining Genre Classification and Harmonic-Percussive Features with Diffusion Models for Music-Video Generation
par: Pina, Leonardo, et autres
Publié: (2024)

Explainable Detection of Machine Generated Music and Early Systematic Evaluation
par: Li, Yupei, et autres
Publié: (2024)

GVMGen: A General Video-to-Music Generation Model with Hierarchical Attentions
par: Zuo, Heda, et autres
Publié: (2025)

Audio Conditioning for Music Generation via Discrete Bottleneck Features
par: Rouard, Simon, et autres
Publié: (2024)

SONIQUE: Video Background Music Generation Using Unpaired Audio-Visual Data
par: Zhang, Liqian, et autres
Publié: (2024)

Seed-Music: A Unified Framework for High Quality and Controlled Music Generation
par: Bai, Ye, et autres
Publié: (2024)

Music-Aligned Holistic 3D Dance Generation via Hierarchical Motion Modeling
par: Li, Xiaojie, et autres
Publié: (2025)

Do Captioning Metrics Reflect Music Semantic Alignment?
par: Lee, Jinwoo, et autres
Publié: (2024)

ChatMusician: Understanding and Generating Music Intrinsically with LLM
par: Yuan, Ruibin, et autres
Publié: (2024)

MusicEval: A Generative Music Dataset with Expert Ratings for Automatic Text-to-Music Evaluation
par: Liu, Cheng, et autres
Publié: (2025)

Video-Guided Text-to-Music Generation Using Public Domain Movie Collections
par: Kim, Haven, et autres
Publié: (2025)

MART: Learning Hierarchical Music Audio Representations with Part-Whole Transformer
par: Yao, Dong, et autres
Publié: (2023)

MoodLoopGP: Generating Emotion-Conditioned Loop Tablature Music with Multi-Granular Features
par: Cui, Wenqian, et autres
Publié: (2024)

Representation Learning for Semantic Alignment of Language, Audio, and Visual Modalities
par: Sudarsanam, Parthasaarathy, et autres
Publié: (2025)

Zero-Shot Fake Video Detection by Audio-Visual Consistency
par: Li, Xiaolou, et autres
Publié: (2024)

SemanticAudio: Audio Generation and Editing in Semantic Space
par: Dai, Zheqi, et autres
Publié: (2026)

Two-stage Audio-Visual Target Speaker Extraction System for Real-Time Processing On Edge Device
par: Li, Zixuan, et autres
Publié: (2025)

MOSA: Music Motion with Semantic Annotation Dataset for Cross-Modal Music Processing
par: Huang, Yu-Fen, et autres
Publié: (2024)

AV-SSAN: Audio-Visual Selective DoA Estimation through Explicit Multi-Band Semantic-Spatial Alignment
par: Chen, Yu, et autres
Publié: (2025)

HASRD: Hierarchical Acoustic and Semantic Representation Disentanglement
par: Hussein, Amir, et autres
Publié: (2025)

From Continuous to Discrete: Cross-Domain Collaborative General Speech Enhancement via Hierarchical Language Models
par: Mu, Zhaoxi, et autres
Publié: (2025)

Amphion: An Open-Source Audio, Music and Speech Generation Toolkit
par: Zhang, Xueyao, et autres
Publié: (2023)

FakeMusicCaps: a Dataset for Detection and Attribution of Synthetic Music Generated via Text-to-Music Models
par: Comanducci, Luca, et autres
Publié: (2024)

SymPAC: Scalable Symbolic Music Generation With Prompts And Constraints
par: Chen, Haonan, et autres
Publié: (2024)

DeformTune: A Deformable XAI Music Prototype for Non-Musicians
par: Xu, Ziqing, et autres
Publié: (2025)

ProGress: Structured Music Generation via Graph Diffusion and Hierarchical Music Analysis
par: Ni-Hahn, Stephen, et autres
Publié: (2025)

From Audio Deepfake Detection to AI-Generated Music Detection -- A Pathway and Overview
par: Li, Yupei, et autres
Publié: (2024)