Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Liu, Linkai, Feng, Wei, Zhao, Xi, Zhang, Shen, Chen, Xingye, Zhang, Zheng, Lv, Jingjing, Shen, Junjie, Law, Ching, Zhou, Yuchen, Guo, Zipeng, Gou, Chao
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2604.21362
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910160313647104
author Liu, Linkai
Feng, Wei
Zhao, Xi
Zhang, Shen
Chen, Xingye
Zhang, Zheng
Lv, Jingjing
Shen, Junjie
Law, Ching
Zhou, Yuchen
Guo, Zipeng
Gou, Chao
author_facet Liu, Linkai
Feng, Wei
Zhao, Xi
Zhang, Shen
Chen, Xingye
Zhang, Zheng
Lv, Jingjing
Shen, Junjie
Law, Ching
Zhou, Yuchen
Guo, Zipeng
Gou, Chao
contents Creative Generation (CG) leverages generative models to automatically produce advertising content that highlights product features, and it has been a significant focus of recent research. However, while CG has advanced considerably, most efforts have concentrated on generating advertising text and images, leaving Creative Video Generation (CVG) relatively underexplored. This gap is largely due to two major challenges faced by Text-to-Video (T2V) models: (a) \textbf{ambiguous semantic alignment}, where models struggle to accurately correlate product selling points with creative video content, and (b) \textbf{inadequate motion adaptability}, resulting in unrealistic movements and distortions. To address these challenges, we develop a comprehensive Advertising Creative Knowledge Base (ACKB) as a foundational resource and propose a knowledge-driven approach (KD-CVG) to overcome the knowledge limitations of existing models. KD-CVG consists of two primary modules: Semantic-Aware Retrieval (SAR) and Multimodal Knowledge Reference (MKR). SAR utilizes the semantic awareness of graph attention networks and reinforcement learning feedback to enhance the model's comprehension of the connections between selling points and creative videos. Building on this, MKR incorporates semantic and motion priors into the T2V model to address existing knowledge gaps. Extensive experiments have demonstrated KD-CVG's superior performance in achieving semantic alignment and motion adaptability, validating its effectiveness over other state-of-the-art methods. The code and dataset will be open source at https://kdcvg.github.io/KDCVG/.
format Preprint
id arxiv_https___arxiv_org_abs_2604_21362
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle KD-CVG: A Knowledge-Driven Approach for Creative Video Generation
Liu, Linkai
Feng, Wei
Zhao, Xi
Zhang, Shen
Chen, Xingye
Zhang, Zheng
Lv, Jingjing
Shen, Junjie
Law, Ching
Zhou, Yuchen
Guo, Zipeng
Gou, Chao
Computer Vision and Pattern Recognition
Creative Generation (CG) leverages generative models to automatically produce advertising content that highlights product features, and it has been a significant focus of recent research. However, while CG has advanced considerably, most efforts have concentrated on generating advertising text and images, leaving Creative Video Generation (CVG) relatively underexplored. This gap is largely due to two major challenges faced by Text-to-Video (T2V) models: (a) \textbf{ambiguous semantic alignment}, where models struggle to accurately correlate product selling points with creative video content, and (b) \textbf{inadequate motion adaptability}, resulting in unrealistic movements and distortions. To address these challenges, we develop a comprehensive Advertising Creative Knowledge Base (ACKB) as a foundational resource and propose a knowledge-driven approach (KD-CVG) to overcome the knowledge limitations of existing models. KD-CVG consists of two primary modules: Semantic-Aware Retrieval (SAR) and Multimodal Knowledge Reference (MKR). SAR utilizes the semantic awareness of graph attention networks and reinforcement learning feedback to enhance the model's comprehension of the connections between selling points and creative videos. Building on this, MKR incorporates semantic and motion priors into the T2V model to address existing knowledge gaps. Extensive experiments have demonstrated KD-CVG's superior performance in achieving semantic alignment and motion adaptability, validating its effectiveness over other state-of-the-art methods. The code and dataset will be open source at https://kdcvg.github.io/KDCVG/.
title KD-CVG: A Knowledge-Driven Approach for Creative Video Generation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2604.21362