Text-to-Edit: Controllable End-to-End Video Ad Creation via Multimodal LLMs
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910779652964352 |
|---|---|
| author | Cheng, Dabing Zhan, Haosen Zhao, Xingchen Liu, Guisheng Li, Zemin Xie, Jinghui Song, Zhao Feng, Weiguo Peng, Bingyue |
| author_facet | Cheng, Dabing Zhan, Haosen Zhao, Xingchen Liu, Guisheng Li, Zemin Xie, Jinghui Song, Zhao Feng, Weiguo Peng, Bingyue |
| contents | The exponential growth of short-video content has ignited a surge in the necessity for efficient, automated solutions to video editing, with challenges arising from the need to understand videos and tailor the editing according to user requirements. Addressing this need, we propose an innovative end-to-end foundational framework, ultimately actualizing precise control over the final video content editing. Leveraging the flexibility and generalizability of Multimodal Large Language Models (MLLMs), we defined clear input-output mappings for efficient video creation. To bolster the model's capability in processing and comprehending video content, we introduce a strategic combination of a denser frame rate and a slow-fast processing technique, significantly enhancing the extraction and understanding of both temporal and spatial video information. Furthermore, we introduce a text-to-edit mechanism that allows users to achieve desired video outcomes through textual input, thereby enhancing the quality and controllability of the edited videos. Through comprehensive experimentation, our method has not only showcased significant effectiveness within advertising datasets, but also yields universally applicable conclusions on public datasets. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_05884 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Text-to-Edit: Controllable End-to-End Video Ad Creation via Multimodal LLMs Cheng, Dabing Zhan, Haosen Zhao, Xingchen Liu, Guisheng Li, Zemin Xie, Jinghui Song, Zhao Feng, Weiguo Peng, Bingyue Computer Vision and Pattern Recognition The exponential growth of short-video content has ignited a surge in the necessity for efficient, automated solutions to video editing, with challenges arising from the need to understand videos and tailor the editing according to user requirements. Addressing this need, we propose an innovative end-to-end foundational framework, ultimately actualizing precise control over the final video content editing. Leveraging the flexibility and generalizability of Multimodal Large Language Models (MLLMs), we defined clear input-output mappings for efficient video creation. To bolster the model's capability in processing and comprehending video content, we introduce a strategic combination of a denser frame rate and a slow-fast processing technique, significantly enhancing the extraction and understanding of both temporal and spatial video information. Furthermore, we introduce a text-to-edit mechanism that allows users to achieve desired video outcomes through textual input, thereby enhancing the quality and controllability of the edited videos. Through comprehensive experimentation, our method has not only showcased significant effectiveness within advertising datasets, but also yields universally applicable conclusions on public datasets. |
| title | Text-to-Edit: Controllable End-to-End Video Ad Creation via Multimodal LLMs |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2501.05884 |