PresentAgent: Multimodal Agent for Presentation Video Generation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Shi, Jingwei, Zhang, Zeyu, Wu, Biao, Liang, Yanjie, Fang, Meng, Chen, Ling, Zhao, Yang
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911041165721600
author Shi, Jingwei
Zhang, Zeyu
Wu, Biao
Liang, Yanjie
Fang, Meng
Chen, Ling
Zhao, Yang
author_facet Shi, Jingwei
Zhang, Zeyu
Wu, Biao
Liang, Yanjie
Fang, Meng
Chen, Ling
Zhao, Yang
contents We present PresentAgent, a multimodal agent that transforms long-form documents into narrated presentation videos. While existing approaches are limited to generating static slides or text summaries, our method advances beyond these limitations by producing fully synchronized visual and spoken content that closely mimics human-style presentations. To achieve this integration, PresentAgent employs a modular pipeline that systematically segments the input document, plans and renders slide-style visual frames, generates contextual spoken narration with large language models and Text-to-Speech models, and seamlessly composes the final video with precise audio-visual alignment. Given the complexity of evaluating such multimodal outputs, we introduce PresentEval, a unified assessment framework powered by Vision-Language Models that comprehensively scores videos across three critical dimensions: content fidelity, visual clarity, and audience comprehension through prompt-based evaluation. Our experimental validation on a curated dataset of 30 document-presentation pairs demonstrates that PresentAgent approaches human-level quality across all evaluation metrics. These results highlight the significant potential of controllable multimodal agents in transforming static textual materials into dynamic, effective, and accessible presentation formats. Code will be available at https://github.com/AIGeeksGroup/PresentAgent.
format Preprint
id arxiv_https___arxiv_org_abs_2507_04036
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle PresentAgent: Multimodal Agent for Presentation Video Generation
Shi, Jingwei
Zhang, Zeyu
Wu, Biao
Liang, Yanjie
Fang, Meng
Chen, Ling
Zhao, Yang
Computer Vision and Pattern Recognition
We present PresentAgent, a multimodal agent that transforms long-form documents into narrated presentation videos. While existing approaches are limited to generating static slides or text summaries, our method advances beyond these limitations by producing fully synchronized visual and spoken content that closely mimics human-style presentations. To achieve this integration, PresentAgent employs a modular pipeline that systematically segments the input document, plans and renders slide-style visual frames, generates contextual spoken narration with large language models and Text-to-Speech models, and seamlessly composes the final video with precise audio-visual alignment. Given the complexity of evaluating such multimodal outputs, we introduce PresentEval, a unified assessment framework powered by Vision-Language Models that comprehensively scores videos across three critical dimensions: content fidelity, visual clarity, and audience comprehension through prompt-based evaluation. Our experimental validation on a curated dataset of 30 document-presentation pairs demonstrates that PresentAgent approaches human-level quality across all evaluation metrics. These results highlight the significant potential of controllable multimodal agents in transforming static textual materials into dynamic, effective, and accessible presentation formats. Code will be available at https://github.com/AIGeeksGroup/PresentAgent.
title PresentAgent: Multimodal Agent for Presentation Video Generation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.04036