Towards Automated Movie Trailer Generation
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866929303323672576 |
|---|---|
| author | Argaw, Dawit Mureja Soldan, Mattia Pardo, Alejandro Zhao, Chen Heilbron, Fabian Caba Chung, Joon Son Ghanem, Bernard |
| author_facet | Argaw, Dawit Mureja Soldan, Mattia Pardo, Alejandro Zhao, Chen Heilbron, Fabian Caba Chung, Joon Son Ghanem, Bernard |
| contents | Movie trailers are an essential tool for promoting films and attracting audiences. However, the process of creating trailers can be time-consuming and expensive. To streamline this process, we propose an automatic trailer generation framework that generates plausible trailers from a full movie by automating shot selection and composition. Our approach draws inspiration from machine translation techniques and models the movies and trailers as sequences of shots, thus formulating the trailer generation problem as a sequence-to-sequence task. We introduce Trailer Generation Transformer (TGT), a deep-learning framework utilizing an encoder-decoder architecture. TGT movie encoder is tasked with contextualizing each movie shot representation via self-attention, while the autoregressive trailer decoder predicts the feature representation of the next trailer shot, accounting for the relevance of shots' temporal order in trailers. Our TGT significantly outperforms previous methods on a comprehensive suite of metrics. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_03477 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Towards Automated Movie Trailer Generation Argaw, Dawit Mureja Soldan, Mattia Pardo, Alejandro Zhao, Chen Heilbron, Fabian Caba Chung, Joon Son Ghanem, Bernard Computer Vision and Pattern Recognition Movie trailers are an essential tool for promoting films and attracting audiences. However, the process of creating trailers can be time-consuming and expensive. To streamline this process, we propose an automatic trailer generation framework that generates plausible trailers from a full movie by automating shot selection and composition. Our approach draws inspiration from machine translation techniques and models the movies and trailers as sequences of shots, thus formulating the trailer generation problem as a sequence-to-sequence task. We introduce Trailer Generation Transformer (TGT), a deep-learning framework utilizing an encoder-decoder architecture. TGT movie encoder is tasked with contextualizing each movie shot representation via self-attention, while the autoregressive trailer decoder predicts the feature representation of the next trailer shot, accounting for the relevance of shots' temporal order in trailers. Our TGT significantly outperforms previous methods on a comprehensive suite of metrics. |
| title | Towards Automated Movie Trailer Generation |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2404.03477 |