Saved in:
Bibliographic Details
Main Authors: Gao, Yu, Huang, Jiancheng, Sun, Xiaopeng, Jie, Zequn, Zhong, Yujie, Ma, Lin
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2405.03025
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • In this paper, we introduce Matten, a cutting-edge latent diffusion model with Mamba-Attention architecture for video generation. With minimal computational cost, Matten employs spatial-temporal attention for local video content modeling and bidirectional Mamba for global video content modeling. Our comprehensive experimental evaluation demonstrates that Matten has competitive performance with the current Transformer-based and GAN-based models in benchmark performance, achieving superior FVD scores and efficiency. Additionally, we observe a direct positive correlation between the complexity of our designed model and the improvement in video quality, indicating the excellent scalability of Matten.