Copertina

Multimodal Diffusion Transformer with Memory Bank for Scalable Long-Duration Talking Video Generation

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zhang, Haojie, Liang, Zhihao, Fu, Ruibo, Liu, Bingyan, Wen, Zhengqi, Liu, Xuefei, Tao, Jianhua, Liang, Yaling
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computer Vision and Pattern Recognition
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Debunk and Infer: Multimodal Fake News Detection via Diffusion-Generated Evidence and LLM Reasoning
di: Yan, Kaiying, et al.
Pubblicazione: (2025)

MuSS: A Large-Scale Dataset and Cinematic Narrative Benchmark for Multi-Shot Subject-to-Video Generation
di: Zhang, Haojie, et al.
Pubblicazione: (2026)

Exploring the Role of Audio in Multimodal Misinformation Detection
di: Liu, Moyang, et al.
Pubblicazione: (2024)

MDPE: A Multimodal Deception Dataset with Personality and Emotional Characteristics
di: Cai, Cong, et al.
Pubblicazione: (2024)

PSA-MF: Personality-Sentiment Aligned Multi-Level Fusion for Multimodal Sentiment Analysis
di: Xie, Heng, et al.
Pubblicazione: (2025)

MEMO: Memory-Guided Diffusion for Expressive Talking Video Generation
di: Zheng, Longtao, et al.
Pubblicazione: (2024)

MTPareto: A MultiModal Targeted Pareto Framework for Fake News Detection
di: Yan, Kaiying, et al.
Pubblicazione: (2025)

ConsistTalk: Intensity Controllable Temporally Consistent Talking Head Generation with Diffusion Noise Search
di: Liu, Zhenjie, et al.
Pubblicazione: (2025)

Exploring Modality Disruption in Multimodal Fake News Detection
di: Liu, Moyang, et al.
Pubblicazione: (2025)

Deconfounded Reasoning for Multimodal Fake News Detection via Causal Intervention
di: Liu, Moyang, et al.
Pubblicazione: (2025)

MINT: a Multi-modal Image and Narrative Text Dubbing Dataset for Foley Audio Content Planning and Generation
di: Fu, Ruibo, et al.
Pubblicazione: (2024)

ST-GDance++: A Scalable Spatial-Temporal Diffusion for Long-Duration Group Choreography
di: Xu, Jing, et al.
Pubblicazione: (2026)

DashFusion: Dual-stream Alignment with Hierarchical Bottleneck Fusion for Multimodal Sentiment Analysis
di: Wen, Yuhua, et al.
Pubblicazione: (2025)

LongVie: Multimodal-Guided Controllable Ultra-Long Video Generation
di: Gao, Jianxiong, et al.
Pubblicazione: (2025)

Realizing Immersive Volumetric Video: A Multimodal Framework for 6-DoF VR Engagement
di: Yang, Zhengxian, et al.
Pubblicazione: (2026)

LAMIC: Layout-Aware Multi-Image Composition via Scalability of Multimodal Diffusion Transformer
di: Chen, Yuzhuo, et al.
Pubblicazione: (2025)

Advancing Narrative Long Video Generation via Training-Free Identity-Aware Memory
di: Liu, Jinzhuo, et al.
Pubblicazione: (2026)

Fake News Detection and Manipulation Reasoning via Large Vision-Language Models
di: Jin, Ruihan, et al.
Pubblicazione: (2024)

High-Fidelity and Long-Duration Human Image Animation with Diffusion Transformer
di: Zheng, Shen, et al.
Pubblicazione: (2025)

OmniMem: Scalable and Adaptive Memory Retrieval for Long Video Generation
di: Zhao, Lin, et al.
Pubblicazione: (2026)

VMonarch: Efficient Video Diffusion Transformers with Structured Attention
di: Liang, Cheng, et al.
Pubblicazione: (2026)

MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding
di: He, Bo, et al.
Pubblicazione: (2024)

EmotiveTalk: Expressive Talking Head Generation through Audio Information Decoupling and Emotional Video Diffusion
di: Wang, Haotian, et al.
Pubblicazione: (2024)

UniTalking: A Unified Audio-Video Framework for Talking Portrait Generation
di: Li, Hebeizi, et al.
Pubblicazione: (2026)

LiveTalk: Real-Time Multimodal Interactive Video Diffusion via Improved On-Policy Distillation
di: Chern, Ethan, et al.
Pubblicazione: (2025)

VideoLucy: Deep Memory Backtracking for Long Video Understanding
di: Zuo, Jialong, et al.
Pubblicazione: (2025)

ARLON: Boosting Diffusion Transformers with Autoregressive Models for Long Video Generation
di: Li, Zongyi, et al.
Pubblicazione: (2024)

CtrlVDiff: Controllable Video Generation via Unified Multimodal Video Diffusion
di: Xi, Dianbing, et al.
Pubblicazione: (2025)

RELIC: Interactive Video World Model with Long-Horizon Memory
di: Hong, Yicong, et al.
Pubblicazione: (2025)

Kling-Avatar: Grounding Multimodal Instructions for Cascaded Long-Duration Avatar Animation Synthesis
di: Ding, Yikang, et al.
Pubblicazione: (2025)

Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrieval
di: Yu, Jiwen, et al.
Pubblicazione: (2025)

Exploring Iterative Refinement with Diffusion Models for Video Grounding
di: Liang, Xiao, et al.
Pubblicazione: (2023)

Boosting Resolution Generalization of Diffusion Transformers with Randomized Positional Encodings
di: Hou, Liang, et al.
Pubblicazione: (2025)

EditYourself: Audio-Driven Generation and Manipulation of Talking Head Videos with Diffusion Transformers
di: Flynn, John, et al.
Pubblicazione: (2026)

Understanding Attention Mechanism in Video Diffusion Models
di: Liu, Bingyan, et al.
Pubblicazione: (2025)

REGen: Multimodal Retrieval-Embedded Generation for Long-to-Short Video Editing
di: Xu, Weihan, et al.
Pubblicazione: (2025)

ImViD: Immersive Volumetric Videos for Enhanced VR Engagement
di: Yang, Zhengxian, et al.
Pubblicazione: (2025)

MME-Unify: A Comprehensive Benchmark for Unified Multimodal Understanding and Generation Models
di: Xie, Wulin, et al.
Pubblicazione: (2025)

DisentTalk: Cross-lingual Talking Face Generation via Semantic Disentangled Diffusion Model
di: Liu, Kangwei, et al.
Pubblicazione: (2025)

Learning Online Scale Transformation for Talking Head Video Generation
di: Hong, Fa-Ting, et al.
Pubblicazione: (2024)