Cover Image

AudCast: Audio-Driven Human Video Generation by Cascaded Diffusion Transformers

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Guan, Jiazhi, Wang, Kaisiyuan, Xu, Zhiliang, Yang, Quanwei, Sun, Yasheng, He, Shengyi, Liang, Borong, Cao, Yukang, Li, Yingying, Feng, Haocheng, Ding, Errui, Wang, Jingdong, Zhao, Youjian, Zhou, Hang, Liu, Ziwei
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition Graphics Multimedia
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

ReSyncer: Rewiring Style-based Generator for Unified Audio-Visually Synced Facial Performer
by: Guan, Jiazhi, et al.
Published: (2024)

TALK-Act: Enhance Textural-Awareness for 2D Speaking Avatar Reenactment with Diffusion Model
by: Guan, Jiazhi, et al.
Published: (2024)

GestureHYDRA: Semantic Co-speech Gesture Synthesis via Hybrid Modality Diffusion Transformer and Cascaded-Synchronized Retrieval-Augmented Generation
by: Yang, Quanwei, et al.
Published: (2025)

Cosh-DiT: Co-Speech Gesture Video Synthesis via Hybrid Audio-Visual Diffusion Transformers
by: Sun, Yasheng, et al.
Published: (2025)

SemanticGarment: Semantic-Controlled Generation and Editing of 3D Gaussian Garments
by: Wang, Ruiyan, et al.
Published: (2025)

DASC: Depth-of-Field Aware Scene Complexity Metric for 3D Visualization on Light Field Display
by: Akbar, Kamran, et al.
Published: (2025)

GTLR-GS: Geometry-Texture Aware LiDAR-Regularized 3D Gaussian Splatting for Realistic Scene Reconstruction
by: Fang, Yan, et al.
Published: (2026)

Generating Digital Models Using Text-to-3D and Image-to-3D Prompts: Critical Case Study
by: Ziatdinov, Rushan, et al.
Published: (2025)

Think2Sing: Orchestrating Structured Motion Subtitles for Singing-Driven 3D Head Animation
by: Huang, Zikai, et al.
Published: (2025)

Automatic Camera Trajectory Control with Enhanced Immersion for Virtual Cinematography
by: Wu, Xinyi, et al.
Published: (2023)

EditYourself: Audio-Driven Generation and Manipulation of Talking Head Videos with Diffusion Transformers
by: Flynn, John, et al.
Published: (2026)

LAV: Audio-Driven Dynamic Visual Generation with Neural Compression and StyleGAN2
by: Jung, Jongmin, et al.
Published: (2025)

SIG-Chat: Spatial Intent-Guided Conversational Gesture Generation Involving How, When and Where
by: Huang, Yiheng, et al.
Published: (2025)

On Copyright Risks of Text-to-Image Diffusion Models
by: Zhang, Yang, et al.
Published: (2023)

InteractEdit: Zero-Shot Editing of Human-Object Interactions in Images
by: Hoe, Jiun Tian, et al.
Published: (2025)

Design of a UE5-based digital twin platform
by: Lyu, Shaoqiu, et al.
Published: (2024)

PointTalk: Audio-Driven Dynamic Lip Point Cloud for 3D Gaussian-based Talking Head Synthesis
by: Xie, Yifan, et al.
Published: (2024)

Sound Sparks Motion: Audio and Text Tuning for Video Editing
by: Razlighi, AmirHossein Naghi, et al.
Published: (2026)

Towards Interactive Multimodal Representation of ML Functions for Human Understanding of ML
by: Wang, Bokang, et al.
Published: (2026)

iDiT-HOI: Inpainting-based Hand Object Interaction Reenactment via Video Diffusion Transformer
by: Shen, Zhelun, et al.
Published: (2025)

SAGE: Semantic-Driven Adaptive Gaussian Splatting in Extended Reality
by: Schiavo, Chiara, et al.
Published: (2025)

Resolution deficits drive simulator sickness and compromise reading performance in virtual environments
by: Wang, Jialin, et al.
Published: (2026)

Unison: Harmonizing Motion, Speech, and Sound for Human-Centric Audio-Video Generation
by: Cheng, Shihao, et al.
Published: (2026)

Audio is all in one: speech-driven gesture synthetics using WavLM pre-trained model
by: Zhang, Fan, et al.
Published: (2023)

Narrative-to-Scene Generation: An LLM-Driven Pipeline for 2D Game Environments
by: Chen, Yi-Chun, et al.
Published: (2025)

The perceptual gap between video see-through displays and natural human vision
by: Wang, Jialin, et al.
Published: (2026)

Real-Time Interactive Hybrid Ocean: Spectrum-Consistent Wave Particle-FFT Coupling
by: Xue, Shengze, et al.
Published: (2025)

L3GS: Layered 3D Gaussian Splats for Efficient 3D Scene Delivery
by: Tsai, Yi-Zhen, et al.
Published: (2025)

From Code to Canvas
by: Werner, Bernhard O.
Published: (2025)

Perceive-Sample-Compress: Towards Real-Time 3D Gaussian Splatting
by: Wang, Zijian, et al.
Published: (2025)

Coordinated 2D-3D Visualization of Volumetric Medical Data in XR with Multimodal Interactions
by: Liu, Qixuan, et al.
Published: (2025)

ArchGPT: Understanding the World's Architectures with Large Multimodal Models
by: Wang, Yuze, et al.
Published: (2025)

A Collaborative Extended Reality Prototype for 3D Surgical Planning and Visualization
by: Qiu, Shi, et al.
Published: (2026)

SVGS: Enhancing Gaussian Splatting Using Primitives with Spatially Varying Colors
by: Xu, Rui, et al.
Published: (2024)

Exploring Palette based Color Guidance in Diffusion Models
by: Qiu, Qianru, et al.
Published: (2025)

PersonaGest: Personalized Co-Speech Gesture Generation with Semantic-Guided Hierarchical Motion Representation
by: Zhao, Junchuan, et al.
Published: (2026)

Laplacian Analysis Meets Dynamics Modelling: Gaussian Splatting for 4D Reconstruction
by: Zhou, Yifan, et al.
Published: (2025)

Beyond the Desktop: XR-Driven Segmentation with Meta Quest 3 and MX Ink
by: de Paiva, Lisle Faray, et al.
Published: (2025)

Unveiling Deep Shadows: A Survey and Benchmark on Image and Video Shadow Detection, Removal, and Generation in the Deep Learning Era
by: Hu, Xiaowei, et al.
Published: (2024)

Streaming Real-Time Rendered Scenes as 3D Gaussians
by: Siekkinen, Matti, et al.
Published: (2026)