Copertina

Enhancing Lip Reading with Multi-Scale Video and Multi-Encoder

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Wang, He, Guo, Pengcheng, Wan, Xucheng, Zhou, Huan, Xie, Lei
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computer Vision and Pattern Recognition
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

MTGA: Multi-View Temporal Granularity Aligned Aggregation for Event-Based Lip-Reading
di: Zhang, Wenhao, et al.
Pubblicazione: (2024)

LipGen: Viseme-Guided Lip Video Generation for Enhancing Visual Speech Recognition
di: Hao, Bowen, et al.
Pubblicazione: (2025)

SwinLip: An Efficient Visual Speech Encoder for Lip Reading Using Swin Transformer
di: Park, Young-Hu, et al.
Pubblicazione: (2025)

UnityVideo: Unified Multi-Modal Multi-Task Learning for Enhancing World-Aware Video Generation
di: Huang, Jiehui, et al.
Pubblicazione: (2025)

Ev-Layout: A Large-scale Event-based Multi-modal Dataset for Indoor Layout Estimation and Tracking
di: Guo, Xucheng, et al.
Pubblicazione: (2025)

VALLR: Visual ASR Language Model for Lip Reading
di: Thomas, Marshall, et al.
Pubblicazione: (2025)

CoME-VL: Scaling Complementary Multi-Encoder Vision-Language Learning
di: Deria, Ankan, et al.
Pubblicazione: (2026)

Super Encoding Network: Recursive Association of Multi-Modal Encoders for Video Understanding
di: Chen, Boyu, et al.
Pubblicazione: (2025)

VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding
di: Maaz, Muhammad, et al.
Pubblicazione: (2024)

MA-LipNet: Multi-Dimensional Attention Networks for Robust Lipreading
di: Rossi, Matteo
Pubblicazione: (2026)

Granulon: Awakening Pixel-Level Visual Encoders with Adaptive Multi-Granularity Semantics for MLLM
di: Mao, Junyuan, et al.
Pubblicazione: (2026)

Efficient Audio-Visual Speech Separation with Discrete Lip Semantics and Multi-Scale Global-Local Attention
di: Li, Kai, et al.
Pubblicazione: (2025)

Enhancing Video Large Language Models with Structured Multi-Video Collaborative Reasoning
di: He, Zhihao, et al.
Pubblicazione: (2025)

AnyTalker: Scaling Multi-Person Talking Video Generation with Interactivity Refinement
di: Zhong, Zhizhou, et al.
Pubblicazione: (2025)

YingVideo-MV: Music-Driven Multi-Stage Video Generation
di: Chen, Jiahui, et al.
Pubblicazione: (2025)

Hierarchical Semantic Learning for Multi-Class Aorta Segmentation
di: Shi, Pengcheng
Pubblicazione: (2025)

Enhance Multi-Scale Spatial-Temporal Coherence for Configurable Video Anomaly Detection
di: Cheng, Kai, et al.
Pubblicazione: (2023)

SayAnything: Audio-Driven Lip Synchronization with Conditional Video Diffusion
di: Ma, Junxian, et al.
Pubblicazione: (2025)

Landmark-Guided Cross-Speaker Lip Reading with Mutual Information Regularization
di: Wu, Linzhi, et al.
Pubblicazione: (2024)

Scaling Down Text Encoders of Text-to-Image Diffusion Models
di: Wang, Lifu, et al.
Pubblicazione: (2025)

ScaleLong: A Multi-Timescale Benchmark for Long Video Understanding
di: Ma, David, et al.
Pubblicazione: (2025)

Enhancing Speech-Driven 3D Facial Animation with Audio-Visual Guidance from Lip Reading Expert
di: EunGi, Han, et al.
Pubblicazione: (2024)

LawDNet: Enhanced Audio-Driven Lip Synthesis via Local Affine Warping Deformation
di: Junli, Deng, et al.
Pubblicazione: (2024)

PASE: Phoneme-Aware Speech Encoder to Improve Lip Sync Accuracy for Talking Head Synthesis
di: Huang, Yihuan, et al.
Pubblicazione: (2025)

Enhancing Visual Forced Alignment with Local Context-Aware Feature Extraction and Multi-Task Learning
di: He, Yi, et al.
Pubblicazione: (2025)

Boosting Adversarial Transferability Against Defenses via Multi-Scale Transformation
di: Guo, Zihong, et al.
Pubblicazione: (2025)

When and What: Diffusion-Grounded VideoLLM with Entity Aware Segmentation for Long Video Understanding
di: Fang, Pengcheng, et al.
Pubblicazione: (2025)

OmniSync: Towards Universal Lip Synchronization via Diffusion Transformers
di: Peng, Ziqiao, et al.
Pubblicazione: (2025)

MoFu: Scale-Aware Modulation and Fourier Fusion for Multi-Subject Video Generation
di: Ling, Run, et al.
Pubblicazione: (2025)

Efficient Masked AutoEncoder for Video Object Counting and A Large-Scale Benchmark
di: Cao, Bing, et al.
Pubblicazione: (2024)

MMDuet2: Enhancing Proactive Interaction of Video MLLMs with Multi-Turn Reinforcement Learning
di: Wang, Yueqian, et al.
Pubblicazione: (2025)

Guided Depth Map Super-Resolution via Multi-Scale Fusion U-shaped Mamba Network
di: Guo, Chenggang, et al.
Pubblicazione: (2025)

MSVCOD:A Large-Scale Multi-Scene Dataset for Video Camouflage Object Detection
di: Gao, Shuyong, et al.
Pubblicazione: (2025)

Breaking the Encoder Barrier for Seamless Video-Language Understanding
di: Li, Handong, et al.
Pubblicazione: (2025)

Uni-Encoder Meets Multi-Encoders: Representation Before Fusion for Brain Tumor Segmentation with Missing Modalities
di: Song, Peibo, et al.
Pubblicazione: (2026)

LiteFrame: Efficient Vision Encoders Unlock Frame Scaling in Video LLMs
di: Kim, Jihwan, et al.
Pubblicazione: (2026)

MultiShotMaster: A Controllable Multi-Shot Video Generation Framework
di: Wang, Qinghe, et al.
Pubblicazione: (2025)

IMC-Net: A Lightweight Content-Conditioned Encoder with Multi-Pass Processing for Image Classification
di: Li, YiZhou
Pubblicazione: (2025)

Learning Multi-view Anomaly Detection with Efficient Adaptive Selection
di: He, Haoyang, et al.
Pubblicazione: (2024)

Analytic Score Optimization for Multi Dimension Video Quality Assessment
di: Lin, Boda, et al.
Pubblicazione: (2026)