Cover Image

SignMouth: Leveraging Mouthing Cues for Sign Language Translation by Multimodal Contrastive Fusion

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wu, Wenfang, Yuan, Tingting, Li, Yupeng, Wang, Daling, Fu, Xiaoming
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Large Sign Language Models: Toward 3D American Sign Language Translation
by: Zhang, Sen, et al.
Published: (2025)

AutoSign: Direct Pose-to-Text Translation for Continuous Sign Language Recognition
by: Johnny, Samuel Ebimobowei, et al.
Published: (2025)

Arabic Sign Language Recognition using Multimodal Approach
by: Alanazi, Ghadeer, et al.
Published: (2026)

Transfer Learning from Visual Speech Recognition to Mouthing Recognition in German Sign Language
by: Pham, Dinh Nam, et al.
Published: (2025)

SignMusketeers: An Efficient Multi-Stream Approach for Sign Language Translation at Scale
by: Gueuwou, Shester, et al.
Published: (2024)

FusionEnsemble-Net: An Attention-Based Ensemble of Spatiotemporal Networks for Multimodal Sign Language Recognition
by: Islam, Md. Milon, et al.
Published: (2025)

Exploiting Ensemble Learning for Cross-View Isolated Sign Language Recognition
by: Wang, Fei, et al.
Published: (2025)

Towards Privacy-Aware Sign Language Translation at Scale
by: Rust, Phillip, et al.
Published: (2024)

Sign Language Translation using Frame and Event Stream: Benchmark Dataset and Algorithms
by: Wang, Xiao, et al.
Published: (2025)

Lost in Translation, Found in Context: Sign Language Translation with Contextual Cues
by: Jang, Youngjoon, et al.
Published: (2025)

SyriSign: A Parallel Corpus for Arabic Text to Syrian Arabic Sign Language Translation
by: Khalil, Mohammad Amer, et al.
Published: (2026)

MDDFNet: Mamba-based Dynamic Dual Fusion Network for Traffic Sign Detection
by: Yu, TianYi
Published: (2025)

Enhancing Bidirectional Sign Language Communication: Integrating YOLOv8 and NLP for Real-Time Gesture Recognition & Translation
by: Bhuiyan, Hasnat Jamil, et al.
Published: (2024)

Sign Spotting Disambiguation using Large Language Models
by: Low, JianHe, et al.
Published: (2025)

DESign: Dynamic Context-Aware Convolution and Efficient Subnet Regularization for Continuous Sign Language Recognition
by: Liu, Sheng, et al.
Published: (2025)

SLVideo: A Sign Language Video Moment Retrieval Framework
by: Martins, Gonçalo Vinagre, et al.
Published: (2024)

American Sign Language Alphabet Recognition using Deep Learning
by: Kasukurthi, Nikhil, et al.
Published: (2019)

iSign: A Benchmark for Indian Sign Language Processing
by: Joshi, Abhinav, et al.
Published: (2024)

Advanced Sign Language Video Generation with Compressed and Quantized Multi-Condition Tokenization
by: Wang, Cong, et al.
Published: (2025)

Sign2GPT: Leveraging Large Language Models for Gloss-Free Sign Language Translation
by: Wong, Ryan, et al.
Published: (2024)

A real-time Artificial Intelligence system for learning Sign Language
by: Cabana, Elisa
Published: (2024)

Generation and Detection of Sign Language Deepfakes - A Linguistic and Visual Analysis
by: Naeem, Shahzeb, et al.
Published: (2024)

Continuous Sign Language Recognition Using Intra-inter Gloss Attention
by: Ranjbar, Hossein, et al.
Published: (2024)

3D-LEX v1.0: 3D Lexicons for American Sign Language and Sign Language of the Netherlands
by: Ranum, Oline, et al.
Published: (2024)

T2S-GPT: Dynamic Vector Quantization for Autoregressive Sign Language Production from Text
by: Yin, Aoxiong, et al.
Published: (2024)

The Importance of Facial Features in Vision-based Sign Language Recognition: Eyes, Mouth or Full Face?
by: Pham, Dinh Nam, et al.
Published: (2025)

LIDAR: Lightweight Adaptive Cue-Aware Fusion Vision Mamba for Multimodal Segmentation of Structural Cracks
by: Liu, Hui, et al.
Published: (2025)

Fusion to Enhance: Fusion Visual Encoder to Enhance Multimodal Language Model
by: She, Yifei, et al.
Published: (2025)

SignVerse-2M: A Two-Million-Clip Pose-Native Universe of 55+ Sign Languages
by: Fang, Sen, et al.
Published: (2026)

EvSign: Sign Language Recognition and Translation with Streaming Events
by: Zhang, Pengyu, et al.
Published: (2024)

Nepali Sign Language Characters Recognition: Dataset Development and Deep Learning Approaches
by: Poudel, Birat, et al.
Published: (2025)

SSLR: A Semi-Supervised Learning Method for Isolated Sign Language Recognition
by: Algafri, Hasan, et al.
Published: (2025)

Geo-Sign: Hyperbolic Contrastive Regularisation for Geometrically Aware Sign Language Translation
by: Fish, Edward, et al.
Published: (2025)

Addressing Asynchronicity in Clinical Multimodal Fusion via Individualized Chest X-ray Generation
by: Yao, Wenfang, et al.
Published: (2024)

New keypoint-based approach for recognising British Sign Language (BSL) from sequences
by: Deb, Oishi, et al.
Published: (2024)

Generation of Indian Sign Language Letters, Numbers, and Words
by: Yadav, Ajeet Kumar, et al.
Published: (2025)

POSESTITCH-SLT: Linguistically Inspired Pose-Stitching for End-to-End Sign Language Translation
by: Joshi, Abhinav, et al.
Published: (2025)

The More, the Merrier: Contrastive Fusion for Higher-Order Multimodal Alignment
by: Koutoupis, Stefanos, et al.
Published: (2025)

SignBind-LLM: Multi-Stage Modality Fusion for Sign Language Translation
by: Thomas, Marshall, et al.
Published: (2025)

The Fluorescent Veil: A Stealthy and Effective Physical Adversarial Patch Against Traffic Sign Recognition
by: Yuan, Shuai, et al.
Published: (2024)