Cover Image

Leveraging Speech for Gesture Detection in Multimodal Communication

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ghaleb, Esam, Burenko, Ilya, Rasenberg, Marlou, Pouw, Wim, Toni, Ivan, Uhrig, Peter, Wilson, Anna, Holler, Judith, Özyürek, Aslı, Fernández, Raquel
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Co-Speech Gesture Detection through Multi-Phase Sequence Labeling
by: Ghaleb, Esam, et al.
Published: (2023)

Learning Co-Speech Gesture Representations in Dialogue through Contrastive Learning: An Intrinsic Evaluation
by: Ghaleb, Esam, et al.
Published: (2024)

Analysing Cross-Speaker Convergence in Face-to-Face Dialogue through the Lens of Automatically Detected Shared Linguistic Constructions
by: Ghaleb, Esam, et al.
Published: (2024)

I see what you mean: Co-Speech Gestures for Reference Resolution in Multimodal Dialogue
by: Ghaleb, Esam, et al.
Published: (2025)

HolisticSemGes: Semantic Grounding of Holistic Co-Speech Gesture Generation with Contrastive Flow-Matching
by: Liu, Lanmiao, et al.
Published: (2026)

SemGes: Semantics-aware Co-Speech Gesture Generation using Semantic Coherence and Relevance Learning
by: Liu, Lanmiao, et al.
Published: (2025)

DuoGesture: Neuro-Inspired and Biomechanically Informed Dual-Stream Co-Speech Gesture Generation
by: Paar, Ferdinand, et al.
Published: (2026)

The Visual Iconicity Challenge: Evaluating Vision-Language Models on Sign Language Form-Meaning Mapping
by: Keleş, Onur, et al.
Published: (2025)

Children Sustain Their Attention on Spatial Scenes When Planning to Describe Spatial Relations Multimodally in Speech and Gesture
by: Ercenur Ünal, et al.
Published: (2026)

The Co‐Structuring of Gesture‐Vocal Dynamics: An Exploration in Karnatak Music Performance
by: Lara Pearson, et al.
Published: (2025)

Hand Gestures Have Predictive Potential During Conversation: An Investigation of the Timing of Gestures in Relation to Speech
by: Marlijn ter Bekke, et al.
Published: (2024)

Gestural and Verbal Evidence of Conceptual Representation Differences in Blind and Sighted Individuals
by: Ezgi Mamus, et al.
Published: (2025)

Gesture Reduces Mapping Difficulties in the Development of Spatial Language Depending on the Complexity of Spatial Relations
by: Ercenur Ünal, et al.
Published: (2025)

Iconicity and Gesture Jointly Facilitate Learning of Second Language Signs at First Exposure in Hearing Nonsigners
by: Dilay Z. Karadöller, et al.
Published: (2024)

Using Perspectival Words Is Harder Than Vocabulary Words for Humans and Even More So for Multimodal Language Models
by: Dong, Dota Tianai, et al.
Published: (2025)

Een kolonie van Duitsers
by: Schrover, Marlou
Published: (2010)

Learning Co-Speech Gesture for Multimodal Aphasia Type Detection
by: Lee, Daeun, et al.
Published: (2023)

Multimodal Quantitative Measures for Multiparty Behaviour Evaluation
by: Shirekar, Ojas, et al.
Published: (2025)

Biopolitical Borders and the Political Economy of Migration Flows to and From Türkiye
by: Mehmet Özyürek
Published: (2024)

Chapter 52 Experimental methods in co-speech gesture research
by: Holler, Judith
Published: (2019)

Opening Social Interactions: The Coordination of Approach, Gaze, Speech, and Handshakes During Greetings
by: Ottilie Tilston, et al.
Published: (2025)

How do Foundation Models Compare to Skeleton-Based Approaches for Gesture Recognition in Human-Robot Interaction?
by: Käs, Stephanie, et al.
Published: (2025)

A Linguistically Motivated Analysis of Intonational Phrasing in Text-to-Speech Systems: Revealing Gaps in Syntactic Sensitivity
by: Pouw, Charlotte, et al.
Published: (2025)

Automatic Detection for Day and Night Time Dust Storms Using MODIS bands.
by: El-ossta, Esam
Published: (2016)

Enhanced Superconductivity in Proximity to Peaks in Densities of States
by: Althüser, Joshua, et al.
Published: (2025)

In-Context Learning in Speech Language Models: Analyzing the Role of Acoustic Features, Linguistic Structure, and Induction Heads
by: Pouw, Charlotte, et al.
Published: (2026)

Landau-Lifshitz damping from Lindbladian dissipation in quantum magnets
by: Uhrig, Götz S.
Published: (2024)

New Goodness-of-Fit Tests for Time Series Models
by: Mahdi, Esam
Published: (2020)

Using Inverse Modeling by HYDRUS-1D to Predict Some Soil Hydraulic Parameters from Soil Water Evaporation
by: Esam Mohammed
Published: (2022)

Intentional Gesture: Deliver Your Intentions with Gestures for Speech
by: Liu, Pinxin, et al.
Published: (2025)

Perception of Phonological Assimilation by Neural Speech Recognition Models
by: Pouw, Charlotte, et al.
Published: (2024)

Multimodal Emotion Coupling via Speech-to-Facial and Bodily Gestures in Dyadic Interaction
by: Herbuela, Von Ralph Dane Marquez, et al.
Published: (2025)

HOP: Heterogeneous Topology-based Multimodal Entanglement for Co-Speech Gesture Generation
by: Cheng, Hongye, et al.
Published: (2025)

LiveGesture Streamable Co-Speech Gesture Generation Model
by: Saleem, Muhammad Usama, et al.
Published: (2026)

Speech-Gesture GAN: Gesture Generation for Robots and Embodied Agents
by: Liu, Carson Yu, et al.
Published: (2023)

LLM Gesticulator: Leveraging Large Language Models for Scalable and Controllable Co-Speech Gesture Synthesis
by: Pang, Haozhou, et al.
Published: (2024)

GesPrompt: Leveraging Co-Speech Gestures to Augment LLM-Based Interaction in Virtual Reality
by: Hu, Xiyun, et al.
Published: (2025)

New perspectives on the physiological basis of muscle loss
by: Alistair J. Monteyne, et al.
Published: (2026)

Experiential Semantic Information and Brain Alignment: Are Multimodal Models Better than Language Models?
by: Bavaresco, Anna, et al.
Published: (2025)

Transvaginal Pezzer Catheter Drainage in Treatment‐Resistant Deep Pelvic Abscess After Cesarean Section: Case Report
by: Bekir Kahveci, et al.
Published: (2026)