Co-Speech Gesture Detection through Multi-Phase Sequence Labeling
Fuente:
arXiv
Saved in:
| Main Authors: | Ghaleb, Esam, Burenko, Ilya, Rasenberg, Marlou, Pouw, Wim, Uhrig, Peter, Holler, Judith, Toni, Ivan, Özyürek, Aslı, Fernández, Raquel |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Leveraging Speech for Gesture Detection in Multimodal Communication
by: Ghaleb, Esam, et al.
Published: (2024)
by: Ghaleb, Esam, et al.
Published: (2024)
Learning Co-Speech Gesture Representations in Dialogue through Contrastive Learning: An Intrinsic Evaluation
by: Ghaleb, Esam, et al.
Published: (2024)
by: Ghaleb, Esam, et al.
Published: (2024)
Analysing Cross-Speaker Convergence in Face-to-Face Dialogue through the Lens of Automatically Detected Shared Linguistic Constructions
by: Ghaleb, Esam, et al.
Published: (2024)
by: Ghaleb, Esam, et al.
Published: (2024)
I see what you mean: Co-Speech Gestures for Reference Resolution in Multimodal Dialogue
by: Ghaleb, Esam, et al.
Published: (2025)
by: Ghaleb, Esam, et al.
Published: (2025)
HolisticSemGes: Semantic Grounding of Holistic Co-Speech Gesture Generation with Contrastive Flow-Matching
by: Liu, Lanmiao, et al.
Published: (2026)
by: Liu, Lanmiao, et al.
Published: (2026)
SemGes: Semantics-aware Co-Speech Gesture Generation using Semantic Coherence and Relevance Learning
by: Liu, Lanmiao, et al.
Published: (2025)
by: Liu, Lanmiao, et al.
Published: (2025)
DuoGesture: Neuro-Inspired and Biomechanically Informed Dual-Stream Co-Speech Gesture Generation
by: Paar, Ferdinand, et al.
Published: (2026)
by: Paar, Ferdinand, et al.
Published: (2026)
The Visual Iconicity Challenge: Evaluating Vision-Language Models on Sign Language Form-Meaning Mapping
by: Keleş, Onur, et al.
Published: (2025)
by: Keleş, Onur, et al.
Published: (2025)
Children Sustain Their Attention on Spatial Scenes When Planning to Describe Spatial Relations Multimodally in Speech and Gesture
by: Ercenur Ünal, et al.
Published: (2026)
by: Ercenur Ünal, et al.
Published: (2026)
The Co‐Structuring of Gesture‐Vocal Dynamics: An Exploration in Karnatak Music Performance
by: Lara Pearson, et al.
Published: (2025)
by: Lara Pearson, et al.
Published: (2025)
Hand Gestures Have Predictive Potential During Conversation: An Investigation of the Timing of Gestures in Relation to Speech
by: Marlijn ter Bekke, et al.
Published: (2024)
by: Marlijn ter Bekke, et al.
Published: (2024)
Gestural and Verbal Evidence of Conceptual Representation Differences in Blind and Sighted Individuals
by: Ezgi Mamus, et al.
Published: (2025)
by: Ezgi Mamus, et al.
Published: (2025)
Gesture Reduces Mapping Difficulties in the Development of Spatial Language Depending on the Complexity of Spatial Relations
by: Ercenur Ünal, et al.
Published: (2025)
by: Ercenur Ünal, et al.
Published: (2025)
Iconicity and Gesture Jointly Facilitate Learning of Second Language Signs at First Exposure in Hearing Nonsigners
by: Dilay Z. Karadöller, et al.
Published: (2024)
by: Dilay Z. Karadöller, et al.
Published: (2024)
Contextual Gesture: Co-Speech Gesture Video Generation through Context-aware Gesture Representation
by: Liu, Pinxin, et al.
Published: (2025)
by: Liu, Pinxin, et al.
Published: (2025)
Conveying Meaning through Gestures: An Investigation into Semantic Co-Speech Gesture Generation
by: Voss, Hendric, et al.
Published: (2025)
by: Voss, Hendric, et al.
Published: (2025)
Een kolonie van Duitsers
by: Schrover, Marlou
Published: (2010)
by: Schrover, Marlou
Published: (2010)
Learning Co-Speech Gesture for Multimodal Aphasia Type Detection
by: Lee, Daeun, et al.
Published: (2023)
by: Lee, Daeun, et al.
Published: (2023)
LiveGesture Streamable Co-Speech Gesture Generation Model
by: Saleem, Muhammad Usama, et al.
Published: (2026)
by: Saleem, Muhammad Usama, et al.
Published: (2026)
Recognizing Co-Speech Gestures in-the-Wild
by: Hegde, Sindhu B, et al.
Published: (2026)
by: Hegde, Sindhu B, et al.
Published: (2026)
Biopolitical Borders and the Political Economy of Migration Flows to and From Türkiye
by: Mehmet Özyürek
Published: (2024)
by: Mehmet Özyürek
Published: (2024)
Chapter 52 Experimental methods in co-speech gesture research
by: Holler, Judith
Published: (2019)
by: Holler, Judith
Published: (2019)
Opening Social Interactions: The Coordination of Approach, Gaze, Speech, and Handshakes During Greetings
by: Ottilie Tilston, et al.
Published: (2025)
by: Ottilie Tilston, et al.
Published: (2025)
How do Foundation Models Compare to Skeleton-Based Approaches for Gesture Recognition in Human-Robot Interaction?
by: Käs, Stephanie, et al.
Published: (2025)
by: Käs, Stephanie, et al.
Published: (2025)
Speech2AffectiveGestures: Synthesizing Co-Speech Gestures with Generative Adversarial Affective Expression Learning
by: Bhattacharya, Uttaran, et al.
Published: (2021)
by: Bhattacharya, Uttaran, et al.
Published: (2021)
PersonaGesture: Single-Reference Co-Speech Gesture Personalization for Unseen Speakers
by: Zhang, Xiangyue, et al.
Published: (2026)
by: Zhang, Xiangyue, et al.
Published: (2026)
A Linguistically Motivated Analysis of Intonational Phrasing in Text-to-Speech Systems: Revealing Gaps in Syntactic Sensitivity
by: Pouw, Charlotte, et al.
Published: (2025)
by: Pouw, Charlotte, et al.
Published: (2025)
Using Perspectival Words Is Harder Than Vocabulary Words for Humans and Even More So for Multimodal Language Models
by: Dong, Dota Tianai, et al.
Published: (2025)
by: Dong, Dota Tianai, et al.
Published: (2025)
Automatic Detection for Day and Night Time Dust Storms Using MODIS bands.
by: El-ossta, Esam
Published: (2016)
by: El-ossta, Esam
Published: (2016)
Enhanced Superconductivity in Proximity to Peaks in Densities of States
by: Althüser, Joshua, et al.
Published: (2025)
by: Althüser, Joshua, et al.
Published: (2025)
GestureLSM: Latent Shortcut based Co-Speech Gesture Generation with Spatial-Temporal Modeling
by: Liu, Pinxin, et al.
Published: (2025)
by: Liu, Pinxin, et al.
Published: (2025)
CoordSpeaker: Exploiting Gesture Captioning for Coordinated Caption-Empowered Co-Speech Gesture Generation
by: Fang, Fengyi, et al.
Published: (2025)
by: Fang, Fengyi, et al.
Published: (2025)
EmotionGesture: Audio-Driven Diverse Emotional Co-Speech 3D Gesture Generation
by: Qi, Xingqun, et al.
Published: (2023)
by: Qi, Xingqun, et al.
Published: (2023)
MambaGesture: Enhancing Co-Speech Gesture Generation with Mamba and Disentangled Multi-Modality Fusion
by: Fu, Chencan, et al.
Published: (2024)
by: Fu, Chencan, et al.
Published: (2024)
Democratizing High-Fidelity Co-Speech Gesture Video Generation
by: Yang, Xu, et al.
Published: (2025)
by: Yang, Xu, et al.
Published: (2025)
Semantic Gesticulator: Semantics-Aware Co-Speech Gesture Synthesis
by: Zhang, Zeyi, et al.
Published: (2024)
by: Zhang, Zeyi, et al.
Published: (2024)
DiM-Gesture: Co-Speech Gesture Generation with Adaptive Layer Normalization Mamba-2 framework
by: Zhang, Fan, et al.
Published: (2024)
by: Zhang, Fan, et al.
Published: (2024)
In-Context Learning in Speech Language Models: Analyzing the Role of Acoustic Features, Linguistic Structure, and Induction Heads
by: Pouw, Charlotte, et al.
Published: (2026)
by: Pouw, Charlotte, et al.
Published: (2026)
Landau-Lifshitz damping from Lindbladian dissipation in quantum magnets
by: Uhrig, Götz S.
Published: (2024)
by: Uhrig, Götz S.
Published: (2024)
EMAGE: Towards Unified Holistic Co-Speech Gesture Generation via Expressive Masked Audio Gesture Modeling
by: Liu, Haiyang, et al.
Published: (2023)
by: Liu, Haiyang, et al.
Published: (2023)
Similar Items
-
Leveraging Speech for Gesture Detection in Multimodal Communication
by: Ghaleb, Esam, et al.
Published: (2024) -
Learning Co-Speech Gesture Representations in Dialogue through Contrastive Learning: An Intrinsic Evaluation
by: Ghaleb, Esam, et al.
Published: (2024) -
Analysing Cross-Speaker Convergence in Face-to-Face Dialogue through the Lens of Automatically Detected Shared Linguistic Constructions
by: Ghaleb, Esam, et al.
Published: (2024) -
I see what you mean: Co-Speech Gestures for Reference Resolution in Multimodal Dialogue
by: Ghaleb, Esam, et al.
Published: (2025) -
HolisticSemGes: Semantic Grounding of Holistic Co-Speech Gesture Generation with Contrastive Flow-Matching
by: Liu, Lanmiao, et al.
Published: (2026)