Cover Image

Gesture2Text: A Generalizable Decoder for Word-Gesture Keyboards in XR Through Trajectory Coarse Discretization and Pre-training

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Shen, Junxiao, Khaldi, Khadija, Zhou, Enmin, Surale, Hemant Bhaskar, Karlson, Amy
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence Computation and Language Graphics Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

RingGesture: A Ring-Based Mid-Air Gesture Typing System Powered by a Deep-Learning Word Prediction Framework
by: Shen, Junxiao, et al.
Published: (2024)

Boosting Gesture Recognition with an Automatic Gesture Annotation Framework
by: Shen, Junxiao, et al.
Published: (2024)

Text2Gestures: A Transformer-Based Network for Generating Emotive Body Gestures for Virtual Agents
by: Bhattacharya, Uttaran, et al.
Published: (2021)

Llanimation: Llama Driven Gesture Animation
by: J. Windle, et al.
Published: (2024)

Conversational Gesture Model (CGM): Extending Speaker‐Centric Audio‐Driven Motion Generation to Full Conversation Gestures
by: T. Koren, et al.
Published: (2026)

Intentional Gesture: Deliver Your Intentions with Gestures for Speech
by: Liu, Pinxin, et al.
Published: (2025)

GestureLSM: Latent Shortcut based Co-Speech Gesture Generation with Spatial-Temporal Modeling
by: Liu, Pinxin, et al.
Published: (2025)

Towards Open-World Gesture Recognition
by: Shen, Junxiao, et al.
Published: (2024)

MIBURI: Towards Expressive Interactive Gesture Synthesis
by: Mughal, M. Hamza, et al.
Published: (2026)

EmoDiffGes: Emotion‐Aware Co‐Speech Holistic Gesture Generation with Progressive Synergistic Diffusion
by: Xinru Li, et al.
Published: (2025)

Reality Check: How Avatar and Face Representation Affect the Perceptual Evaluation of Synthesized Gestures
by: Du, Haoyang, et al.
Published: (2026)

XR is XR: Rethinking MR and XR as Neutral Umbrella Terms
by: Kurata, Takeshi
Published: (2026)

LLAniMAtion: LLAMA Driven Gesture Animation
by: Windle, Jonathan, et al.
Published: (2024)

MAG: Multi-Modal Aligned Autoregressive Co-Speech Gesture Generation without Vector Quantization
by: Liu, Binjie, et al.
Published: (2025)

PersonaGest: Personalized Co-Speech Gesture Generation with Semantic-Guided Hierarchical Motion Representation
by: Zhao, Junchuan, et al.
Published: (2026)

Semantic Gesticulator: Semantics-Aware Co-Speech Gesture Synthesis
by: Zhang, Zeyi, et al.
Published: (2024)

A computational medical XR discipline
by: Papagiannakis, George, et al.
Published: (2021)

Incorporating Spatial Awareness in Data-Driven Gesture Generation for Virtual Agents
by: Deichler, Anna, et al.
Published: (2024)

ASCRIBE-XR: Virtual Reality for Visualization of Scientific Imagery
by: Pandolfi, Ronald J., et al.
Published: (2025)

Decoupled Edge Physics algorithms for collaborative XR simulations
by: Kokiadis, George, et al.
Published: (2024)

Surface‐aware Mesh Texture Synthesis with Pre‐trained 2D CNNs
by: Áron Samuel Kovács, et al.
Published: (2024)

Towards Unified Co-Speech Gesture Generation via Hierarchical Implicit Periodicity Learning
by: Guo, Xin, et al.
Published: (2025)

Cues to fast‐forward collaboration: A Survey of Workspace Awareness and Visual Cues in XR Collaborative Systems
by: R. Assaf, et al.
Published: (2024)

Integrating Representational Gestures into Automatically Generated Embodied Explanations and its Effects on Understanding and Interaction Quality
by: Robrecht, Amelie Sophie, et al.
Published: (2024)

AIvaluateXR: An Evaluation Framework for on-Device AI in XR with Benchmarking Results
by: Khan, Dawar, et al.
Published: (2025)

Speech-driven Personalized Gesture Synthetics: Harnessing Automatic Fuzzy Feature Inference
by: Zhang, Fan, et al.
Published: (2024)

Self‐supervised Learning of Fine‐to‐Coarse Cuboid Shape Abstraction
by: Gregor Kobsik, et al.
Published: (2026)

WordRobe: Text-Guided Generation of Textured 3D Garments
by: Srivastava, Astitva, et al.
Published: (2024)

DIDiffGes: Decoupled Semi-Implicit Diffusion Models for Real-time Gesture Generation from Speech
by: Cheng, Yongkang, et al.
Published: (2025)

Criminator: An Easy-to-Use XR "Crime Animator" for Rapid Reconstruction and Analysis of Dynamic Crime Scenes
by: Pooryousef, Vahid, et al.
Published: (2026)

Fast Texture Transfer for XR Avatars via Barycentric UV Conversion
by: Song, Hail, et al.
Published: (2025)

DiM-Gesture: Co-Speech Gesture Generation with Adaptive Layer Normalization Mamba-2 framework
by: Zhang, Fan, et al.
Published: (2024)

Towards Reliable Human Evaluations in Gesture Generation: Insights from a Community-Driven State-of-the-Art Benchmark
by: Nagy, Rajmund, et al.
Published: (2025)

Beyond the Desktop: XR-Driven Segmentation with Meta Quest 3 and MX Ink
by: de Paiva, Lisle Faray, et al.
Published: (2025)

STAR: Smartphone-analogous Typing in Augmented Reality
by: Kim, Taejun, et al.
Published: (2025)

Robust Photo-Realistic Hand Gesture Generation: from Single View to Multiple View
by: Fu, Qifan, et al.
Published: (2025)

LLM Gesticulator: Leveraging Large Language Models for Scalable and Controllable Co-Speech Gesture Synthesis
by: Pang, Haozhou, et al.
Published: (2024)

Conditional GAN for Enhancing Diffusion Models in Efficient and Authentic Global Gesture Generation from Audios
by: Cheng, Yongkang, et al.
Published: (2024)

DiM-Gestor: Co-Speech Gesture Generation with Adaptive Layer Normalization Mamba-2
by: Zhang, Fan, et al.
Published: (2024)

Coordinated 2D-3D Visualization of Volumetric Medical Data in XR with Multimodal Interactions
by: Liu, Qixuan, et al.
Published: (2025)