Cover Image

Conversational Co-Speech Gesture Generation via Modeling Dialog Intention, Emotion, and Context with Diffusion Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Xue, Haiwei, Yang, Sicheng, Zhang, Zhensong, Wu, Zhiyong, Li, Minglei, Dai, Zonghong, Meng, Helen
Format:	Preprint
Published:	2023
Subjects:	Human-Computer Interaction
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Co-Speech Gesture Video Generation via Motion-Decoupled Diffusion Model
by: He, Xu, et al.
Published: (2024)

Freetalker: Controllable Speech and Text-Driven Gesture Generation Based on Diffusion Models for Enhanced Speaker Naturalness
by: Yang, Sicheng, et al.
Published: (2024)

A Unified Editing Method for Co-Speech Gesture Generation via Diffusion Inversion
by: Zhao, Zeyu, et al.
Published: (2024)

MambaGesture: Enhancing Co-Speech Gesture Generation with Mamba and Disentangled Multi-Modality Fusion
by: Fu, Chencan, et al.
Published: (2024)

SIGGesture: Generalized Co-Speech Gesture Synthesis via Semantic Injection with Large-Scale Pre-Training Diffusion Models
by: Cheng, Qingrong, et al.
Published: (2024)

Streaming Generation of Co-Speech Gestures via Accelerated Rolling Diffusion
by: Vu, Evgeniia, et al.
Published: (2025)

Conveying Meaning through Gestures: An Investigation into Semantic Co-Speech Gesture Generation
by: Voss, Hendric, et al.
Published: (2025)

sEMG-based Gesture-Free Hand Intention Recognition: System, Dataset, Toolbox, and Benchmark Results
by: Li, Hongxin, et al.
Published: (2024)

GesPrompt: Leveraging Co-Speech Gestures to Augment LLM-Based Interaction in Virtual Reality
by: Hu, Xiyun, et al.
Published: (2025)

Feel my Speech: Automatic Speech Emotion Conversion for Tangible, Haptic, or Proxemic Interaction Design
by: Aslan, Ilhan
Published: (2024)

From Dyads to Groups: Rethinking Emotional Support with Conversational AI
by: Hu, Yuqing, et al.
Published: (2026)

Reimagining Wearable AR Gesture Design: Physical Therapy Reasoning in Everyday Contexts
by: Wu, Wei, et al.
Published: (2026)

Speech Command + Speech Emotion: Exploring Emotional Speech Commands as a Compound and Playful Modality
by: Aslan, Ilhan, et al.
Published: (2025)

Conversate: Supporting Reflective Learning in Interview Practice Through Interactive Simulation and Dialogic Feedback
by: Daryanto, Taufiq, et al.
Published: (2024)

MambaTalk: Efficient Holistic Gesture Synthesis with Selective State Space Models
by: Xu, Zunnan, et al.
Published: (2024)

Motion as Emotion: Detecting Affect and Cognitive Load from Free-Hand Gestures in VR
by: Chua, Phoebe, et al.
Published: (2024)

A Robot Expressing Emotions Through Gestures: Everyone Outside of Italy Would Understand this?
by: Consoli, Ilaria, et al.
Published: (2024)

PERCY: Personal Emotional Robotic Conversational System
by: Meng, Zhijin, et al.
Published: (2025)

Speech-Gesture Mapping and Engagement Evaluation in Human Robot Interaction
by: Ghosh, Bishal, et al.
Published: (2018)

ImaGGen: Zero-Shot Generation of Co-Speech Semantic Gestures Grounded in Language and Image Input
by: Voss, Hendric, et al.
Published: (2025)

A Conversational Approach to Well-being Awareness Creation and Behavioural Intention
by: Azzini, Antonia, et al.
Published: (2025)

DiM-Gestor: Co-Speech Gesture Generation with Adaptive Layer Normalization Mamba-2
by: Zhang, Fan, et al.
Published: (2024)

SingVisio: Visual Analytics of Diffusion Model for Singing Voice Conversion
by: Xue, Liumeng, et al.
Published: (2024)

The Wireless Charger as a Gesture Sensor: A Novel Approach to Ubiquitous Interaction
by: Wang, Weiyi, et al.
Published: (2025)

"How to Explore Biases in Speech Emotion AI with Users?" A Speech-Emotion-Acting Study Exploring Age and Language Biases
by: Borre, Josephine Beatrice Skovbo, et al.
Published: (2025)

Understanding Pedestrian Gesture Misrecognition: Insights from Vision-Language Model Reasoning
by: Tran, Tram Thi Minh, et al.
Published: (2025)

Enhancing EEG Signal-Based Emotion Recognition with Synthetic Data: Diffusion Model Approach
by: Siddhad, Gourav, et al.
Published: (2024)

GestureCoach: Rehearsing for Engaging Talks with LLM-Driven Gesture Recommendations
by: Ram, Ashwin, et al.
Published: (2025)

Improved Dysarthric Speech to Text Conversion via TTS Personalization
by: Mihajlik, Péter, et al.
Published: (2025)

Understanding Emotional Body Expressions via Large Language Models
by: Lu, Haifeng, et al.
Published: (2024)

Multimodal Dialog Systems with Dual Knowledge-enhanced Generative Pretrained Language Model
by: Chen, Xiaolin, et al.
Published: (2022)

OpenWatch: A Multimodal Benchmark for Hand Gesture Recognition on Smartwatches
by: Bonazzi, Pietro, et al.
Published: (2026)

Large Language Models in Qualitative Research: Uses, Tensions, and Intentions
by: Schroeder, Hope, et al.
Published: (2024)

Mental Models of Meeting Goals: Supporting Intentionality in Meeting Technologies
by: Scott, Ava Elizabeth, et al.
Published: (2024)

Emotionally Enriched Feedback via Generative AI
by: Alsaiari, Omar, et al.
Published: (2024)

Signaling Human Intentions to Service Robots: Understanding the Use of Social Cues during In-Person Conversations
by: Lyu, Hanfang, et al.
Published: (2025)

Text2Gestures: A Transformer-Based Network for Generating Emotive Body Gestures for Virtual Agents
by: Bhattacharya, Uttaran, et al.
Published: (2021)

Automated UI Interface Generation via Diffusion Models: Enhancing Personalization and Efficiency
by: Duan, Yifei, et al.
Published: (2025)

Agonistic Image Generation: Unsettling the Hegemony of Intention
by: Shaw, Andrew, et al.
Published: (2025)

GazeNoter: Co-Piloted AR Note-Taking via Gaze Selection of LLM Suggestions to Match Users' Intentions
by: Tsai, Hsin-Ruey, et al.
Published: (2024)