Cover Image

Bridging Speech, Emotion, and Motion: a VLM-based Multimodal Edge-deployable Framework for Humanoid Robots

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yang, Songhua, Li, Xuetao, Fei, Xuanye, Li, Mengde, Li, Miao
Format:	Preprint
Published:	2026
Subjects:	Robotics Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

RGMP: Recurrent Geometric-prior Multimodal Policy for Generalizable Humanoid Robot Manipulation
by: Li, Xuetao, et al.
Published: (2025)

Generalizable Geometric Prior and Recurrent Spiking Feature Learning for Humanoid Robot Manipulation
by: Li, Xuetao, et al.
Published: (2026)

INTENTION: Inferring Tendencies of Humanoid Robot Motion Through Interactive Intuition and Grounded VLM
by: Wang, Jin, et al.
Published: (2025)

Learning Robust Grasping Strategy Through Tactile Sensing and Adaption Skill
by: Hu, Yueming, et al.
Published: (2024)

Harmon: Whole-Body Motion Generation of Humanoid Robots from Language Descriptions
by: Jiang, Zhenyu, et al.
Published: (2024)

TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Control
by: Xie, Weiji, et al.
Published: (2026)

RobotDancing: Residual-Action Reinforcement Learning Enables Robust Long-Horizon Humanoid Motion Tracking
by: Sun, Zhenguo, et al.
Published: (2025)

EMOTION: Expressive Motion Sequence Generation for Humanoid Robots with In-Context Learning
by: Huang, Peide, et al.
Published: (2024)

Robot Collapse: Supply Chain Backdoor Attacks Against VLM-based Robotic Manipulation
by: Wang, Xianlong, et al.
Published: (2024)

Get It Right: Improving Comprehensibility with Adaptable Speech Expression of a Humanoid Service Robot
by: Sievers, Thomas, et al.
Published: (2024)

When Attention Betrays: Erasing Backdoor Attacks in Robotic Policies by Reconstructing Visual Tokens
by: Li, Xuetao, et al.
Published: (2026)

Multi-Scenario Reasoning: Unlocking Cognitive Autonomy in Humanoid Robots for Multimodal Understanding
by: Wang, Libo
Published: (2024)

Human-Humanoid Robots Cross-Embodiment Behavior-Skill Transfer Using Decomposed Adversarial Learning from Demonstration
by: Liu, Junjia, et al.
Published: (2024)

Multi-Gait Learning for Humanoid Robots Using Reinforcement Learning with Selective Adversarial Motion Prior
by: Wu, Yuanye, et al.
Published: (2026)

Humanoid World Models: Open World Foundation Models for Humanoid Robotics
by: Ali, Muhammad Qasim, et al.
Published: (2025)

StyleLoco: Generative Adversarial Distillation for Natural Humanoid Robot Locomotion
by: Ma, Le, et al.
Published: (2025)

Kaiwu: A Multimodal Manipulation Dataset and Framework for Robot Learning and Human-Robot Interaction
by: Jiang, Shuo, et al.
Published: (2025)

AMO: Adaptive Motion Optimization for Hyper-Dexterous Humanoid Whole-Body Control
by: Li, Jialong, et al.
Published: (2025)

On the Vulnerability of LLM/VLM-Controlled Robotics
by: Wu, Xiyang, et al.
Published: (2024)

Mobile-TeleVision: Predictive Motion Priors for Humanoid Whole-Body Control
by: Lu, Chenhao, et al.
Published: (2024)

Efficient Emotion-Aware Iconic Gesture Prediction for Robot Co-Speech
by: Montiel-Vazquez, Edwin C., et al.
Published: (2026)

Humanoid Occupancy: Enabling A Generalized Multimodal Occupancy Perception System on Humanoid Robots
by: Cui, Wei, et al.
Published: (2025)

A Real-to-Sim-to-Real Approach to Robotic Manipulation with VLM-Generated Iterative Keypoint Rewards
by: Patel, Shivansh, et al.
Published: (2025)

MetaWorld-X: Hierarchical World Modeling via VLM-Orchestrated Experts for Humanoid Loco-Manipulation
by: Shen, Yutong, et al.
Published: (2026)

CLOT: Closed-Loop Global Motion Tracking for Whole-Body Humanoid Teleoperation
by: Zhu, Tengjie, et al.
Published: (2026)

Unified Embodied VLM Reasoning with Robotic Action via Autoregressive Discretized Pre-training
by: Liu, Yi, et al.
Published: (2025)

Towards Adaptable Humanoid Control via Adaptive Motion Tracking
by: Huang, Tao, et al.
Published: (2025)

PolySim: Bridging the Sim-to-Real Gap for Humanoid Control via Multi-Simulator Dynamics Randomization
by: Lei, Zixing, et al.
Published: (2025)

Perceiving, Reasoning, Adapting: A Dual-Layer Framework for VLM-Guided Precision Robotic Manipulation
by: Jia, Qingxuan, et al.
Published: (2025)

VividFace: Real-Time and Realistic Facial Expression Shadowing for Humanoid Robots
by: Li, Peizhen, et al.
Published: (2026)

The Robot's Inner Critic: Self-Refinement of Social Behaviors through VLM-based Replanning
by: Lim, Jiyu, et al.
Published: (2026)

Endowing GPT-4 with a Humanoid Body: Building the Bridge Between Off-the-Shelf VLMs and the Physical World
by: Jian, Yingzhao, et al.
Published: (2025)

A Semantic Autonomy Framework for VLM-Integrated Indoor Mobile Robots: Hybrid Deterministic Reasoning and Cross-Robot Adaptive Memory
by: Abaza, Bogdan Felician, et al.
Published: (2026)

Heracles: Bridging Precise Tracking and Generative Synthesis for General Humanoid Control
by: Tao, Zelin, et al.
Published: (2026)

LiteVLA-Edge: Quantized On-Device Multimodal Control for Embedded Robotics
by: Williams, Justin, et al.
Published: (2026)

One-shot Adaptation of Humanoid Whole-body Motion with Walking Priors
by: Huang, Hao, et al.
Published: (2025)

Keypoint-based Diffusion for Robotic Motion Planning on the NICOL Robot
by: Clasmeier, Lennart, et al.
Published: (2025)

Learning the Generalizable Manipulation Skills on Soft-body Tasks via Guided Self-attention Behavior Cloning Policy
by: Li, Xuetao, et al.
Published: (2024)

Learning Human-Like Badminton Skills for Humanoid Robots
by: Chen, Yeke, et al.
Published: (2026)

Humanoid Manipulation Interface: Humanoid Whole-Body Manipulation from Robot-Free Demonstrations
by: Nai, Ruiqian, et al.
Published: (2026)