Buchumschlag

A Modern System Recipe for Situated Embodied Human-Robot Conversation with Real-Time Multimodal LLMs and Tool-Calling

Fuente: arXiv

Gespeichert in:

Bibliographische Detailangaben
Hauptverfasser:	Lee, Dong Won, Gillet, Sarah, Morency, Louis-Philippe, Breazeal, Cynthia, Park, Hae Won
Format:	Preprint
Veröffentlicht:	2026
Schlagworte:	Robotics
Online-Zugang:	Acceder al recurso
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Ähnliche Einträge

Aligning Dialogue Agents with Global Feedback via Large Language Model Multimodal Reward Decomposition
von: Lee, Dong Won, et al.
Veröffentlicht: (2025)

Social Human Robot Embodied Conversation (SHREC) Dataset: Benchmarking Foundational Models' Social Reasoning
von: Lee, Dong Won, et al.
Veröffentlicht: (2025)

Integrating Flow Theory and Adaptive Robot Roles: A Conceptual Model of Dynamic Robot Role Adaptation for the Enhanced Flow Experience in Long-term Multi-person Human-Robot Interactions
von: Chen, Huili, et al.
Veröffentlicht: (2024)

Improving Dialogue Agents by Decomposing One Global Explicit Annotation with Local Implicit Multimodal Feedback
von: Lee, Dong Won, et al.
Veröffentlicht: (2024)

Social Robots as Social Proxies for Fostering Connection and Empathy Towards Humanity
von: Shen, Jocelyn, et al.
Veröffentlicht: (2025)

Does "Reasoning" with Large Language Models Improve Recognizing, Generating, and Reframing Unhelpful Thoughts?
von: Qi, Yilin, et al.
Veröffentlicht: (2025)

EL-AGHF: Extended Lagrangian Affine Geometric Heat Flow
von: Kim, Sangmin, et al.
Veröffentlicht: (2025)

A Learning Framework for Diverse Legged Robot Locomotion Using Barrier-Based Style Rewards
von: Kim, Gijeong, et al.
Veröffentlicht: (2024)

Alter-Art: Exploring Embodied Artistic Creation through a Robot Avatar
von: Park, Do Won, et al.
Veröffentlicht: (2026)

DynaFlow: Dynamics-embedded Flow Matching for Physically Consistent Motion Generation from State-only Demonstrations
von: Lee, Sowoo, et al.
Veröffentlicht: (2025)

Dynamically-Consistent Trajectory Optimization for Legged Robots via Contact Point Decomposition
von: Kim, Sangmin, et al.
Veröffentlicht: (2025)

HEART-felt Narratives: Tracing Empathy and Narrative Style in Personal Stories with LLMs
von: Shen, Jocelyn, et al.
Veröffentlicht: (2024)

Online Friction Coefficient Identification for Legged Robots on Slippery Terrain Using Smoothed Contact Gradients
von: Kim, Hajun, et al.
Veröffentlicht: (2025)

Design of a 3-DOF Hopping Robot with an Optimized Gearbox: An Intermediate Platform Toward Bipedal Robots
von: Choe, JongHun, et al.
Veröffentlicht: (2025)

Learning Impact-Rich Rotational Maneuvers via Centroidal Velocity Rewards and Sim-to-Real Techniques: A One-Leg Hopper Flip Case Study
von: Kang, Dongyun, et al.
Veröffentlicht: (2025)

Multimodal Large Language Models for Real-Time Situated Reasoning
von: Abbo, Giulio Antonio, et al.
Veröffentlicht: (2026)

Detection and Recognition: A Pairwise Interaction Framework for Mobile Service Robots
von: Liang, Mengyu, et al.
Veröffentlicht: (2026)

A Modular Residual Learning Framework to Enhance Model-Based Approach for Robust Locomotion
von: Kim, Min-Gyu, et al.
Veröffentlicht: (2025)

Multi-Sensor Fusion for Quadruped Robot State Estimation using Invariant Filtering and Smoothing
von: Nisticò, Ylenia, et al.
Veröffentlicht: (2025)

Dynamic Policy Learning for Legged Robot with Simplified Model Pretraining and Model Homotopy Transfer
von: Kang, Dongyun, et al.
Veröffentlicht: (2025)

AI or Human? Understanding Perceptions of Embodied Robots with LLMs
von: Hriscu, Lavinia, et al.
Veröffentlicht: (2025)

Actuator-Constrained Reinforcement Learning for High-Speed Quadrupedal Locomotion
von: Shin, Young-Ha, et al.
Veröffentlicht: (2023)

PPF: Pre-training and Preservative Fine-tuning of Humanoid Locomotion via Model-Assumption-based Regularization
von: Jung, Hyunyoung, et al.
Veröffentlicht: (2025)

An Android Robot Head as Embodied Conversational Agent
von: Heisler, Marcel, et al.
Veröffentlicht: (2023)

A HeARTfelt Robot: Social Robot-Driven Deep Emotional Art Reflection with Children
von: Pu, Isabella, et al.
Veröffentlicht: (2024)

Collaborative Conversation in Safe Multimodal Human-Robot Collaboration
von: Ferrari, Davide, et al.
Veröffentlicht: (2024)

Contact-Implicit Model Predictive Control: Controlling Diverse Quadruped Motions Without Pre-Planned Contact Modes or Trajectories
von: Kim, Gijeong, et al.
Veröffentlicht: (2023)

BT-ACTION: A Test-Driven Approach for Modular Understanding of User Instruction Leveraging Behaviour Trees and LLMs
von: Leszczynski, Alexander, et al.
Veröffentlicht: (2025)

When Robots Get Chatty: Grounding Multimodal Human-Robot Conversation and Collaboration
von: Allgeuer, Philipp, et al.
Veröffentlicht: (2024)

Embracing Evolution: A Call for Body-Control Co-Design in Embodied Humanoid Robot
von: Liu, Guiliang, et al.
Veröffentlicht: (2025)

Shaping Expressiveness in Robotics: The Role of Design Tools in Crafting Embodied Robot Movements
von: Zibetti, Elisabetta, et al.
Veröffentlicht: (2026)

Reinforcement Learning-based Robust Wall Climbing Locomotion Controller in Ferromagnetic Environment
von: Um, Yong, et al.
Veröffentlicht: (2025)

Imitating and Finetuning Model Predictive Control for Robust and Symmetric Quadrupedal Locomotion
von: Youm, Donghoon, et al.
Veröffentlicht: (2023)

Ice-Breakers, Turn-Takers and Fun-Makers: Exploring Robots for Groups with Teenagers
von: Gillet, Sarah, et al.
Veröffentlicht: (2025)

Real-time Photorealistic Mapping for Situational Awareness in Robot Teleoperation
von: Page, Ian, et al.
Veröffentlicht: (2025)

Real-time Robotics Situation Awareness for Accident Prevention in Industry
von: Deniz, Juan M., et al.
Veröffentlicht: (2024)

SemanticScanpath: Combining Gaze and Speech for Situated Human-Robot Interaction Using LLMs
von: Menendez, Elisabeth, et al.
Veröffentlicht: (2025)

How Many Training Samples Are Needed for the Inverse Kinematics Solutions by Artificial Neural Networks
von: Lim, Dong-Won
Veröffentlicht: (2026)

SP‐RTSD: A Lightweight Real‐Time Strawberry Detection on Edge Devices for Onboard Robotic Harvesting
von: Yujie Chen, et al.
Veröffentlicht: (2025)

EmpathicStories++: A Multimodal Dataset for Empathy towards Personal Experiences
von: Shen, Jocelyn, et al.
Veröffentlicht: (2024)