Cover Image

Ablation Study of Multimodal Perception, Language Grounding, and Control for Human-Robot Interaction in an Object Detection and Grasping Task

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Tian, Zi, Shen, Guanting
Format:	Preprint
Published:	2026
Subjects:	Robotics Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

An Approach to Combining Video and Speech with Large Language Models in Human-Robot Interaction
by: Shen, Guanting, et al.
Published: (2026)

INVIGORATE: Interactive Visual Grounding and Grasping in Clutter
by: Zhang, Hanbo, et al.
Published: (2021)

HiFi-CS: Towards Open Vocabulary Visual Grounding For Robotic Grasping Using Vision-Language Models
by: Bhat, Vineet, et al.
Published: (2024)

GraspCorrect: Robotic Grasp Correction via Vision-Language Model-Guided Feedback
by: Lee, Sungjae, et al.
Published: (2025)

A High-Force Gripper with Embedded Multimodal Sensing for Powerful and Perception Driven Grasping
by: Del Bianco, Edoardo, et al.
Published: (2025)

ShapeGrasp: Zero-Shot Task-Oriented Grasping with Large Language Models through Geometric Decomposition
by: Li, Samuel, et al.
Published: (2024)

GraspFactory: A Large Object-Centric Grasping Dataset
by: Srinivas, Srinidhi Kalgundi, et al.
Published: (2025)

Kaiwu: A Multimodal Manipulation Dataset and Framework for Robot Learning and Human-Robot Interaction
by: Jiang, Shuo, et al.
Published: (2025)

Visuo-Haptic Object Perception for Robots: An Overview
by: Navarro-Guerrero, Nicolás, et al.
Published: (2022)

A Graph-to-Text Approach to Knowledge-Grounded Response Generation in Human-Robot Interaction
by: Walker, Nicholas Thomas, et al.
Published: (2023)

CARMA: Context-Aware Situational Grounding of Human-Robot Group Interactions by Combining Vision-Language Models with Object and Action Recognition
by: Deigmoeller, Joerg, et al.
Published: (2025)

GraspGF: Learning Score-based Grasping Primitive for Human-assisting Dexterous Grasping
by: Wu, Tianhao, et al.
Published: (2023)

Multi-Class Human/Object Detection on Robot Manipulators using Proprioceptive Sensing
by: Hehli, Justin, et al.
Published: (2025)

Grasp Like Humans: Learning Generalizable Multi-Fingered Grasping from Human Proprioceptive Sensorimotor Integration
by: Guo, Ce, et al.
Published: (2025)

Inference of Upcoming Human Grasp Using EMG During Reach-to-Grasp Movement
by: Han, Mo, et al.
Published: (2021)

Visuomotor Grasping with World Models for Surgical Robots
by: Lin, Hongbin, et al.
Published: (2025)

Safe Probabilistic Planning for Human-Robot Interaction using Conformal Risk Control
by: Gonzales, Jake, et al.
Published: (2026)

VLAD-Grasp: Zero-shot Grasp Detection via Vision-Language Models
by: Kulshrestha, Manav, et al.
Published: (2025)

VCoT-Grasp: Grasp Foundation Models with Visual Chain-of-Thought Reasoning for Language-driven Grasp Generation
by: Zhang, Haoran, et al.
Published: (2025)

3D-Grounded Vision-Language Framework for Robotic Task Planning: Automated Prompt Synthesis and Supervised Reasoning
by: Tang, Guoqin, et al.
Published: (2025)

Towards Affect-Adaptive Human-Robot Interaction: A Protocol for Multimodal Dataset Collection on Social Anxiety
by: Poprcova, Vesna, et al.
Published: (2025)

Show and Grasp: Few-shot Semantic Segmentation for Robot Grasping through Zero-shot Foundation Models
by: Barcellona, Leonardo, et al.
Published: (2024)

Safe Multimodal Communication in Human-Robot Collaboration
by: Ferrari, Davide, et al.
Published: (2023)

Attribute-Based Robotic Grasping with Data-Efficient Adaptation
by: Yang, Yang, et al.
Published: (2025)

Local Occupancy-Enhanced Object Grasping with Multiple Triplanar Projection
by: Ma, Kangqi, et al.
Published: (2024)

Visual-tactile Fusion for Transparent Object Grasping in Complex Backgrounds
by: Li, Shoujie, et al.
Published: (2022)

Volumetric Reconstruction From Partial Views for Task-Oriented Grasping
by: Yan, Fujian, et al.
Published: (2025)

Theory of Mind for Explainable Human-Robot Interaction
by: Bauer, Marie S., et al.
Published: (2025)

CooHOI: Learning Cooperative Human-Object Interaction with Manipulated Object Dynamics
by: Gao, Jiawei, et al.
Published: (2024)

Inverse Kinematics for Neuro-Robotic Grasping with Humanoid Embodied Agents
by: Habekost, Jan-Gerrit, et al.
Published: (2024)

3DSGrasp: 3D Shape-Completion for Robotic Grasp
by: Mohammadi, Seyed S., et al.
Published: (2023)

Grounded Vision-Language Interpreter for Integrated Task and Motion Planning
by: Siburian, Jeremy, et al.
Published: (2025)

IndoorBEV: Joint Detection and Footprint Completion of Objects via Mask-based Prediction in Indoor Scenarios for Bird's-Eye View Perception
by: Li, Haichuan, et al.
Published: (2025)

OnlineHOI: Towards Online Human-Object Interaction Generation and Perception
by: Ji, Yihong, et al.
Published: (2025)

PhyGrasp: Generalizing Robotic Grasping with Physics-informed Large Multimodal Models
by: Guo, Dingkun, et al.
Published: (2024)

DexGraspVLA: A Vision-Language-Action Framework Towards General Dexterous Grasping
by: Zhong, Yifan, et al.
Published: (2025)

FastGrasp: Learning-based Whole-body Control method for Fast Dexterous Grasping with Mobile Manipulators
by: Tao, Heng, et al.
Published: (2026)

Autonomous Human-Robot Interaction via Operator Imitation
by: Christen, Sammy, et al.
Published: (2025)

Grounding Language Models with Semantic Digital Twins for Robotic Planning
by: Naeem, Mehreen, et al.
Published: (2025)

STEER: Flexible Robotic Manipulation via Dense Language Grounding
by: Smith, Laura, et al.
Published: (2024)