Cover Image

Utilizing Vision-Language Models as Action Models for Intent Recognition and Assistance

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Contreras, Cesar Alan, Chiou, Manolis, Rastegarpanah, Alireza, Szulik, Michal, Stolkin, Rustam
Format:	Preprint
Published:	2025
Subjects:	Robotics Artificial Intelligence Human-Computer Interaction
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Probabilistic Human Intent Prediction for Mobile Manipulation: An Evaluation with Human-Inspired Constraints
by: Contreras, Cesar Alan, et al.
Published: (2025)

Intent-Driven LLM Ensemble Planning for Flexible Multi-Robot Disassembly: Demonstration on EV Batteries
by: Erdogan, Cansu, et al.
Published: (2025)

A Mini-Review on Mobile Manipulators with Variable Autonomy
by: Contreras, Cesar Alan, et al.
Published: (2024)

An Exploratory Study on Crack Detection in Concrete through Human-Robot Collaboration
by: Kim, Junyeon, et al.
Published: (2025)

CARMA: Context-Aware Situational Grounding of Human-Robot Group Interactions by Combining Vision-Language Models with Object and Action Recognition
by: Deigmoeller, Joerg, et al.
Published: (2025)

Semi-autonomous Robotic Disassembly Enhanced by Mixed Reality
by: Rastegarpanah, Alireza, et al.
Published: (2024)

IntentCUA: Learning Intent-level Representations for Skill Abstraction and Multi-Agent Planning in Computer-Use Agents
by: Lee, Seoyoung, et al.
Published: (2026)

USER-VLM 360: Personalized Vision Language Models with User-aware Tuning for Social Human-Robot Interactions
by: Rahimi, Hamed, et al.
Published: (2025)

Text to Robotic Assembly of Multi Component Objects using 3D Generative AI and Vision Language Models
by: Kyaw, Alexander Htet, et al.
Published: (2025)

Existential Crisis: A Social Robot's Reason for Being
by: Medgyesy, Dora, et al.
Published: (2025)

Designing for Disagreement: Front-End Guardrails for Assistance Allocation in LLM-Enabled Robots
by: Ng, Carmen
Published: (2026)

Beyond Rigid AI: Towards Natural Human-Machine Symbiosis for Interoperative Surgical Assistance
by: Seenivasan, Lalithkumar, et al.
Published: (2025)

Integrating Intent Understanding and Optimal Behavior Planning for Behavior Tree Generation from Human Instructions
by: Chen, Xinglin, et al.
Published: (2024)

Human-centered AI with focus on Human-robot interaction (Book chapter)
by: Mortezapour, Alireza, et al.
Published: (2025)

Camera Control at the Edge with Language Models for Scene Understanding
by: Buynitsky, Alexiy, et al.
Published: (2025)

TypeFly: Flying Drones with Large Language Model
by: Chen, Guojun, et al.
Published: (2023)

Leveraging GCN-based Action Recognition for Teleoperation in Daily Activity Assistance
by: Kwok, Thomas M., et al.
Published: (2025)

Theory of Mind abilities of Large Language Models in Human-Robot Interaction : An Illusion?
by: Verma, Mudit, et al.
Published: (2024)

Exploring Large Language Models to Facilitate Variable Autonomy for Human-Robot Teaming
by: Lakhnati, Younes, et al.
Published: (2023)

Are Large Language Models Aligned with People's Social Intuitions for Human-Robot Interactions?
by: Wachowiak, Lennart, et al.
Published: (2024)

LLM A*: Human in the Loop Large Language Models Enabled A* Search for Robotics
by: Xiao, Hengjia, et al.
Published: (2023)

Shared Autonomy with IDA: Interventional Diffusion Assistance
by: McMahan, Brandon J., et al.
Published: (2024)

Developing Situational Awareness for Joint Action with Autonomous Vehicles
by: Kaufman, Robert, et al.
Published: (2024)

SARGes: Semantically Aligned Reliable Gesture Generation via Intent Chain
by: Gao, Nan, et al.
Published: (2025)

Think-Then-React: Towards Unconstrained Human Action-to-Reaction Generation
by: Tan, Wenhui, et al.
Published: (2025)

VARP: Reinforcement Learning from Vision-Language Model Feedback with Agent Regularized Preferences
by: Singh, Anukriti, et al.
Published: (2025)

Interactive Task Planning with Language Models
by: Li, Boyi, et al.
Published: (2023)

Reciprocal Learning of Intent Inferral with Augmented Visual Feedback for Stroke
by: Xu, Jingxi, et al.
Published: (2024)

I Was Blind but Now I See: Implementing Vision-Enabled Dialogue in Social Robots
by: Abbo, Giulio Antonio, et al.
Published: (2023)

Training Models to Detect Successive Robot Errors from Human Reactions
by: Liu, Shannon, et al.
Published: (2025)

Bootstrapping Linear Models for Fast Online Adaptation in Human-Agent Collaboration
by: Newman, Benjamin A, et al.
Published: (2024)

IntentVLM: Open-Vocabulary Intention Recognition through Forward-Inverse Modeling with Video-Language Models
by: Rahimi, Hamed, et al.
Published: (2026)

FlexiFly: Interfacing the Physical World with Foundation Models Empowered by Reconfigurable Drone Systems
by: Zhao, Minghui, et al.
Published: (2024)

Toward Informed AV Decision-Making: Computational Model of Well-being and Trust in Mobility
by: Zahedi, Zahra, et al.
Published: (2025)

The Use of Gaze-Derived Confidence of Inferred Operator Intent in Adjusting Safety-Conscious Haptic Assistance
by: Webb, Jeremy D., et al.
Published: (2025)

Chain-of-Modality: Learning Manipulation Programs from Multimodal Human Videos with Vision-Language-Models
by: Wang, Chen, et al.
Published: (2025)

Cross-modality Force and Language Embeddings for Natural Human-Robot Communication
by: Tejwani, Ravi, et al.
Published: (2025)

Natural Language Instructions for Intuitive Human Interaction with Robotic Assistants in Field Construction Work
by: Park, Somin, et al.
Published: (2023)

Toward Ownership Understanding of Objects: Active Question Generation with Large Language Model and Probabilistic Generative Model
by: Hashimoto, Saki, et al.
Published: (2025)

LLM4AD: Large Language Models for Autonomous Driving -- Concept, Review, Benchmark, Experiments, and Future Trends
by: Cui, Can, et al.
Published: (2024)