Cover Image

SkySim: A ROS2-based Simulation Environment for Natural Language Control of Drone Swarms using Large Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Shibu, Aditya, Saleh, Marah, Al-Musleh, Mohamed, Abdulaziz, Nidhal
Format:	Preprint
Published:	2026
Subjects:	Robotics Human-Computer Interaction
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Towards Natural Language Environment: Understanding Seamless Natural-Language-Based Human-Multi-Robot Interactions
by: Liu, Ziyi, et al.
Published: (2026)

TypeFly: Flying Drones with Large Language Model
by: Chen, Guojun, et al.
Published: (2023)

Simulating an Autonomous System in CARLA using ROS 2
by: Abdo, Joseph, et al.
Published: (2025)

Cognitive Guardrails for Open-World Decision Making in Autonomous Drone Swarms
by: Cleland-Huang, Jane, et al.
Published: (2025)

ROSClaw: An OpenClaw ROS 2 Framework for Agentic Robot Control and Interaction
by: Cardenas, Irvin Steve, et al.
Published: (2026)

Quadrupped-Legged Robot Movement Plan Generation using Large Language Model
by: Muhtadin, et al.
Published: (2025)

SwarmChat: An LLM-Based, Context-Aware Multimodal Interaction System for Robotic Swarms
by: Eumi, Ettilla Mohiuddin, et al.
Published: (2025)

Inferring World Belief States in Dynamic Real-World Environments
by: Kolb, Jack, et al.
Published: (2026)

LEGS-POMDP: Language and Gesture-Guided Object Search in Partially Observable Environments
by: He, Ivy Xiao, et al.
Published: (2026)

Adaptive Human-Swarm Interaction based on Workload Measurement using Functional Near-Infrared Spectroscopy
by: Abioye, Ayodeji O., et al.
Published: (2024)

The Conversation is the Command: Interacting with Real-World Autonomous Robot Through Natural Language
by: Nwankwo, Linus, et al.
Published: (2024)

LARS: Light Augmented Reality System for Swarm
by: Raoufi, Mohsen, et al.
Published: (2024)

Swarm Body: Embodied Swarm Robots
by: Ichihashi, Sosuke, et al.
Published: (2024)

The Design of Informative Take-Over Requests for Semi-Autonomous Cyber-Physical Systems: Combining Spoken Language and Visual Icons in a Drone-Controller Setting
by: Gundappa, Ashwini, et al.
Published: (2024)

Warmth and Competence in the Swarm: Designing Effective Human-Robot Teams
by: Miyauchi, Genki, et al.
Published: (2026)

Understanding Large-Language Model (LLM)-powered Human-Robot Interaction
by: Kim, Callie Y., et al.
Published: (2024)

The Effect of Predictive Formal Modelling at Runtime on Performance in Human-Swarm Interaction
by: Abioye, Ayodeji O., et al.
Published: (2024)

LaMI: Large Language Models for Multi-Modal Human-Robot Interaction
by: Wang, Chao, et al.
Published: (2024)

DVRP-MHSI: Dynamic Visualization Research Platform for Multimodal Human-Swarm Interaction
by: Zhu, Pengming, et al.
Published: (2024)

Swarm manipulation: An efficient and accurate technique for multi-object manipulation in virtual reality
by: Li, Xiang, et al.
Published: (2024)

Gaze-supported Large Language Model Framework for Bi-directional Human-Robot Interaction
by: Rüppel, Jens V., et al.
Published: (2025)

Enhancing Human-Robot Collaborative Assembly in Manufacturing Systems Using Large Language Models
by: Lim, Jonghan, et al.
Published: (2024)

SimCoachCorpus: A naturalistic dataset with language and trajectories for embodied teaching
by: Sumner, Emily, et al.
Published: (2025)

Sense4HRI: A ROS 2 HRI Framework for Physiological Sensor Integration and Synchronized Logging
by: Scheibl, Manuel, et al.
Published: (2026)

From One to Many: How Active Robot Swarm Sizes Influence Human Cognitive Processes
by: Kaduk, Julian, et al.
Published: (2024)

A Study on Human-Swarm Interaction: A Framework for Assessing Situation Awareness and Task Performance
by: Wattearachchi, Wasura D., et al.
Published: (2025)

Vision-Language System using Open-Source LLMs for Gestures in Medical Interpreter Robots
by: Ngo, Thanh-Tung, et al.
Published: (2026)

Alternative Interfaces for Human-initiated Natural Language Communication and Robot-initiated Haptic Feedback: Towards Better Situational Awareness in Human-Robot Collaboration
by: Bennie, Callum, et al.
Published: (2024)

Designing Effective Human-Swarm Interaction Interfaces: Insights from a User Study on Task Performance
by: Wattearachchi, Wasura D., et al.
Published: (2025)

Xpress: A System For Dynamic, Context-Aware Robot Facial Expressions using Language Models
by: Antony, Victor Nikhil, et al.
Published: (2025)

Integrating Large Language Models with Multimodal Virtual Reality Interfaces to Support Collaborative Human-Robot Construction Work
by: Park, Somin, et al.
Published: (2024)

How Do We Research Human-Robot Interaction in the Age of Large Language Models? A Systematic Review
by: Wang, Yufeng, et al.
Published: (2026)

Environment-Aware and Human-Cooperative Swing Control for Lower-Limb Prostheses in Diverse Obstacle Scenarios
by: Xing, Haosen, et al.
Published: (2025)

Empathic Grounding: Explorations using Multimodal Interaction and Large Language Models with Conversational Agents
by: Arjmand, Mehdi, et al.
Published: (2024)

Evaluating Interactions between Automated Vehicles and Cyclists using a coupled In-the-Loop Test Environment
by: Kaiser, Michael, et al.
Published: (2025)

Robot Tasks with Fuzzy Time Requirements from Natural Language Instructions
by: Sucker, Sascha, et al.
Published: (2024)

Cross-modality Force and Language Embeddings for Natural Human-Robot Communication
by: Tejwani, Ravi, et al.
Published: (2025)

Feasibility of Embodied Dynamics Based Bayesian Learning for Continuous Pursuit Motion Control of Assistive Mobile Robots in the Built Environment
by: Zhou, Xiaoshan, et al.
Published: (2025)

Applying Ontologies and Knowledge Augmented Large Language Models to Industrial Automation: A Decision-Making Guidance for Achieving Human-Robot Collaboration in Industry 5.0
by: Oyekan, John, et al.
Published: (2025)

Collecting Human Motion Data in Large and Occlusion-Prone Environments using Ultra-Wideband Localization
by: Kaden, Janik, et al.
Published: (2025)