RACAS: Controlling Diverse Robots With a Single Agentic System

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ashley, Dylan R., Przepióra, Jan, Chen, Yimeng, Abualsaud, Ali, Yesmagambet, Nurzhan, Park, Shinkyu, Feron, Eric, Schmidhuber, Jürgen
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911505589469184
author Ashley, Dylan R.
Przepióra, Jan
Chen, Yimeng
Abualsaud, Ali
Yesmagambet, Nurzhan
Park, Shinkyu
Feron, Eric
Schmidhuber, Jürgen
author_facet Ashley, Dylan R.
Przepióra, Jan
Chen, Yimeng
Abualsaud, Ali
Yesmagambet, Nurzhan
Park, Shinkyu
Feron, Eric
Schmidhuber, Jürgen
contents Many robotic platforms expose an API through which external software can command their actuators and read their sensors. However, transitioning from these low-level interfaces to high-level autonomous behaviour requires a complicated pipeline, whose components demand distinct areas of expertise. Existing approaches to bridging this gap either require retraining for every new embodiment or have only been validated across structurally similar platforms. We introduce RACAS (Robot-Agnostic Control via Agentic Systems), a cooperative agentic architecture in which three LLM/VLM-based modules (Monitors, a Controller, and a Memory Curator) communicate exclusively through natural language to provide closed-loop robot control. RACAS requires only a natural language description of the robot, a definition of available actions, and a task specification; no source code, model weights, or reward functions need to be modified to move between platforms. We evaluate RACAS on several tasks using a wheeled ground robot, a recently published novel multi-jointed robotic limb, and an underwater vehicle. RACAS consistently solved all assigned tasks across these radically different platforms, demonstrating the potential of agentic AI to substantially reduce the barrier to prototyping robotic solutions.
format Preprint
id arxiv_https___arxiv_org_abs_2603_05621
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle RACAS: Controlling Diverse Robots With a Single Agentic System
Ashley, Dylan R.
Przepióra, Jan
Chen, Yimeng
Abualsaud, Ali
Yesmagambet, Nurzhan
Park, Shinkyu
Feron, Eric
Schmidhuber, Jürgen
Robotics
Artificial Intelligence
Computation and Language
Machine Learning
Multiagent Systems
68T40 (Primary) 68T07, 68T42, 68T45, 68T50 (Secondary)
I.2.9; I.2.6; I.2.7; I.2.10; I.2.11
Many robotic platforms expose an API through which external software can command their actuators and read their sensors. However, transitioning from these low-level interfaces to high-level autonomous behaviour requires a complicated pipeline, whose components demand distinct areas of expertise. Existing approaches to bridging this gap either require retraining for every new embodiment or have only been validated across structurally similar platforms. We introduce RACAS (Robot-Agnostic Control via Agentic Systems), a cooperative agentic architecture in which three LLM/VLM-based modules (Monitors, a Controller, and a Memory Curator) communicate exclusively through natural language to provide closed-loop robot control. RACAS requires only a natural language description of the robot, a definition of available actions, and a task specification; no source code, model weights, or reward functions need to be modified to move between platforms. We evaluate RACAS on several tasks using a wheeled ground robot, a recently published novel multi-jointed robotic limb, and an underwater vehicle. RACAS consistently solved all assigned tasks across these radically different platforms, demonstrating the potential of agentic AI to substantially reduce the barrier to prototyping robotic solutions.
title RACAS: Controlling Diverse Robots With a Single Agentic System
topic Robotics
Artificial Intelligence
Computation and Language
Machine Learning
Multiagent Systems
68T40 (Primary) 68T07, 68T42, 68T45, 68T50 (Secondary)
I.2.9; I.2.6; I.2.7; I.2.10; I.2.11
url https://arxiv.org/abs/2603.05621