Deploying Foundation Model-Enabled Air and Ground Robots in the Field: Challenges and Opportunities
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866912376129847296 |
|---|---|
| author | Ravichandran, Zachary Cladera, Fernando Hughes, Jason Murali, Varun Hsieh, M. Ani Pappas, George J. Taylor, Camillo J. Kumar, Vijay |
| author_facet | Ravichandran, Zachary Cladera, Fernando Hughes, Jason Murali, Varun Hsieh, M. Ani Pappas, George J. Taylor, Camillo J. Kumar, Vijay |
| contents | The integration of foundation models (FMs) into robotics has enabled robots to understand natural language and reason about the semantics in their environments. However, existing FM-enabled robots primary operate in closed-world settings, where the robot is given a full prior map or has a full view of its workspace. This paper addresses the deployment of FM-enabled robots in the field, where missions often require a robot to operate in large-scale and unstructured environments. To effectively accomplish these missions, robots must actively explore their environments, navigate obstacle-cluttered terrain, handle unexpected sensor inputs, and operate with compute constraints. We discuss recent deployments of SPINE, our LLM-enabled autonomy framework, in field robotic settings. To the best of our knowledge, we present the first demonstration of large-scale LLM-enabled robot planning in unstructured environments with several kilometers of missions. SPINE is agnostic to a particular LLM, which allows us to distill small language models capable of running onboard size, weight and power (SWaP) limited platforms. Via preliminary model distillation work, we then present the first language-driven UAV planner using on-device language models. We conclude our paper by proposing several promising directions for future research. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_09477 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Deploying Foundation Model-Enabled Air and Ground Robots in the Field: Challenges and Opportunities Ravichandran, Zachary Cladera, Fernando Hughes, Jason Murali, Varun Hsieh, M. Ani Pappas, George J. Taylor, Camillo J. Kumar, Vijay Robotics Artificial Intelligence The integration of foundation models (FMs) into robotics has enabled robots to understand natural language and reason about the semantics in their environments. However, existing FM-enabled robots primary operate in closed-world settings, where the robot is given a full prior map or has a full view of its workspace. This paper addresses the deployment of FM-enabled robots in the field, where missions often require a robot to operate in large-scale and unstructured environments. To effectively accomplish these missions, robots must actively explore their environments, navigate obstacle-cluttered terrain, handle unexpected sensor inputs, and operate with compute constraints. We discuss recent deployments of SPINE, our LLM-enabled autonomy framework, in field robotic settings. To the best of our knowledge, we present the first demonstration of large-scale LLM-enabled robot planning in unstructured environments with several kilometers of missions. SPINE is agnostic to a particular LLM, which allows us to distill small language models capable of running onboard size, weight and power (SWaP) limited platforms. Via preliminary model distillation work, we then present the first language-driven UAV planner using on-device language models. We conclude our paper by proposing several promising directions for future research. |
| title | Deploying Foundation Model-Enabled Air and Ground Robots in the Field: Challenges and Opportunities |
| topic | Robotics Artificial Intelligence |
| url | https://arxiv.org/abs/2505.09477 |