OVITA: Open-Vocabulary Interpretable Trajectory Adaptations

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Maurya, Anurag, Ghosh, Tashmoy, Nguyen, Anh, Prakash, Ravi
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908500141015040
author Maurya, Anurag
Ghosh, Tashmoy
Nguyen, Anh
Prakash, Ravi
author_facet Maurya, Anurag
Ghosh, Tashmoy
Nguyen, Anh
Prakash, Ravi
contents Adapting trajectories to dynamic situations and user preferences is crucial for robot operation in unstructured environments with non-expert users. Natural language enables users to express these adjustments in an interactive manner. We introduce OVITA, an interpretable, open-vocabulary, language-driven framework designed for adapting robot trajectories in dynamic and novel situations based on human instructions. OVITA leverages multiple pre-trained Large Language Models (LLMs) to integrate user commands into trajectories generated by motion planners or those learned through demonstrations. OVITA employs code as an adaptation policy generated by an LLM, enabling users to adjust individual waypoints, thus providing flexible control. Another LLM, which acts as a code explainer, removes the need for expert users, enabling intuitive interactions. The efficacy and significance of the proposed OVITA framework is demonstrated through extensive simulations and real-world environments with diverse tasks involving spatiotemporal variations on heterogeneous robotic platforms such as a KUKA IIWA robot manipulator, Clearpath Jackal ground robot, and CrazyFlie drone.
format Preprint
id arxiv_https___arxiv_org_abs_2508_17260
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle OVITA: Open-Vocabulary Interpretable Trajectory Adaptations
Maurya, Anurag
Ghosh, Tashmoy
Nguyen, Anh
Prakash, Ravi
Robotics
Adapting trajectories to dynamic situations and user preferences is crucial for robot operation in unstructured environments with non-expert users. Natural language enables users to express these adjustments in an interactive manner. We introduce OVITA, an interpretable, open-vocabulary, language-driven framework designed for adapting robot trajectories in dynamic and novel situations based on human instructions. OVITA leverages multiple pre-trained Large Language Models (LLMs) to integrate user commands into trajectories generated by motion planners or those learned through demonstrations. OVITA employs code as an adaptation policy generated by an LLM, enabling users to adjust individual waypoints, thus providing flexible control. Another LLM, which acts as a code explainer, removes the need for expert users, enabling intuitive interactions. The efficacy and significance of the proposed OVITA framework is demonstrated through extensive simulations and real-world environments with diverse tasks involving spatiotemporal variations on heterogeneous robotic platforms such as a KUKA IIWA robot manipulator, Clearpath Jackal ground robot, and CrazyFlie drone.
title OVITA: Open-Vocabulary Interpretable Trajectory Adaptations
topic Robotics
url https://arxiv.org/abs/2508.17260