Toward Accurate Long-Horizon Robotic Manipulation: Language-to-Action with Foundation Models via Scene Graphs

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Dinesh, Sushil Samuel, Park, Shinkyu
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915588707713024
author Dinesh, Sushil Samuel
Park, Shinkyu
author_facet Dinesh, Sushil Samuel
Park, Shinkyu
contents This paper presents a framework that leverages pre-trained foundation models for robotic manipulation without domain-specific training. The framework integrates off-the-shelf models, combining multimodal perception from foundation models with a general-purpose reasoning model capable of robust task sequencing. Scene graphs, dynamically maintained within the framework, provide spatial awareness and enable consistent reasoning about the environment. The framework is evaluated through a series of tabletop robotic manipulation experiments, and the results highlight its potential for building robotic manipulation systems directly on top of off-the-shelf foundation models.
format Preprint
id arxiv_https___arxiv_org_abs_2510_27558
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Toward Accurate Long-Horizon Robotic Manipulation: Language-to-Action with Foundation Models via Scene Graphs
Dinesh, Sushil Samuel
Park, Shinkyu
Robotics
Artificial Intelligence
Machine Learning
This paper presents a framework that leverages pre-trained foundation models for robotic manipulation without domain-specific training. The framework integrates off-the-shelf models, combining multimodal perception from foundation models with a general-purpose reasoning model capable of robust task sequencing. Scene graphs, dynamically maintained within the framework, provide spatial awareness and enable consistent reasoning about the environment. The framework is evaluated through a series of tabletop robotic manipulation experiments, and the results highlight its potential for building robotic manipulation systems directly on top of off-the-shelf foundation models.
title Toward Accurate Long-Horizon Robotic Manipulation: Language-to-Action with Foundation Models via Scene Graphs
topic Robotics
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2510.27558