Cover Image

Robo-Instruct: Simulator-Augmented Instruction Alignment For Finetuning Code LLMs

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Hu, Zichao, Li, Junyi Jessy, Guha, Arjun, Biswas, Joydeep
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Artificial Intelligence Robotics
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Creating and Repairing Robot Programs in Open-World Domains
by: Schlesinger, Claire, et al.
Published: (2024)

ReMEmbR: Building and Reasoning Over Long-Horizon Spatio-Temporal Memory for Robot Navigation
by: Anwar, Abrar, et al.
Published: (2024)

Joint Verification and Refinement of Language Models for Safety-Constrained Planning
by: Yang, Yunhao, et al.
Published: (2024)

RAG-Instruct: Boosting LLMs with Diverse Retrieval-Augmented Instructions
by: Liu, Wanlong, et al.
Published: (2024)

InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environment
by: Long, Yuxing, et al.
Published: (2024)

RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twins
by: Mu, Yao, et al.
Published: (2025)

RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twins (early version)
by: Mu, Yao, et al.
Published: (2024)

Chain of Code: Reasoning with a Language Model-Augmented Code Emulator
by: Li, Chengshu, et al.
Published: (2023)

InverseCoder: Self-improving Instruction-Tuned Code LLMs with Inverse-Instruct
by: Wu, Yutong, et al.
Published: (2024)

ComposableNav: Instruction-Following Navigation in Dynamic Environments via Composable Diffusion
by: Hu, Zichao, et al.
Published: (2025)

CoFineLLM: Conformal Finetuning of LLMs for Language-Instructed Robot Planning
by: Wang, Jun, et al.
Published: (2025)

RoboPlayground: Democratizing Robotic Evaluation through Structured Physical Domains
by: Wang, Yi Ru, et al.
Published: (2026)

BeSimulator: A Large Language Model Powered Text-based Behavior Simulator
by: Wang, Jianan, et al.
Published: (2024)

Robo2VLM: Visual Question Answering from Large-Scale In-the-Wild Robot Manipulation Datasets
by: Chen, Kaiyuan, et al.
Published: (2025)

I2EDL: Interactive Instruction Error Detection and Localization
by: Taioli, Francesco, et al.
Published: (2024)

HyCodePolicy: Hybrid Language Controllers for Multimodal Monitoring and Decision in Embodied Agents
by: Liu, Yibin, et al.
Published: (2025)

LLMs Lean on Priors, Not Programming Language Semantics
by: Thimmaiah, Aditya, et al.
Published: (2025)

Investigating the Role of Instruction Variety and Task Difficulty in Robotic Manipulation Tasks
by: Parekh, Amit, et al.
Published: (2024)

Mind the Error! Detection and Localization of Instruction Errors in Vision-and-Language Navigation
by: Taioli, Francesco, et al.
Published: (2024)

Code-as-Symbolic-Planner: Foundation Model-Based Robot Planning via Symbolic Code Generation
by: Chen, Yongchao, et al.
Published: (2025)

Is It JUST Semantics? A Case Study of Discourse Particle Understanding in LLMs
by: Sheffield, William, et al.
Published: (2025)

REI-Bench: Can Embodied Agents Understand Vague Human Instructions in Task Planning?
by: Jiang, Chenxi, et al.
Published: (2025)

Embodied AI: From LLMs to World Models
by: Feng, Tongtong, et al.
Published: (2025)

RoboCodeX: Multimodal Code Generation for Robotic Behavior Synthesis
by: Mu, Yao, et al.
Published: (2024)

Simulating User Agents for Embodied Conversational-AI
by: Philipov, Daniel, et al.
Published: (2024)

RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Robotics
by: Song, Chan Hee, et al.
Published: (2024)

Deploying and Evaluating LLMs to Program Service Mobile Robots
by: Hu, Zichao, et al.
Published: (2023)

Prompt Selection and Augmentation for Few Examples Code Generation in Large Language Model and its Application in Robotics Control
by: Wu, On Tai, et al.
Published: (2024)

LLM-Empowered Embodied Agent for Memory-Augmented Task Planning in Household Robotics
by: Glocker, Marc, et al.
Published: (2025)

Can LLMs plan paths with extra hints from solvers?
by: Wu, Erik, et al.
Published: (2024)

Unseen from Seen: Rewriting Observation-Instruction Using Foundation Models for Augmenting Vision-Language Navigation
by: Wei, Ziming, et al.
Published: (2025)

ASMR: Augmenting Life Scenario using Large Generative Models for Robotic Action Reflection
by: Tsai, Shang-Chi, et al.
Published: (2025)

Continual Learning via Sparse Memory Finetuning
by: Lin, Jessy, et al.
Published: (2025)

InstructRetro: Instruction Tuning post Retrieval-Augmented Pretraining
by: Wang, Boxin, et al.
Published: (2023)

Ain't Misbehavin' -- Using LLMs to Generate Expressive Robot Behavior in Conversations with the Tabletop Robot Haru
by: Wang, Zining, et al.
Published: (2024)

General Agentic Planning Through Simulative Reasoning with World Models
by: Deng, Mingkai, et al.
Published: (2025)

Why We Need World Models for AGI: Where LLMs Fail and How World Models May Outperform
by: Alaswad, Feisal, et al.
Published: (2026)

MM-Instruct: Generated Visual Instructions for Large Multimodal Model Alignment
by: Liu, Jihao, et al.
Published: (2024)

Ada-Instruct: Adapting Instruction Generators for Complex Reasoning
by: Cui, Wanyun, et al.
Published: (2023)

Infinity Instruct: Scaling Instruction Selection and Synthesis to Enhance Language Models
by: Li, Jijie, et al.
Published: (2025)