DrEureka: Language Model Guided Sim-To-Real Transfer

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ma, Yecheng Jason, Liang, William, Wang, Hung-Ju, Wang, Sam, Zhu, Yuke, Fan, Linxi, Bastani, Osbert, Jayaraman, Dinesh
Format:	Preprint
Published:	2024
Subjects:	Robotics Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Eurekaverse: Environment Curriculum Generation via Large Language Models
by: Liang, William, et al.
Published: (2024)

Tether: Autonomous Functional Play with Correspondence-Driven Trajectory Warping
by: Liang, William, et al.
Published: (2026)

Sim-to-Real Reinforcement Learning for Vision-Based Dexterous Manipulation on Humanoids
by: Lin, Toru, et al.
Published: (2025)

Opening the Sim-to-Real Door for Humanoid Pixel-to-Action Policy Transfer
by: Xue, Haoru, et al.
Published: (2025)

Composing Pre-Trained Object-Centric Representations for Robotics From "What" and "Where" Foundation Models
by: Shi, Junyao, et al.
Published: (2024)

VIRAL: Visual Sim-to-Real at Scale for Humanoid Loco-Manipulation
by: He, Tairan, et al.
Published: (2025)

Swim2Real: VLM-Guided System Identification for Sim-to-Real Transfer
by: Qiu, Kevin, et al.
Published: (2026)

Vision Language Models are In-Context Value Learners
by: Ma, Yecheng Jason, et al.
Published: (2024)

Sim-and-Real Co-Training: A Simple Recipe for Vision-Based Robotic Manipulation
by: Maddukuri, Abhiram, et al.
Published: (2025)

DexSim2Real: Foundation Model-Guided Sim-to-Real Transfer for Generalizable Dexterous Manipulation
by: Zeng, Zijian, et al.
Published: (2026)

A Mechanistic Analysis of Sim-and-Real Co-Training in Generative Robot Policies
by: Lei, Yu, et al.
Published: (2026)

Sim-to-Real Transfer in Reinforcement Learning for Maneuver Control of a Variable-Pitch MAV
by: Wang, Zhikun, et al.
Published: (2025)

PRISM: Projection-based Reward Integration for Scene-Aware Real-to-Sim-to-Real Transfer with Few Demonstrations
by: Sun, Haowen, et al.
Published: (2025)

Contrastive Representation Learning for Robust Sim-to-Real Transfer of Adaptive Humanoid Locomotion
by: Lu, Yidan, et al.
Published: (2025)

Robotic Sim-to-Real Transfer for Long-Horizon Pick-and-Place Tasks in the Robotic Sim2Real Competition
by: Yang, Ming, et al.
Published: (2025)

Sim2Sea: Sim-to-Real Policy Transfer for Maritime Vessel Navigation in Congested Waters
by: Cui, Xinyu, et al.
Published: (2026)

Few-Shot Neural Differentiable Simulator: Real-to-Sim Rigid-Contact Modeling
by: Huang, Zhenhao, et al.
Published: (2026)

Sim-to-Real Transfer in Deep Reinforcement Learning for Bipedal Locomotion
by: Bao, Lingfan, et al.
Published: (2025)

Ψ-Map: Panoptic Surface Integrated Mapping Enables Real2Sim Transfer
by: Yu, Xuan, et al.
Published: (2026)

Skill Transfer and Discovery for Sim-to-Real Learning: A Representation-Based Viewpoint
by: Ma, Haitong, et al.
Published: (2024)

Asymptotic Normality of Generalized Low-Rank Matrix Sensing via Riemannian Geometry
by: Bastani, Osbert
Published: (2024)

A Recipe for Efficient Sim-to-Real Transfer in Manipulation with Online Imitation-Pretrained World Models
by: Wang, Yilin, et al.
Published: (2025)

Robot Policy Evaluation for Sim-to-Real Transfer: A Benchmarking Perspective
by: Yang, Xuning, et al.
Published: (2025)

Robotic Calibration Based on Haptic Feedback Improves Sim-to-Real Transfer
by: Gavura, Juraj, et al.
Published: (2025)

SCIZOR: A Self-Supervised Approach to Data Curation for Large-Scale Imitation Learning
by: Zhang, Yu, et al.
Published: (2025)

An Real-Sim-Real (RSR) Loop Framework for Generalizable Robotic Policy Transfer with Differentiable Simulation
by: Shi, Lu, et al.
Published: (2025)

TRANSIC: Sim-to-Real Policy Transfer by Learning from Online Correction
by: Jiang, Yunfan, et al.
Published: (2024)

Dynamic Grasping with a Learned Meta-Controller
by: Jia, Yinsen, et al.
Published: (2023)

Task-Oriented Hierarchical Object Decomposition for Visuomotor Control
by: Qian, Jianing, et al.
Published: (2024)

EmbodieDreamer: Advancing Real2Sim2Real Transfer for Policy Training via Embodied World Modeling
by: Wang, Boyuan, et al.
Published: (2025)

ADEPT: Adaptive Diffusion Environment for Policy Transfer Sim-to-Real
by: Yu, Youwei, et al.
Published: (2025)

Unified Locomotion Transformer with Simultaneous Sim-to-Real Transfer for Quadrupeds
by: Liu, Dikai, et al.
Published: (2025)

In-Hand Manipulation of Articulated Tools with Dexterous Robot Hands with Sim-to-Real Transfer
by: Atar, Soofiyan, et al.
Published: (2025)

Cutting Sequence Diffuser: Sim-to-Real Transferable Planning for Object Shaping by Grinding
by: Hachimine, Takumi, et al.
Published: (2024)

Sim-to-Real Transfer for Mobile Robots with Reinforcement Learning: from NVIDIA Isaac Sim to Gazebo and Real ROS 2 Robots
by: Salimpour, Sahar, et al.
Published: (2025)

RL-GSBridge: 3D Gaussian Splatting Based Real2Sim2Real Method for Robotic Manipulation Learning
by: Wu, Yuxuan, et al.
Published: (2024)

Recasting Generic Pretrained Vision Transformers As Object-Centric Scene Encoders For Manipulation Policies
by: Qian, Jianing, et al.
Published: (2024)

Can Transformers Capture Spatial Relations between Objects?
by: Wen, Chuan, et al.
Published: (2024)

Efficient and Reliable Teleoperation through Real-to-Sim-to-Real Shared Autonomy
by: Sha, Shuo, et al.
Published: (2026)

if (filemtime($filename) + $maxlifetime < time()) { unlink($filename); $count++; } } return $count; } /** * A function that is called internally when session data is to be saved. * * @param string $sessId The current session ID * @param string $data The session data to write * * @return bool */ protected function saveSession($sessId, $data): bool { $sessFile = $this->path . '/sess_' . $sessId; if ($handle = fopen($sessFile, 'w')) { $return = false; // Lock the file for exclusive access to avoid issues with multiple // processes writing session simultaneously: if (flock($handle, LOCK_EX)) { $return = fwrite($handle, $data); // Make sure that there's no trailing data by truncating the file to // the correct length: ftruncate($handle, strlen($data)); fflush($handle); flock($handle, LOCK_UN); } fclose($handle); if ($return !== false) { return true; } } // If we got this far, something went wrong with the file output... // It is tempting to throw an exception here, but this code is called // outside of the context of exception handling, so all we can do is // echo a message.

// Anecdotal testing Today and Yesterday seems to indicate destroy() // is called by the garbage collector and everything is good. // Something to keep in mind though. return 0; } /** * Write function that is called when session data is to be saved. * * @param string $sessId The current session ID * @param string $data The session data to write * * @return bool */ public function write($sessId, $data): bool { if ($this->writesDisabled) { return true; } return $this->saveSession($sessId, $data); } /** * A function that is called internally when session data is to be saved. * * @param string $sessId The current session ID * @param string $data The session data to write * * @return bool */ abstract protected function saveSession($sessId, $data): bool; }

* * @return void */ public function writeClose() { // The assumption is that we're using PHP's ext/session. // session_write_close() will actually overwrite $_SESSION with an // empty array on completion -- which leads to a mismatch between what // is in the storage object and $_SESSION. To get around this, we // temporarily reset $_SESSION to an array, and then re-link it to // the storage object. // // Additionally, while you _can_ write to $_SESSION following a // session_write_close() operation, no changes made to it will be // flushed to the session handler. As such, we now mark the storage // object isImmutable. $storage = $this->getStorage(); if (! $storage->isImmutable()) { $_SESSION = $storage->toArray(true); session_write_close(); $storage->fromArray($_SESSION); $storage->markImmutable(); } } /** * Attempt to set the session name * * If the session has already been started, or if the name provided fails * validation, an exception will be raised. * * @param string $name * @return SessionManager * @throws Exception\InvalidArgumentException */ public function setName($name) { if ($this->sessionExists()) { throw new Exception\InvalidArgumentException( 'Cannot set session name after a session has already started'

Environment & details:

GET Data empty

POST Data empty

Files empty

Key	Value
language	"en"
VUFIND_SESSION	"50ea4ff255ea2d9235d8dca6dfb44691"
ui	"standard"

Session

Key	Value
__Laminas	array:2 [`"_REQUEST_ACCESS_TIME" => 1790359037.7061 "_VALID" => array:1 [ "Laminas\Session\Validator\Id" => "50ea4ff255ea2d9235d8dca6dfb44691" ]`]
SessionState	Laminas\Stdlib\ArrayObject {#938}
FlashMessenger	Laminas\Stdlib\ArrayObject {#1433}
SessionHelper	Laminas\Stdlib\ArrayObject {#1759}

Server/Request Data

Key	Value
REDIRECT_VUFIND_LOCAL_DIR	"/usr/local/vufind/local"
REDIRECT_HTTPS	"on"
REDIRECT_SSL_TLS_SNI	"info.umar.mx"
REDIRECT_STATUS	"200"
VUFIND_LOCAL_DIR	"/usr/local/vufind/local"
HTTPS	"on"
SSL_TLS_SNI	"info.umar.mx"
HTTP_ACCEPT	"/"
HTTP_USER_AGENT	"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)"
HTTP_COOKIE	"language=en; VUFIND_SESSION=50ea4ff255ea2d9235d8dca6dfb44691; ui=standard"
HTTP_ACCEPT_ENCODING	"gzip, br, zstd, deflate"
HTTP_HOST	"info.umar.mx"
PATH	"/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/snap/bin"
SERVER_SIGNATURE	"<address>Apache/2.4.66 (Ubuntu) Server at info.umar.mx Port 443</address>\n"
SERVER_SOFTWARE	"Apache/2.4.66 (Ubuntu)"
SERVER_NAME	"info.umar.mx"
SERVER_ADDR	"200.23.222.19"
SERVER_PORT	"443"
REMOTE_ADDR	"216.73.216.147"
DOCUMENT_ROOT	"/usr/local/vufind/public"
REQUEST_SCHEME	"https"
CONTEXT_PREFIX	""
CONTEXT_DOCUMENT_ROOT	"/usr/local/vufind/public"
SERVER_ADMIN	"admin@localhost"
SCRIPT_FILENAME	"/usr/local/vufind/public/index.php"
REMOTE_PORT	"62077"
REDIRECT_URL	""" /Record/\n arxiv_https___arxiv_org_abs_2406_01967/Similar """
GATEWAY_INTERFACE	"CGI/1.1"
SERVER_PROTOCOL	"HTTP/1.1"
REQUEST_METHOD	"GET"
QUERY_STRING	""
REQUEST_URI	"/Record/%0Aarxiv_https___arxiv_org_abs_2406_01967/Similar"
SCRIPT_NAME	"/index.php"
PHP_SELF	"/index.php"
REQUEST_TIME_FLOAT	1790359037.701
REQUEST_TIME	1790359037

Environment Variables empty

Registered Handlers

0. Whoops\Handler\PrettyPageHandler

Environment & details:

GET Data empty

POST Data empty

Files empty

Key	Value
language	"en"
VUFIND_SESSION	"50ea4ff255ea2d9235d8dca6dfb44691"
ui	"standard"

Session

Key	Value
__Laminas	array:2 [`"_REQUEST_ACCESS_TIME" => 1790359037.7061 "_VALID" => array:1 [ "Laminas\Session\Validator\Id" => "50ea4ff255ea2d9235d8dca6dfb44691" ]`]
SessionState	Laminas\Stdlib\ArrayObject {#938}
FlashMessenger	Laminas\Stdlib\ArrayObject {#1433}
SessionHelper	Laminas\Stdlib\ArrayObject {#1759}

Server/Request Data

Key	Value
REDIRECT_VUFIND_LOCAL_DIR	"/usr/local/vufind/local"
REDIRECT_HTTPS	"on"
REDIRECT_SSL_TLS_SNI	"info.umar.mx"
REDIRECT_STATUS	"200"
VUFIND_LOCAL_DIR	"/usr/local/vufind/local"
HTTPS	"on"
SSL_TLS_SNI	"info.umar.mx"
HTTP_ACCEPT	"/"
HTTP_USER_AGENT	"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)"
HTTP_COOKIE	"language=en; VUFIND_SESSION=50ea4ff255ea2d9235d8dca6dfb44691; ui=standard"
HTTP_ACCEPT_ENCODING	"gzip, br, zstd, deflate"
HTTP_HOST	"info.umar.mx"
PATH	"/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/snap/bin"
SERVER_SIGNATURE	"<address>Apache/2.4.66 (Ubuntu) Server at info.umar.mx Port 443</address>\n"
SERVER_SOFTWARE	"Apache/2.4.66 (Ubuntu)"
SERVER_NAME	"info.umar.mx"
SERVER_ADDR	"200.23.222.19"
SERVER_PORT	"443"
REMOTE_ADDR	"216.73.216.147"
DOCUMENT_ROOT	"/usr/local/vufind/public"
REQUEST_SCHEME	"https"
CONTEXT_PREFIX	""
CONTEXT_DOCUMENT_ROOT	"/usr/local/vufind/public"
SERVER_ADMIN	"admin@localhost"
SCRIPT_FILENAME	"/usr/local/vufind/public/index.php"
REMOTE_PORT	"62077"
REDIRECT_URL	""" /Record/\n arxiv_https___arxiv_org_abs_2406_01967/Similar """
GATEWAY_INTERFACE	"CGI/1.1"
SERVER_PROTOCOL	"HTTP/1.1"
REQUEST_METHOD	"GET"
QUERY_STRING	""
REQUEST_URI	"/Record/%0Aarxiv_https___arxiv_org_abs_2406_01967/Similar"
SCRIPT_NAME	"/index.php"
PHP_SELF	"/index.php"
REQUEST_TIME_FLOAT	1790359037.701
REQUEST_TIME	1790359037

Environment Variables empty

Registered Handlers

0. Whoops\Handler\PrettyPageHandler

Similar Items

Similar Items

Environment & details:

Environment & details: