Sim2Dust: Mastering Dynamic Waypoint Tracking on Granular Media

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Orsula, Andrej, Geist, Matthieu, Olivares-Mendez, Miguel, Martinez, Carol
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918164457062400
author Orsula, Andrej
Geist, Matthieu
Olivares-Mendez, Miguel
Martinez, Carol
author_facet Orsula, Andrej
Geist, Matthieu
Olivares-Mendez, Miguel
Martinez, Carol
contents Reliable autonomous navigation across the unstructured terrains of distant planetary surfaces is a critical enabler for future space exploration. However, the deployment of learning-based controllers is hindered by the inherent sim-to-real gap, particularly for the complex dynamics of wheel interactions with granular media. This work presents a complete sim-to-real framework for developing and validating robust control policies for dynamic waypoint tracking on such challenging surfaces. We leverage massively parallel simulation to train reinforcement learning agents across a vast distribution of procedurally generated environments with randomized physics. These policies are then transferred zero-shot to a physical wheeled rover operating in a lunar-analogue facility. Our experiments systematically compare multiple reinforcement learning algorithms and action smoothing filters to identify the most effective combinations for real-world deployment. Crucially, we provide strong empirical evidence that agents trained with procedural diversity achieve superior zero-shot performance compared to those trained on static scenarios. We also analyze the trade-offs of fine-tuning with high-fidelity particle physics, which offers minor gains in low-speed precision at a significant computational cost. Together, these contributions establish a validated workflow for creating reliable learning-based navigation systems, marking a substantial step towards deploying autonomous robots in the final frontier.
format Preprint
id arxiv_https___arxiv_org_abs_2508_11503
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Sim2Dust: Mastering Dynamic Waypoint Tracking on Granular Media
Orsula, Andrej
Geist, Matthieu
Olivares-Mendez, Miguel
Martinez, Carol
Robotics
Artificial Intelligence
Machine Learning
Reliable autonomous navigation across the unstructured terrains of distant planetary surfaces is a critical enabler for future space exploration. However, the deployment of learning-based controllers is hindered by the inherent sim-to-real gap, particularly for the complex dynamics of wheel interactions with granular media. This work presents a complete sim-to-real framework for developing and validating robust control policies for dynamic waypoint tracking on such challenging surfaces. We leverage massively parallel simulation to train reinforcement learning agents across a vast distribution of procedurally generated environments with randomized physics. These policies are then transferred zero-shot to a physical wheeled rover operating in a lunar-analogue facility. Our experiments systematically compare multiple reinforcement learning algorithms and action smoothing filters to identify the most effective combinations for real-world deployment. Crucially, we provide strong empirical evidence that agents trained with procedural diversity achieve superior zero-shot performance compared to those trained on static scenarios. We also analyze the trade-offs of fine-tuning with high-fidelity particle physics, which offers minor gains in low-speed precision at a significant computational cost. Together, these contributions establish a validated workflow for creating reliable learning-based navigation systems, marking a substantial step towards deploying autonomous robots in the final frontier.
title Sim2Dust: Mastering Dynamic Waypoint Tracking on Granular Media
topic Robotics
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2508.11503