Towards Adaptive Environment Generation for Training Embodied Agents

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yeo, Teresa, Weerakoon, Dulaj, Weerakoon, Dulanga, Misra, Archan
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914310509297664
author Yeo, Teresa
Weerakoon, Dulaj
Weerakoon, Dulanga
Misra, Archan
author_facet Yeo, Teresa
Weerakoon, Dulaj
Weerakoon, Dulanga
Misra, Archan
contents Embodied agents struggle to generalize to new environments, even when those environments share similar underlying structures to their training settings. Most current approaches to generating these training environments follow an open-loop paradigm, without considering the agent's current performance. While procedural generation methods can produce diverse scenes, diversity without feedback from the agent is inefficient. The generated environments may be trivially easy, providing limited learning signal. To address this, we present a proof-of-concept for closed-loop environment generation that adapts difficulty to the agent's current capabilities. Our system employs a controllable environment representation, extracts fine-grained performance feedback beyond binary success or failure, and implements a closed-loop adaptation mechanism that translates this feedback into environment modifications. This feedback-driven approach generates training environments that more challenging in the ways the agent needs to improve, enabling more efficient learning and better generalization to novel settings.
format Preprint
id arxiv_https___arxiv_org_abs_2602_06366
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Towards Adaptive Environment Generation for Training Embodied Agents
Yeo, Teresa
Weerakoon, Dulaj
Weerakoon, Dulanga
Misra, Archan
Robotics
Embodied agents struggle to generalize to new environments, even when those environments share similar underlying structures to their training settings. Most current approaches to generating these training environments follow an open-loop paradigm, without considering the agent's current performance. While procedural generation methods can produce diverse scenes, diversity without feedback from the agent is inefficient. The generated environments may be trivially easy, providing limited learning signal. To address this, we present a proof-of-concept for closed-loop environment generation that adapts difficulty to the agent's current capabilities. Our system employs a controllable environment representation, extracts fine-grained performance feedback beyond binary success or failure, and implements a closed-loop adaptation mechanism that translates this feedback into environment modifications. This feedback-driven approach generates training environments that more challenging in the ways the agent needs to improve, enabling more efficient learning and better generalization to novel settings.
title Towards Adaptive Environment Generation for Training Embodied Agents
topic Robotics
url https://arxiv.org/abs/2602.06366