Beyond Fixed Tasks: Unsupervised Environment Design for Task-Level Pairs
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915697768005632 |
|---|---|
| author | Furelos-Blanco, Daniel Pert, Charles Kelbel, Frederik Spies, Alex F. Russo, Alessandra Dennis, Michael |
| author_facet | Furelos-Blanco, Daniel Pert, Charles Kelbel, Frederik Spies, Alex F. Russo, Alessandra Dennis, Michael |
| contents | Training general agents to follow complex instructions (tasks) in intricate environments (levels) remains a core challenge in reinforcement learning. Random sampling of task-level pairs often produces unsolvable combinations, highlighting the need to co-design tasks and levels. While unsupervised environment design (UED) has proven effective at automatically designing level curricula, prior work has only considered a fixed task. We present ATLAS (Aligning Tasks and Levels for Autocurricula of Specifications), a novel method that generates joint autocurricula over tasks and levels. Our approach builds upon UED to automatically produce solvable yet challenging task-level pairs for policy training. To evaluate ATLAS and drive progress in the field, we introduce an evaluation suite that models tasks as reward machines in Minigrid levels. Experiments demonstrate that ATLAS vastly outperforms random sampling approaches, particularly when sampling solvable pairs is unlikely. We further show that mutations leveraging the structure of both tasks and levels accelerate convergence to performant policies. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_12706 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Beyond Fixed Tasks: Unsupervised Environment Design for Task-Level Pairs Furelos-Blanco, Daniel Pert, Charles Kelbel, Frederik Spies, Alex F. Russo, Alessandra Dennis, Michael Machine Learning Artificial Intelligence Training general agents to follow complex instructions (tasks) in intricate environments (levels) remains a core challenge in reinforcement learning. Random sampling of task-level pairs often produces unsolvable combinations, highlighting the need to co-design tasks and levels. While unsupervised environment design (UED) has proven effective at automatically designing level curricula, prior work has only considered a fixed task. We present ATLAS (Aligning Tasks and Levels for Autocurricula of Specifications), a novel method that generates joint autocurricula over tasks and levels. Our approach builds upon UED to automatically produce solvable yet challenging task-level pairs for policy training. To evaluate ATLAS and drive progress in the field, we introduce an evaluation suite that models tasks as reward machines in Minigrid levels. Experiments demonstrate that ATLAS vastly outperforms random sampling approaches, particularly when sampling solvable pairs is unlikely. We further show that mutations leveraging the structure of both tasks and levels accelerate convergence to performant policies. |
| title | Beyond Fixed Tasks: Unsupervised Environment Design for Task-Level Pairs |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2511.12706 |