Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Guo, Zijian, Işık, İlker, Ahmad, H. M. Sabbir, Li, Wenchao
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2604.24729
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910170526777344
author Guo, Zijian
Işık, İlker
Ahmad, H. M. Sabbir
Li, Wenchao
author_facet Guo, Zijian
Işık, İlker
Ahmad, H. M. Sabbir
Li, Wenchao
contents Specification-guided reinforcement learning (RL) provides a principled framework for encoding complex, temporally extended tasks using formal specifications such as linear temporal logic (LTL). While recent methods have shown promising results, their ability to generalize across unseen specifications and diverse environments remains insufficiently understood. In this work, we introduce SpecRLBench, a benchmark designed to evaluate the generalization capabilities of LTL-based specification-guided RL methods. The benchmark spans multiple difficulty levels across navigation and manipulation domains, incorporating both static and dynamic environments, diverse robot dynamics, and varied observation modalities. Through extensive empirical evaluation, we characterize the strengths and limitations of existing approaches and reveal the challenges that emerge as specification and environment complexity increase. SpecRLBench provides a structured platform for systematic comparison and supports the development of more generalizable specification-guided RL methods. Code is available at https://github.com/BU-DEPEND-Lab/SpecRLBench.
format Preprint
id arxiv_https___arxiv_org_abs_2604_24729
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle SpecRLBench: A Benchmark for Generalization in Specification-Guided Reinforcement Learning
Guo, Zijian
Işık, İlker
Ahmad, H. M. Sabbir
Li, Wenchao
Machine Learning
Specification-guided reinforcement learning (RL) provides a principled framework for encoding complex, temporally extended tasks using formal specifications such as linear temporal logic (LTL). While recent methods have shown promising results, their ability to generalize across unseen specifications and diverse environments remains insufficiently understood. In this work, we introduce SpecRLBench, a benchmark designed to evaluate the generalization capabilities of LTL-based specification-guided RL methods. The benchmark spans multiple difficulty levels across navigation and manipulation domains, incorporating both static and dynamic environments, diverse robot dynamics, and varied observation modalities. Through extensive empirical evaluation, we characterize the strengths and limitations of existing approaches and reveal the challenges that emerge as specification and environment complexity increase. SpecRLBench provides a structured platform for systematic comparison and supports the development of more generalizable specification-guided RL methods. Code is available at https://github.com/BU-DEPEND-Lab/SpecRLBench.
title SpecRLBench: A Benchmark for Generalization in Specification-Guided Reinforcement Learning
topic Machine Learning
url https://arxiv.org/abs/2604.24729