Bridging Perception and Planning: Towards End-to-End Planning for Signal Temporal Logic Tasks

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Ye, Bowen, Huang, Junyue, Liu, Yang, Qiao, Xiaozhen, Yin, Xiang
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912933482594304
author Ye, Bowen
Huang, Junyue
Liu, Yang
Qiao, Xiaozhen
Yin, Xiang
author_facet Ye, Bowen
Huang, Junyue
Liu, Yang
Qiao, Xiaozhen
Yin, Xiang
contents We investigate the task and motion planning problem for Signal Temporal Logic (STL) specifications in robotics. Existing STL methods rely on pre-defined maps or mobility representations, which are ineffective in unstructured real-world environments. We propose the \emph{Structured-MoE STL Planner} (\textbf{S-MSP}), a differentiable framework that maps synchronized multi-view camera observations and an STL specification directly to a feasible trajectory. S-MSP integrates STL constraints within a unified pipeline, trained with a composite loss that combines trajectory reconstruction and STL robustness. A \emph{structure-aware} Mixture-of-Experts (MoE) model enables horizon-aware specialization by projecting sub-tasks into temporally anchored embeddings. We evaluate S-MSP using a high-fidelity simulation of factory-logistics scenarios with temporally constrained tasks. Experiments show that S-MSP outperforms single-expert baselines in STL satisfaction and trajectory feasibility. A rule-based \emph{safety filter} at inference improves physical executability without compromising logical correctness, showcasing the practicality of the approach.
format Preprint
id arxiv_https___arxiv_org_abs_2509_12813
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Bridging Perception and Planning: Towards End-to-End Planning for Signal Temporal Logic Tasks
Ye, Bowen
Huang, Junyue
Liu, Yang
Qiao, Xiaozhen
Yin, Xiang
Robotics
Systems and Control
We investigate the task and motion planning problem for Signal Temporal Logic (STL) specifications in robotics. Existing STL methods rely on pre-defined maps or mobility representations, which are ineffective in unstructured real-world environments. We propose the \emph{Structured-MoE STL Planner} (\textbf{S-MSP}), a differentiable framework that maps synchronized multi-view camera observations and an STL specification directly to a feasible trajectory. S-MSP integrates STL constraints within a unified pipeline, trained with a composite loss that combines trajectory reconstruction and STL robustness. A \emph{structure-aware} Mixture-of-Experts (MoE) model enables horizon-aware specialization by projecting sub-tasks into temporally anchored embeddings. We evaluate S-MSP using a high-fidelity simulation of factory-logistics scenarios with temporally constrained tasks. Experiments show that S-MSP outperforms single-expert baselines in STL satisfaction and trajectory feasibility. A rule-based \emph{safety filter} at inference improves physical executability without compromising logical correctness, showcasing the practicality of the approach.
title Bridging Perception and Planning: Towards End-to-End Planning for Signal Temporal Logic Tasks
topic Robotics
Systems and Control
url https://arxiv.org/abs/2509.12813