From Words to Safety: Language-Conditioned Safety Filtering for Robot Navigation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Feng, Zeyuan, Zhang, Haimingyue, Bansal, Somil
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909894066569216
author Feng, Zeyuan
Zhang, Haimingyue
Bansal, Somil
author_facet Feng, Zeyuan
Zhang, Haimingyue
Bansal, Somil
contents As robots become increasingly integrated into open-world, human-centered environments, their ability to interpret natural language instructions and adhere to safety constraints is critical for effective and trustworthy interaction. Existing approaches often focus on mapping language to reward functions instead of safety specifications or address only narrow constraint classes (e.g., obstacle avoidance), limiting their robustness and applicability. We propose a modular framework for language-conditioned safety in robot navigation. Our framework is composed of three core components: (1) a large language model (LLM)-based module that translates free-form instructions into structured safety specifications, (2) a perception module that grounds these specifications by maintaining object-level 3D representations of the environment, and (3) a model predictive control (MPC)-based safety filter that enforces both semantic and geometric constraints in real time. We evaluate the effectiveness of the proposed framework through both simulation studies and hardware experiments, demonstrating that it robustly interprets and enforces diverse language-specified constraints across a wide range of environments and scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2511_05889
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle From Words to Safety: Language-Conditioned Safety Filtering for Robot Navigation
Feng, Zeyuan
Zhang, Haimingyue
Bansal, Somil
Robotics
As robots become increasingly integrated into open-world, human-centered environments, their ability to interpret natural language instructions and adhere to safety constraints is critical for effective and trustworthy interaction. Existing approaches often focus on mapping language to reward functions instead of safety specifications or address only narrow constraint classes (e.g., obstacle avoidance), limiting their robustness and applicability. We propose a modular framework for language-conditioned safety in robot navigation. Our framework is composed of three core components: (1) a large language model (LLM)-based module that translates free-form instructions into structured safety specifications, (2) a perception module that grounds these specifications by maintaining object-level 3D representations of the environment, and (3) a model predictive control (MPC)-based safety filter that enforces both semantic and geometric constraints in real time. We evaluate the effectiveness of the proposed framework through both simulation studies and hardware experiments, demonstrating that it robustly interprets and enforces diverse language-specified constraints across a wide range of environments and scenarios.
title From Words to Safety: Language-Conditioned Safety Filtering for Robot Navigation
topic Robotics
url https://arxiv.org/abs/2511.05889