Robotics-Inspired Guardrails for Foundation Models in Socially Sensitive Domains

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Ramnauth, Rebecca, Brscic, Drazen, Scassellati, Brian
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917511273906176
author Ramnauth, Rebecca
Brscic, Drazen
Scassellati, Brian
author_facet Ramnauth, Rebecca
Brscic, Drazen
Scassellati, Brian
contents Foundation models are increasingly deployed in socially sensitive domains such as education, mental health, and caregiving, where failures are often cumulative and context-dependent. Existing guardrail approaches -- ranging from training-time alignment to prompting, decoding constraints, and post-hoc moderation -- primarily provide empirical risk reduction rather than enforceable behavioral guarantees, and largely treat safety as a property of individual outputs rather than interaction trajectories. We reframe guardrails as a problem of runtime behavioral control over interaction trajectories, drawing on robotics to introduce formal constructs for constraint enforcement in uncertain, closed-loop systems. We instantiate these ideas in the Grounded Observer framework and apply it across three real-world deployments: small talk, in-home autism therapy, and behavioral de-escalation in schools. Across settings, the framework enables runtime interventions that mitigate drift into undesirable interaction regimes while adapting to diverse social contexts. We discuss extensions to the framework and propose research directions toward stronger guarantees.
format Preprint
id arxiv_https___arxiv_org_abs_2605_19940
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Robotics-Inspired Guardrails for Foundation Models in Socially Sensitive Domains
Ramnauth, Rebecca
Brscic, Drazen
Scassellati, Brian
Artificial Intelligence
Robotics
Foundation models are increasingly deployed in socially sensitive domains such as education, mental health, and caregiving, where failures are often cumulative and context-dependent. Existing guardrail approaches -- ranging from training-time alignment to prompting, decoding constraints, and post-hoc moderation -- primarily provide empirical risk reduction rather than enforceable behavioral guarantees, and largely treat safety as a property of individual outputs rather than interaction trajectories. We reframe guardrails as a problem of runtime behavioral control over interaction trajectories, drawing on robotics to introduce formal constructs for constraint enforcement in uncertain, closed-loop systems. We instantiate these ideas in the Grounded Observer framework and apply it across three real-world deployments: small talk, in-home autism therapy, and behavioral de-escalation in schools. Across settings, the framework enables runtime interventions that mitigate drift into undesirable interaction regimes while adapting to diverse social contexts. We discuss extensions to the framework and propose research directions toward stronger guarantees.
title Robotics-Inspired Guardrails for Foundation Models in Socially Sensitive Domains
topic Artificial Intelligence
Robotics
url https://arxiv.org/abs/2605.19940