Protecting Context and Prompts: Deterministic Security for Non-Deterministic AI

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Rajagopalan, Mohan, Rao, Vinay
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866915790913011712
author Rajagopalan, Mohan
Rao, Vinay
author_facet Rajagopalan, Mohan
Rao, Vinay
contents Large Language Model (LLM) applications are vulnerable to prompt injection and context manipulation attacks that traditional security models cannot prevent. We introduce two novel primitives--authenticated prompts and authenticated context--that provide cryptographically verifiable provenance across LLM workflows. Authenticated prompts enable self-contained lineage verification, while authenticated context uses tamper-evident hash chains to ensure integrity of dynamic inputs. Building on these primitives, we formalize a policy algebra with four proven theorems providing protocol-level Byzantine resistance--even adversarial agents cannot violate organizational policies. Five complementary defenses--from lightweight resource controls to LLM-based semantic validation--deliver layered, preventative security with formal guarantees. Evaluation against representative attacks spanning 6 exhaustive categories achieves 100% detection with zero false positives and nominal overhead. We demonstrate the first approach combining cryptographically enforced prompt lineage, tamper-evident context, and provable policy reasoning--shifting LLM security from reactive detection to preventative guarantees.
format Preprint
id arxiv_https___arxiv_org_abs_2602_10481
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Protecting Context and Prompts: Deterministic Security for Non-Deterministic AI
Rajagopalan, Mohan
Rao, Vinay
Cryptography and Security
Artificial Intelligence
Multiagent Systems
Large Language Model (LLM) applications are vulnerable to prompt injection and context manipulation attacks that traditional security models cannot prevent. We introduce two novel primitives--authenticated prompts and authenticated context--that provide cryptographically verifiable provenance across LLM workflows. Authenticated prompts enable self-contained lineage verification, while authenticated context uses tamper-evident hash chains to ensure integrity of dynamic inputs. Building on these primitives, we formalize a policy algebra with four proven theorems providing protocol-level Byzantine resistance--even adversarial agents cannot violate organizational policies. Five complementary defenses--from lightweight resource controls to LLM-based semantic validation--deliver layered, preventative security with formal guarantees. Evaluation against representative attacks spanning 6 exhaustive categories achieves 100% detection with zero false positives and nominal overhead. We demonstrate the first approach combining cryptographically enforced prompt lineage, tamper-evident context, and provable policy reasoning--shifting LLM security from reactive detection to preventative guarantees.
title Protecting Context and Prompts: Deterministic Security for Non-Deterministic AI
topic Cryptography and Security
Artificial Intelligence
Multiagent Systems
url https://arxiv.org/abs/2602.10481