Are Agents Probabilistic Automata? A Trace-Based, Memory-Constrained Theory of Agentic AI

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Koohestani, Roham, Li, Ziyou, Podkopaev, Anton, Izadi, Maliheh
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866918315216076800
author Koohestani, Roham
Li, Ziyou
Podkopaev, Anton
Izadi, Maliheh
author_facet Koohestani, Roham
Li, Ziyou
Podkopaev, Anton
Izadi, Maliheh
contents This paper studies standard controller architectures for agentic AI and derives automata-theoretic models of their interaction behavior via trace semantics and abstraction. We model an agent implementation as a finite control program augmented with explicit memory primitives (bounded buffers, a call stack, or read/write external memory) and a stochastic policy component (e.g., an LLM) that selects among architecturally permitted actions. Instead of equating the concrete agent with a deterministic acceptor, we treat the agent-environment closed loop as inducing a probability distribution over finite interaction traces. Given an abstraction function $\Abs$ from concrete configurations to a finite abstract state space, we obtain a probabilistic trace language and an abstract probabilistic transition model $M_{\Abs}$ suitable for probabilistic model checking. Imposing explicit, framework-auditable restrictions on memory access and control flow, we prove that the support of the resulting trace language is regular for bounded-memory controllers, context-free for strict call-return controllers, and recursively enumerable for controllers equipped with unbounded read/write memory. These correspondences allow the reuse of existing verification methods for finite-state and pushdown systems, and they delineate precisely when undecidability barriers arise. The probabilistic semantics leads to quantitative analyses such as: what is the probability of entering an unsafe abstract region, and how can we bound this probability in the presence of environment nondeterminism.
format Preprint
id arxiv_https___arxiv_org_abs_2510_23487
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Are Agents Probabilistic Automata? A Trace-Based, Memory-Constrained Theory of Agentic AI
Koohestani, Roham
Li, Ziyou
Podkopaev, Anton
Izadi, Maliheh
Artificial Intelligence
Formal Languages and Automata Theory
This paper studies standard controller architectures for agentic AI and derives automata-theoretic models of their interaction behavior via trace semantics and abstraction. We model an agent implementation as a finite control program augmented with explicit memory primitives (bounded buffers, a call stack, or read/write external memory) and a stochastic policy component (e.g., an LLM) that selects among architecturally permitted actions. Instead of equating the concrete agent with a deterministic acceptor, we treat the agent-environment closed loop as inducing a probability distribution over finite interaction traces. Given an abstraction function $\Abs$ from concrete configurations to a finite abstract state space, we obtain a probabilistic trace language and an abstract probabilistic transition model $M_{\Abs}$ suitable for probabilistic model checking. Imposing explicit, framework-auditable restrictions on memory access and control flow, we prove that the support of the resulting trace language is regular for bounded-memory controllers, context-free for strict call-return controllers, and recursively enumerable for controllers equipped with unbounded read/write memory. These correspondences allow the reuse of existing verification methods for finite-state and pushdown systems, and they delineate precisely when undecidability barriers arise. The probabilistic semantics leads to quantitative analyses such as: what is the probability of entering an unsafe abstract region, and how can we bound this probability in the presence of environment nondeterminism.
title Are Agents Probabilistic Automata? A Trace-Based, Memory-Constrained Theory of Agentic AI
topic Artificial Intelligence
Formal Languages and Automata Theory
url https://arxiv.org/abs/2510.23487