Saved in:
Bibliographic Details
Main Author: Mehta, Aman
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2602.11619
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910020020469760
author Mehta, Aman
author_facet Mehta, Aman
contents Run the same LLM agent on the same task twice: do you get the same behavior? We find the answer is often no. In a study of 3,000 agent runs across three models (Llama 3.1 70B, GPT-4o, and Claude Sonnet 4.5) on HotpotQA, we observe that ReAct-style agents produce 2.0--4.2 distinct action sequences per 10 runs on average, even with identical inputs. More importantly, this variance predicts failure: tasks with consistent behavior ($\leq$2 unique paths) achieve 80--92% accuracy, while highly inconsistent tasks ($\geq$6 unique paths) achieve only 25--60%, a 32--55 percentage point gap depending on model. We trace variance to early decisions: 69% of divergence occurs at step 2, the first search query. Our results suggest that monitoring behavioral consistency during execution could enable early error detection and improve agent reliability.
format Preprint
id arxiv_https___arxiv_org_abs_2602_11619
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle When Agents Disagree With Themselves: Measuring Behavioral Consistency in LLM-Based Agents
Mehta, Aman
Artificial Intelligence
Run the same LLM agent on the same task twice: do you get the same behavior? We find the answer is often no. In a study of 3,000 agent runs across three models (Llama 3.1 70B, GPT-4o, and Claude Sonnet 4.5) on HotpotQA, we observe that ReAct-style agents produce 2.0--4.2 distinct action sequences per 10 runs on average, even with identical inputs. More importantly, this variance predicts failure: tasks with consistent behavior ($\leq$2 unique paths) achieve 80--92% accuracy, while highly inconsistent tasks ($\geq$6 unique paths) achieve only 25--60%, a 32--55 percentage point gap depending on model. We trace variance to early decisions: 69% of divergence occurs at step 2, the first search query. Our results suggest that monitoring behavioral consistency during execution could enable early error detection and improve agent reliability.
title When Agents Disagree With Themselves: Measuring Behavioral Consistency in LLM-Based Agents
topic Artificial Intelligence
url https://arxiv.org/abs/2602.11619