Cover Image

A Benchmark for Evaluating Outcome-Driven Constraint Violations in Autonomous AI Agents

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Li, Miles Q., Fung, Benjamin C. M., Weiss, Martin, Xiong, Pulei, Al-Hussaeni, Khalil, Fachkha, Claude
Format:	Preprint
Published:	2025
Subjects:	Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Taxonomy and Consistency Analysis of Safety Benchmarks for AI Agents
by: Li, Miles Q., et al.
Published: (2026)

Security Concerns for Large Language Models: A Survey
by: Li, Miles Q., et al.
Published: (2025)

Training Dynamics of a 1.7B LLaMa Model: A Data-Efficient Approach
by: Li, Miles Q., et al.
Published: (2024)

On the Effectiveness of Incremental Training of Large Language Models
by: Li, Miles Q., et al.
Published: (2024)

Towards integration of Privacy Enhancing Technologies in Explainable Artificial Intelligence
by: Allana, Sonal, et al.
Published: (2025)

Agent-Testing Agent: A Meta-Agent for Automated Testing and Evaluation of Conversational AI Agents
by: Komoravolu, Sameer, et al.
Published: (2025)

Adaptive Prompt Embedding Optimization for LLM Jailbreaking
by: Li, Miles Q., et al.
Published: (2026)

Towards Outcome-Oriented, Task-Agnostic Evaluation of AI Agents
by: AlShikh, Waseem, et al.
Published: (2025)

Converging Paradigms: The Synergy of Symbolic and Connectionist AI in LLM-Empowered Autonomous Agents
by: Xiong, Haoyi, et al.
Published: (2024)

AgentDrive: An Open Benchmark Dataset for Agentic AI Reasoning with LLM-Generated Scenarios in Autonomous Systems
by: Ferrag, Mohamed Amine, et al.
Published: (2026)

Towards Unifying Quantitative Security Benchmarking for Multi Agent Systems
by: Sharma, Gauri, et al.
Published: (2025)

Autonomous Evaluation and Refinement of Digital Agents
by: Pan, Jiayi, et al.
Published: (2024)

Efficient Benchmarking of AI Agents
by: Ndzomga, Franck
Published: (2026)

SeClaw: Spec-Driven Security Task Synthesis for Evaluating Autonomous Agents
by: Cheng, Hao, et al.
Published: (2026)

SAGE: A Service Agent Graph-guided Evaluation Benchmark
by: Shi, Ling, et al.
Published: (2026)

Adversarial Attacks in AI-Driven RAN Slicing: SLA Violations and Recovery
by: Tashman, Deemah H., et al.
Published: (2026)

Fully Autonomous AI Agents Should Not be Developed
by: Mitchell, Margaret, et al.
Published: (2025)

Evaluating Language-Model Agents on Realistic Autonomous Tasks
by: Kinniment, Megan, et al.
Published: (2023)

AI2Agent: An End-to-End Framework for Deploying AI Projects as Autonomous Agents
by: Chen, Jiaxiang, et al.
Published: (2025)

Generative Existence and the Interdimensional Hypothesis: A Theoretical Framework for AI Consciousness Grounded in Bidirectional Constraint Closure and Scale Dilation
by: Nickolas Patrick Joseph Schoff, et al.
Published: (2026)

Carthago Delenda Est: Co-opetitive Indirect Information Diffusion Model for Influence Operations on Online Social Media
by: Low, Jwen Fai, et al.
Published: (2024)

REAL: Benchmarking Autonomous Agents on Deterministic Simulations of Real Websites
by: Garg, Divyansh, et al.
Published: (2025)

AndroidLab: Training and Systematic Benchmarking of Android Autonomous Agents
by: Xu, Yifan, et al.
Published: (2024)

AgentDAM: Privacy Leakage Evaluation for Autonomous Web Agents
by: Zharmagambetov, Arman, et al.
Published: (2025)

Stargazer: A Scalable Model-Fitting Benchmark Environment for AI Agents under Astrophysical Constraints
by: Liu, Xinge, et al.
Published: (2026)

Benchmarking and Evaluation of AI Models in Biology: Outcomes and Recommendations from the CZI Virtual Cells Workshop
by: Fahsbender, Elizabeth, et al.
Published: (2025)

TurboAgent: An LLM-Driven Autonomous Multi-Agent Framework for Turbomachinery Aerodynamic Design
by: Du, Juan, et al.
Published: (2026)

JudgeAgent: Beyond Static Benchmarks for Knowledge-Driven and Dynamic LLM Evaluation
by: Shi, Zhichao, et al.
Published: (2025)

ELT-Bench: An End-to-End Benchmark for Evaluating AI Agents on ELT Pipelines
by: Jin, Tengjun, et al.
Published: (2025)

Decentralized Governance of Autonomous AI Agents
by: Chaffer, Tomer Jordi, et al.
Published: (2024)

Vending-Bench: A Benchmark for Long-Term Coherence of Autonomous Agents
by: Backlund, Axel, et al.
Published: (2025)

SkillFlow:Benchmarking Lifelong Skill Discovery and Evolution for Autonomous Agents
by: Zhang, Ziao, et al.
Published: (2026)

Evaluating Plan Compliance in Autonomous Programming Agents
by: Liu, Shuyang, et al.
Published: (2026)

AgentRx: A Benchmark Study of LLM Agents for Multimodal Clinical Prediction Tasks
by: Jorf, Baraa Al, et al.
Published: (2026)

Proposer-Agent-Evaluator(PAE): Autonomous Skill Discovery For Foundation Model Internet Agents
by: Zhou, Yifei, et al.
Published: (2024)

Saving SWE-Bench: A Benchmark Mutation Approach for Realistic Agent Evaluation
by: Garg, Spandan, et al.
Published: (2025)

Claw-Eval: Towards Trustworthy Evaluation of Autonomous Agents
by: Ye, Bowen, et al.
Published: (2026)

SWE-AGI: Benchmarking Specification-Driven Software Construction with MoonBit in the Era of Autonomous Agents
by: Zhang, Zhirui, et al.
Published: (2026)

MDGYM: Benchmarking AI Agents on Molecular Simulations
by: Kumar, Vinay, et al.
Published: (2026)

Leveraging Constraint Violation Signals For Action-Constrained Reinforcement Learning
by: Brahmanage, Janaka Chathuranga, et al.
Published: (2025)