Copertina

SOPBench: Evaluating Language Agents at Following Standard Operating Procedures and Constraints

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Li, Zekun, Huang, Shinda, Wang, Jiangtian, Zhang, Nathan, Antoniades, Antonis, Hua, Wenyue, Zhu, Kaijie, Zeng, Sirui, Wang, Chi, Wang, William Yang, Yan, Xifeng
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computation and Language Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

MultiAgent Collaboration Attack: Investigating Adversarial Attacks in Large Language Model Collaborations via Debate
di: Amayuelas, Alfonso, et al.
Pubblicazione: (2024)

ADL: A Declarative Language for Agent-Based Chatbots
di: Zeng, Sirui, et al.
Pubblicazione: (2025)

SWE-Search: Enhancing Software Agents with Monte Carlo Tree Search and Iterative Refinement
di: Antoniades, Antonis, et al.
Pubblicazione: (2024)

Self-Resource Allocation in Multi-Agent LLM Systems
di: Amayuelas, Alfonso, et al.
Pubblicazione: (2025)

Group-Evolving Agents: Open-Ended Self-Improvement via Experience Sharing
di: Weng, Zhaotian, et al.
Pubblicazione: (2026)

Neuroformer: Multimodal and Multitask Generative Pretraining for Brain Data
di: Antoniades, Antonis, et al.
Pubblicazione: (2023)

MAGPIE: A dataset for Multi-AGent contextual PrIvacy Evaluation
di: Juneja, Gurusha, et al.
Pubblicazione: (2025)

Dynamic Speculative Agent Planning
di: Guan, Yilin, et al.
Pubblicazione: (2025)

Generalization v.s. Memorization: Tracing Language Models' Capabilities Back to Pretraining Data
di: Wang, Xinyi, et al.
Pubblicazione: (2024)

Language Control Diffusion: Efficiently Scaling through Space, Time, and Tasks
di: Zhang, Edwin, et al.
Pubblicazione: (2022)

NPHardEval4V: Dynamic Evaluation of Large Vision-Language Models with Effects of Vision
di: Li, Xiang, et al.
Pubblicazione: (2024)

Agent-S: LLM Agentic workflow to automate Standard Operating Procedures
di: Kulkarni, Mandar
Pubblicazione: (2025)

Formal-LLM: Integrating Formal Language and Natural Language for Controllable LLM-based Agents
di: Li, Zelong, et al.
Pubblicazione: (2024)

Semantic minimalism and the continuous nature of polysemy
di: Jiangtian Li
Pubblicazione: (2024)

SOP-Maze: Evaluating Large Language Models on Complicated Business Standard Operating Procedures
di: Wang, Jiaming, et al.
Pubblicazione: (2025)

Dynamic Evaluation of Large Language Models by Meta Probing Agents
di: Zhu, Kaijie, et al.
Pubblicazione: (2024)

Interactive Speculative Planning: Enhance Agent Efficiency through Co-design of System and User Interface
di: Hua, Wenyue, et al.
Pubblicazione: (2024)

Multiple kutane epitheloide angiomatöse Knötchen
di: Sirui Hua, et al.
Pubblicazione: (2025)

High Dimensional Procedural Content Generation
di: Xu, Kaijie, et al.
Pubblicazione: (2026)

MELON: Provable Defense Against Indirect Prompt Injection Attacks in AI Agents
di: Zhu, Kaijie, et al.
Pubblicazione: (2025)

Quantifying Trust: Financial Risk Management for Trustworthy AI Agents
di: Hua, Wenyue, et al.
Pubblicazione: (2026)

AIOS: LLM Agent Operating System
di: Mei, Kai, et al.
Pubblicazione: (2024)

THOUGHTTERMINATOR: Benchmarking, Calibrating, and Mitigating Overthinking in Reasoning Models
di: Pu, Xiao, et al.
Pubblicazione: (2025)

MAGPIE: A benchmark for Multi-AGent contextual PrIvacy Evaluation
di: Juneja, Gurusha, et al.
Pubblicazione: (2025)

SOPRAG: Multi-view Graph Experts Retrieval for Industrial Standard Operating Procedures
di: Lin, Liangtao, et al.
Pubblicazione: (2026)

Adaptive Layer-skipping in Pre-trained LLMs
di: Luo, Xuan, et al.
Pubblicazione: (2025)

Direct Multi-Token Decoding
di: Luo, Xuan, et al.
Pubblicazione: (2025)

Global Human-guided Counterfactual Explanations for Molecular Properties via Reinforcement Learning
di: Wang, Danqing, et al.
Pubblicazione: (2024)

What if LLMs Have Different World Views: Simulating Alien Civilizations with LLM-based Agents
di: Xue, Zhaoqian, et al.
Pubblicazione: (2024)

OpenP5: An Open-Source Platform for Developing, Training, and Evaluating LLM-based Recommender Systems
di: Xu, Shuyuan, et al.
Pubblicazione: (2023)

AgentReview: Exploring Peer Review Dynamics with LLM Agents
di: Jin, Yiqiao, et al.
Pubblicazione: (2024)

Bot or Human? Detecting ChatGPT Imposters with A Single Question
di: Wang, Hong, et al.
Pubblicazione: (2023)

Learning to Lie: Reinforcement Learning Attacks Damage Human-AI Teams and Teams of LLMs
di: Musaffar, Abed Kareem, et al.
Pubblicazione: (2025)

Disentangling Logic: The Role of Context in Large Language Model Reasoning Capabilities
di: Hua, Wenyue, et al.
Pubblicazione: (2024)

Can Online GenAI Discussion Serve as Bellwether for Labor Market Shifts?
di: Cao, Shurui, et al.
Pubblicazione: (2025)

Multi‐Agent Learning With Hierarchical Biomechanical Priors for Efficient 3D Human Pose Estimation in Virtual Reality
di: Xingquan Cai, et al.
Pubblicazione: (2025)

Design Study for Project on Standard Operating Procedures for Technical Library Services.
di: Libbey, Miles A., et al.
Pubblicazione: (1970)

PromptBench: A Unified Library for Evaluation of Large Language Models
di: Zhu, Kaijie, et al.
Pubblicazione: (2023)

Metal‐Organic Nanosheet Gels: Hierarchically Porous Materials for Selective Loading and Differential Release
di: Jiangtian Tan, et al.
Pubblicazione: (2025)

Probing the Representational Structure of Regular Polysemy via Sense Analogy Questions: Insights from Contextual Word Vectors
di: Jiangtian Li, et al.
Pubblicazione: (2024)