Copertina

$τ^2$-Bench: Evaluating Conversational Agents in a Dual-Control Environment

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Barres, Victor, Dong, Honghua, Ray, Soham, Si, Xujie, Narasimhan, Karthik
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Artificial Intelligence Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

$τ$-Knowledge: Evaluating Conversational Agents over Unstructured Knowledge
di: Shi, Quan, et al.
Pubblicazione: (2026)

$τ$-Voice: Benchmarking Full-Duplex Voice Agents on Real-World Domains
di: Ray, Soham, et al.
Pubblicazione: (2026)

$τ$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
di: Yao, Shunyu, et al.
Pubblicazione: (2024)

TypyBench: Evaluating LLM Type Inference for Untyped Python Repositories
di: Dong, Honghua, et al.
Pubblicazione: (2025)

Contextual Experience Replay for Self-Improvement of Language Agents
di: Liu, Yitao, et al.
Pubblicazione: (2025)

AgentCE-Bench: Agent Configurable Evaluation with Scalable Horizons and Controllable Difficulty under Lightweight Environments
di: Yang, Wang, et al.
Pubblicazione: (2026)

APPL: A Prompt Programming Language for Harmonious Integration of Programs and Large Language Model Prompts
di: Dong, Honghua, et al.
Pubblicazione: (2024)

Controllable Discovery of Intents: Incremental Deep Clustering Using Semi-Supervised Contrastive Learning
di: Rawat, Mrinal, et al.
Pubblicazione: (2024)

VideoGameBench: Can Vision-Language Models complete popular video games?
di: Zhang, Alex L., et al.
Pubblicazione: (2025)

Cognitive Architectures for Language Agents
di: Sumers, Theodore R., et al.
Pubblicazione: (2023)

Can Language Models Solve Olympiad Programming?
di: Shi, Quan, et al.
Pubblicazione: (2024)

A NotSo Simple Way to Beat Simple Bench
di: Sane, Soham, et al.
Pubblicazione: (2024)

LLMs are Superior Feedback Providers: Bootstrapping Reasoning for Lie Detection with Self-Generated Feedback
di: Banerjee, Tanushree, et al.
Pubblicazione: (2024)

NC-Bench: An LLM Benchmark for Evaluating Conversational Competence
di: Moore, Robert J., et al.
Pubblicazione: (2026)

PersonaGym: Evaluating Persona Agents and LLMs
di: Samuel, Vinay, et al.
Pubblicazione: (2024)

IMPersona: Evaluating Individual Level LM Impersonation
di: Shi, Quan, et al.
Pubblicazione: (2025)

Language-Guided World Models: A Model-Based Approach to AI Control
di: Zhang, Alex, et al.
Pubblicazione: (2024)

AgentBench: Evaluating LLMs as Agents
di: Liu, Xiao, et al.
Pubblicazione: (2023)

Chronosymbolic Learning: Efficient CHC Solving with Symbolic Reasoning and Inductive Learning
di: Luo, Ziyan, et al.
Pubblicazione: (2023)

LLMs Still Can't Plan; Can LRMs? A Preliminary Evaluation of OpenAI's o1 on PlanBench
di: Valmeekam, Karthik, et al.
Pubblicazione: (2024)

MemBench: Towards More Comprehensive Evaluation on the Memory of LLM-based Agents
di: Tan, Haoran, et al.
Pubblicazione: (2025)

MobileBench-OL: A Comprehensive Chinese Benchmark for Evaluating Mobile GUI Agents in Real-World Environment
di: Wu, Qinzhuo, et al.
Pubblicazione: (2026)

OP-Bench: Benchmarking Over-Personalization for Memory-Augmented Personalized Conversational Agents
di: Hu, Yulin, et al.
Pubblicazione: (2026)

LLM-ARC: Enhancing LLMs with an Automated Reasoning Critic
di: Kalyanpur, Aditya, et al.
Pubblicazione: (2024)

CostBench: Evaluating Multi-Turn Cost-Optimal Planning and Adaptation in Dynamic Environments for LLM Tool-Use Agents
di: Liu, Jiayu, et al.
Pubblicazione: (2025)

CocoaBench: Evaluating Unified Digital Agents in the Wild
di: CocoaBench Team, et al.
Pubblicazione: (2026)

EngramaBench: Evaluating Long-Term Conversational Memory with Structured Graph Retrieval
di: Acuna, Julian
Pubblicazione: (2026)

CHATATC: Large Language Model-Driven Conversational Agents for Supporting Strategic Air Traffic Flow Management
di: Abdulhak, Sinan, et al.
Pubblicazione: (2024)

SPADE-Bench: Evaluating Spontaneous Strategic Deception in Agents via Plan-Action Divergence
di: Bu, Yuyan, et al.
Pubblicazione: (2026)

MDIT-Bench: Evaluating the Dual-Implicit Toxicity in Large Multimodal Models
di: Jin, Bohan, et al.
Pubblicazione: (2025)

Mobile-Bench: An Evaluation Benchmark for LLM-based Mobile Agents
di: Deng, Shihan, et al.
Pubblicazione: (2024)

GameBench: Evaluating Strategic Reasoning Abilities of LLM Agents
di: Costarelli, Anthony, et al.
Pubblicazione: (2024)

Exploring and Controlling Diversity in LLM-Agent Conversation
di: Chu, KuanChao, et al.
Pubblicazione: (2024)

ARE: Scaling Up Agent Environments and Evaluations
di: Froger, Romain, et al.
Pubblicazione: (2025)

QualEval: Qualitative Evaluation for Model Improvement
di: Murahari, Vishvak, et al.
Pubblicazione: (2023)

Towards Repository-Level Program Verification with Large Language Models
di: Zhong, Si Cheng, et al.
Pubblicazione: (2025)

Agent-Testing Agent: A Meta-Agent for Automated Testing and Evaluation of Conversational AI Agents
di: Komoravolu, Sameer, et al.
Pubblicazione: (2025)

KVoiceBench, KOpenAudioBench, and KMMAU: Agent-Driven Korean Speech Benchmarks for Evaluating SpeechLMs
di: Kim, Haechan, et al.
Pubblicazione: (2026)

AgentRewardBench: Evaluating Automatic Evaluations of Web Agent Trajectories
di: Lù, Xing Han, et al.
Pubblicazione: (2025)

UserBench: An Interactive Gym Environment for User-Centric Agents
di: Qian, Cheng, et al.
Pubblicazione: (2025)