Image de couverture de livre

Holistic Agent Leaderboard: The Missing Infrastructure for AI Agent Evaluation

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Kapoor, Sayash, Stroebl, Benedikt, Kirgis, Peter, Nadgir, Nitya, Siegel, Zachary S, Wei, Boyi, Xue, Tianci, Chen, Ziru, Chen, Felix, Utpala, Saiteja, Ndzomga, Franck, Oruganty, Dheeraj, Luskin, Sophie, Liu, Kangheng, Yu, Botao, Arora, Amit, Hahm, Dongyoon, Trivedi, Harsh, Sun, Huan, Lee, Juyong, Jin, Tengjun, Mai, Yifan, Zhou, Yifei, Zhu, Yuxuan, Bommasani, Rishi, Kang, Daniel, Song, Dawn, Henderson, Peter, Su, Yu, Liang, Percy, Narayanan, Arvind
Format:	Preprint
Publié:	2025
Sujets:	Artificial Intelligence Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Towards a Science of AI Agent Reliability
par: Rabanser, Stephan, et autres
Publié: (2026)

AI Agents That Matter
par: Kapoor, Sayash, et autres
Publié: (2024)

CORE-Bench: Fostering the Credibility of Published Research Through a Computational Reproducibility Agent Benchmark
par: Siegel, Zachary S., et autres
Publié: (2024)

The Limits of Inference Scaling Through Resampling
par: Stroebl, Benedikt, et autres
Publié: (2024)

Log analysis is necessary for credible evaluation of AI agents
par: Kirgis, Peter, et autres
Publié: (2026)

Efficient Benchmarking of AI Agents
par: Ndzomga, Franck
Publié: (2026)

MobileSafetyBench: Evaluating Safety of Autonomous Agents in Mobile Device Control
par: Lee, Juyong, et autres
Publié: (2024)

Build Agent Advocates, Not Platform Agents
par: Kapoor, Sayash, et autres
Publié: (2025)

Benchmarking Mobile Device Control Agents across Diverse Configurations
par: Lee, Juyong, et autres
Publié: (2024)

Dynamic Risk Assessments for Offensive Cybersecurity Agents
par: Wei, Boyi, et autres
Publié: (2025)

Differences in the Moral Foundations of Large Language Models
par: Kirgis, Peter
Publié: (2025)

MASAI: Modular Architecture for Software-engineering AI Agents
par: Arora, Daman, et autres
Publié: (2024)

Promises and pitfalls of artificial intelligence for legal applications
par: Kapoor, Sayash, et autres
Publié: (2024)

The Leaderboard Illusion
par: Singh, Shivalika, et autres
Publié: (2025)

Pervasive Annotation Errors Break Text-to-SQL Benchmarks and Leaderboards
par: Jin, Tengjun, et autres
Publié: (2026)

Enhancing LLM Agent Safety via Causal Influence Prompting
par: Hahm, Dongyoon, et autres
Publié: (2025)

The 2024 Foundation Model Transparency Index
par: Bommasani, Rishi, et autres
Publié: (2024)

Quantifying Media Influence on Covid-19 Mask-Wearing Beliefs
par: Rabb, Nicholas, et autres
Publié: (2024)

Foundation Model Transparency Reports
par: Bommasani, Rishi, et autres
Publié: (2024)

The 2025 Foundation Model Transparency Index
par: Wan, Alexander, et autres
Publié: (2025)

Alignment Tampering: How Reinforcement Learning from Human Feedback Is Exploited to Optimize Misaligned Biases
par: Hahm, Dongyoon, et autres
Publié: (2026)

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents
par: Mazaheri, Parsa, et autres
Publié: (2026)

Information Retrieval Induced Safety Degradation in AI Agents
par: Yu, Cheng, et autres
Publié: (2025)

ELT-Bench: An End-to-End Benchmark for Evaluating AI Agents on ELT Pipelines
par: Jin, Tengjun, et autres
Publié: (2025)

DermETAS-SNA LLM: A Dermatology Focused Evolutionary Transformer Architecture Search with StackNet Augmented LLM Assistant
par: Oruganty, Nitya Phani Santosh, et autres
Publié: (2025)

Unintended Misalignment from Agentic Fine-Tuning: Risks and Mitigation
par: Hahm, Dongyoon, et autres
Publié: (2025)

ChemToolAgent: The Impact of Tools on Language Agents for Chemistry Problem Solving
par: Yu, Botao, et autres
Publié: (2024)

Efficient Remote Sensing with Harmonized Transfer Learning and Modality Alignment
par: Huang, Tengjun
Publié: (2024)

Open-World Evaluations for Measuring Frontier AI Capabilities
par: Kapoor, Sayash, et autres
Publié: (2026)

ELT-Bench-Verified: Benchmark Quality Issues Underestimate AI Agent Capabilities
par: Zanoli, Christopher, et autres
Publié: (2026)

Social Welfare Function Leaderboard: When LLM Agents Allocate Social Welfare
par: Shi, Zhengliang, et autres
Publié: (2025)

The Societal Impact of Foundation Models: Advancing Evidence-based AI Policy
par: Bommasani, Rishi
Publié: (2025)

NeurIPS should lead scientific consensus on AI policy
par: Bommasani, Rishi
Publié: (2025)

How does Chain of Thought decompose complex tasks?
par: Nadgir, Amrut, et autres
Publié: (2026)

Some[Body] Must Receive That Pain for Agent Accountability
par: Hu, Botao Amber, et autres
Publié: (2026)

Low-Rank Agent-Specific Adaptation (LoRASA) for Multi-Agent Policy Learning
par: Zhang, Beining, et autres
Publié: (2025)

Computational modeling of microstructure
par: Luskin, Mitchell
Publié: (2003)

Titian's Bacchus and His Two Loves
par: Fern Luskin
Publié: (2024)

On the Day They Experience: Awakening Self-Sovereign Experiential AI Agents
par: Hu, Botao Amber, et autres
Publié: (2025)

Context-Masked Meta-Prompting for Privacy-Preserving LLM Adaptation in Finance
par: Hiraou, Sayash Raaj
Publié: (2024)