Imagen de Portada

Survey on Evaluation of LLM-based Agents

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Yehudai, Asaf, Eden, Lilach, Li, Alan, Uziel, Guy, Zhao, Yilun, Bar-Haim, Roy, Cohan, Arman, Shmueli-Scheuer, Michal
Formato:	Preprint
Publicado:	2025
Materias:	Artificial Intelligence Computation and Language Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Agentic CLEAR: Automating Multi-Level Evaluation of LLM Agents
por: Yehudai, Asaf, et al.
Publicado: (2026)

CLEAR: Error Analysis via LLM-as-a-Judge Made Easy
por: Yehudai, Asaf, et al.
Publicado: (2025)

JuStRank: Benchmarking LLM Judges for System Ranking
por: Gera, Ariel, et al.
Publicado: (2024)

Time to REFLECT: Can We Trust LLM Judges for Evidence-based Research Agents?
por: Wang, Leyao, et al.
Publicado: (2026)

A Matter of TASTE: Improving Coverage and Difficulty of Agent Benchmarks
por: Keren, Tomer, et al.
Publicado: (2026)

General Agent Evaluation
por: Bandel, Elron, et al.
Publicado: (2026)

SUCEA: Reasoning-Intensive Retrieval for Adversarial Fact-checking through Claim Decomposition and Editing
por: Liu, Hongjun, et al.
Publicado: (2025)

On Evaluating LLM Alignment by Evaluating LLMs as Judges
por: Liu, Yixin, et al.
Publicado: (2025)

Think Again! The Effect of Test-Time Compute on Preferences, Opinions, and Beliefs of Large Language Models
por: Kour, George, et al.
Publicado: (2025)

Can AI Be a Good Peer Reviewer? A Survey of Peer Review Process, Evaluation, and the Future
por: Wu, Sihong, et al.
Publicado: (2026)

Bayesian Calibration of Win Rate Estimation with LLM Evaluators
por: Gao, Yicheng, et al.
Publicado: (2024)

M3SciQA: A Multi-Modal Multi-Document Scientific QA Benchmark for Evaluating Foundation Models
por: Li, Chuhan, et al.
Publicado: (2024)

Investigating Data Contamination in Modern Benchmarks for Large Language Models
por: Deng, Chunyuan, et al.
Publicado: (2023)

Do These LLM Benchmarks Agree? Fixing Benchmark Evaluation with BenchBench
por: Perlitz, Yotam, et al.
Publicado: (2024)

Teaching Values to Machines: Simulating Human-Like Behavior in LLMs
por: Yehudai, Asaf, et al.
Publicado: (2026)

ErrorMap and ErrorAtlas: Charting the Failure Landscape of Large Language Models
por: Ashury-Tahan, Shir, et al.
Publicado: (2026)

When LLMs are Unfit Use FastFit: Fast and Effective Text Classification with Many Classes
por: Yehudai, Asaf, et al.
Publicado: (2024)

AbGen: Evaluating Large Language Models in Ablation Study Design and Evaluation for Scientific Research
por: Zhao, Yilun, et al.
Publicado: (2025)

MIMIR: A Streamlined Platform for Personalized Agent Tuning in Domain Expertise
por: Deng, Chunyuan, et al.
Publicado: (2024)

MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoning
por: Tang, Xiangru, et al.
Publicado: (2023)

ANCHOR: Branch-Point Data Generation for GUI Agents
por: Wei, Jinbiao, et al.
Publicado: (2026)

Robustness as an Emergent Property of Task Performance
por: Ashury-Tahan, Shir, et al.
Publicado: (2026)

Growing Pains: Extensible and Efficient LLM Benchmarking Via Fixed Parameter Calibration
por: Habba, Eliya, et al.
Publicado: (2026)

RbtAct: Rebuttal as Supervision for Actionable Review Feedback Generation
por: Wu, Sihong, et al.
Publicado: (2026)

WildIFEval: Instruction Following in the Wild
por: Lior, Gili, et al.
Publicado: (2025)

On the Benefits of Fine-Grained Loss Truncation: A Case Study on Factuality in Summarization
por: Flores, Lorenzo Jaime Yu, et al.
Publicado: (2024)

Step-level Optimization for Efficient Computer-use Agents
por: Wei, Jinbiao, et al.
Publicado: (2026)

MedAgentsBench: Benchmarking Thinking Models and Agent Frameworks for Complex Medical Reasoning
por: Tang, Xiangru, et al.
Publicado: (2025)

ReIFE: Re-evaluating Instruction-Following Evaluation
por: Liu, Yixin, et al.
Publicado: (2024)

Evaluating Legal Reasoning Traces with Legal Issue Tree Rubrics
por: Lee, Jinu, et al.
Publicado: (2025)

SciMDR: Advancing Scientific Multimodal Document Reasoning
por: Chen, Ziyu, et al.
Publicado: (2026)

PuzzlePlex: Benchmarking Foundation Models on Reasoning and Planning with Puzzles
por: Long, Yitao, et al.
Publicado: (2025)

LocAgent: Graph-Guided LLM Agents for Code Localization
por: Chen, Zhaoling, et al.
Publicado: (2025)

Stay Tuned: An Empirical Study of the Impact of Hyperparameters on LLM Tuning in Real-World Applications
por: Halfon, Alon, et al.
Publicado: (2024)

ChemSafetyBench: Benchmarking LLM Safety on Chemistry Domain
por: Zhao, Haochen, et al.
Publicado: (2024)

ChemAgent: Self-updating Library in Large Language Models Improves Chemical Reasoning
por: Tang, Xiangru, et al.
Publicado: (2025)

Step-Back Profiling: Distilling User History for Personalized Scientific Writing
por: Tang, Xiangru, et al.
Publicado: (2024)

When Can Transformers Count to n?
por: Yehudai, Gilad, et al.
Publicado: (2024)

TOMATO: Assessing Visual Temporal Reasoning Capabilities in Multimodal Foundation Models
por: Shangguan, Ziyao, et al.
Publicado: (2024)

Unitxt: Flexible, Shareable and Reusable Data Preparation and Evaluation for Generative AI
por: Bandel, Elron, et al.
Publicado: (2024)