Imagen de Portada

A Matter of TASTE: Improving Coverage and Difficulty of Agent Benchmarks

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Keren, Tomer, Calderon, Nitay, Yehudai, Asaf, Perlitz, Yotam, Shmueli-Scheuer, Michal, Reichert, Roi
Formato:	Preprint
Publicado:	2026
Materias:	Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

CLEAR: Error Analysis via LLM-as-a-Judge Made Easy
por: Yehudai, Asaf, et al.
Publicado: (2025)

Agentic CLEAR: Automating Multi-Level Evaluation of LLM Agents
por: Yehudai, Asaf, et al.
Publicado: (2026)

General Agent Evaluation
por: Bandel, Elron, et al.
Publicado: (2026)

JuStRank: Benchmarking LLM Judges for System Ranking
por: Gera, Ariel, et al.
Publicado: (2024)

Do These LLM Benchmarks Agree? Fixing Benchmark Evaluation with BenchBench
por: Perlitz, Yotam, et al.
Publicado: (2024)

Growing Pains: Extensible and Efficient LLM Benchmarking Via Fixed Parameter Calibration
por: Habba, Eliya, et al.
Publicado: (2026)

Survey on Evaluation of LLM-based Agents
por: Yehudai, Asaf, et al.
Publicado: (2025)

On Behalf of the Stakeholders: Trends in NLP Model Interpretability in the Era of LLMs
por: Calderon, Nitay, et al.
Publicado: (2024)

Efficient Benchmarking of Language Models
por: Perlitz, Yotam, et al.
Publicado: (2023)

LIBERTy: A Causal Framework for Benchmarking Concept-Based Explanations of LLMs with Structural Counterfactuals
por: Toker, Gilat, et al.
Publicado: (2026)

ELT-Bench-Verified: Benchmark Quality Issues Underestimate AI Agent Capabilities
por: Zanoli, Christopher, et al.
Publicado: (2026)

The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMs
por: Calderon, Nitay, et al.
Publicado: (2025)

The Mighty ToRR: A Benchmark for Table Reasoning and Robustness
por: Ashury-Tahan, Shir, et al.
Publicado: (2025)

Unitxt: Flexible, Shareable and Reusable Data Preparation and Evaluation for Generative AI
por: Bandel, Elron, et al.
Publicado: (2024)

Think Again! The Effect of Test-Time Compute on Preferences, Opinions, and Beliefs of Large Language Models
por: Kour, George, et al.
Publicado: (2025)

CUBE: A Standard for Unifying Agent Benchmarks
por: Lacoste, Alexandre, et al.
Publicado: (2026)

When LLMs are Unfit Use FastFit: Fast and Effective Text Classification with Many Classes
por: Yehudai, Asaf, et al.
Publicado: (2024)

Teaching Values to Machines: Simulating Human-Like Behavior in LLMs
por: Yehudai, Asaf, et al.
Publicado: (2026)

The Colorful Future of LLMs: Evaluating and Improving LLMs as Emotional Supporters for Queer Youth
por: Lissak, Shir, et al.
Publicado: (2024)

ErrorMap and ErrorAtlas: Charting the Failure Landscape of Large Language Models
por: Ashury-Tahan, Shir, et al.
Publicado: (2026)

Robustness as an Emergent Property of Task Performance
por: Ashury-Tahan, Shir, et al.
Publicado: (2026)

NL-Eye: Abductive NLI for Images
por: Ventura, Mor, et al.
Publicado: (2024)

Time to REFLECT: Can We Trust LLM Judges for Evidence-based Research Agents?
por: Wang, Leyao, et al.
Publicado: (2026)

WildIFEval: Instruction Following in the Wild
por: Lior, Gili, et al.
Publicado: (2025)

DOVE: A Large-Scale Multi-Dimensional Predictions Dataset Towards Meaningful LLM Evaluation
por: Habba, Eliya, et al.
Publicado: (2025)

How Safe is Your Safety Metric? Automatic Concatenation Tests for Metric Reliability
por: Fandina, Ora Nova, et al.
Publicado: (2024)

Selective Self-Rehearsal: A Fine-Tuning Approach to Improve Generalization in Large Language Models
por: Gupta, Sonam, et al.
Publicado: (2024)

RSRCC: A Remote Sensing Regional Change Comprehension Benchmark Constructed via Retrieval-Augmented Best-of-N Ranking
por: Kazoom, Roie, et al.
Publicado: (2026)

A Nurse is Blue and Elephant is Rugby: Cross Domain Alignment in Large Language Models Reveal Human-like Patterns
por: Yehudai, Asaf, et al.
Publicado: (2024)

Interactive Explanations for Reinforcement-Learning Agents
por: Amitai, Yotam, et al.
Publicado: (2025)

Can We Govern the Agent-to-Agent Economy?
por: Chaffer, Tomer Jordi
Publicado: (2025)

ParaCodex: A Profiling-Guided Autonomous Coding Agent for Reliable Parallel Code Generation and Translation
por: Kaplan, Erel, et al.
Publicado: (2026)

MorphoBench: A Benchmark with Difficulty Adaptive to Model Reasoning
por: Wang, Xukai, et al.
Publicado: (2025)

Empty Shelves or Lost Keys? Recall Is the Bottleneck for Parametric Factuality
por: Calderon, Nitay, et al.
Publicado: (2026)

Stay Tuned: An Empirical Study of the Impact of Hyperparameters on LLM Tuning in Real-World Applications
por: Halfon, Alon, et al.
Publicado: (2024)

Selectively Sharing Experiences Improves Multi-Agent Reinforcement Learning
por: Gerstgrasser, Matthias, et al.
Publicado: (2023)

Workflows vs Agents for Code Translation
por: Gray, Henry, et al.
Publicado: (2025)

Repository Intelligence Graph: Deterministic Architectural Map for LLM Code Assistants
por: Cherny-Shahar, Tsvi, et al.
Publicado: (2026)

All You Need is Sally-Anne: ToM in AI Strongly Supported After Surpassing Tests for 3-Year-Olds
por: Alon, Nitay, et al.
Publicado: (2025)

TASTE: A Designer-Annotated Multi-Dimensional Preference Dataset for AI-Generated Graphic Design
por: Zhu, Haonan, et al.
Publicado: (2026)