Cover Image

AutoBench: Automating LLM Evaluation through Reciprocal Peer Assessment

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Loi, Dario, Muià, Elena Maria, Siciliano, Federico, Trappolini, Giovanni, Crisà, Vincenzo, Kruger, Peter, Silvestri, Fabrizio
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Artificial Intelligence I.2.7; I.2.11; H.3.4; D.2.8
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

PillagerBench: Benchmarking LLM-Based Agents in Competitive Minecraft Team Environments
by: Schipper, Olivier, et al.
Published: (2025)

Privacy Preserving Multi Agent Path Finding
by: Lehman, Rotem Lev, et al.
Published: (2026)

Building Large-Scale Drone Defenses from Small-Team Strategies
by: Douglas, Grant, et al.
Published: (2026)

Toward Constraint Compliant Goal Formulation and Planning
by: Jones, Steven J., et al.
Published: (2024)

PilotBench: A Benchmark for General Aviation Agents with Safety Constraints
by: Wu, Yalun, et al.
Published: (2026)

TML-Bench: Benchmark for Data Science Agents on Tabular ML Tasks
by: Pinchuk, Mykola
Published: (2026)

N-Agent Ad Hoc Teamwork
by: Wang, Caroline, et al.
Published: (2024)

Dynamic UGV-UAV Cooperative Path Planning in Uncertain Environments
by: Nguyen, Ninh, et al.
Published: (2026)

Redefining Clustered Federated Learning for System Identification: The Path of ClusterCraft
by: Keçeci, Ertuğrul, et al.
Published: (2025)

Evading Overlapping Community Detection via Proxy Node Injection
by: Loi, Dario, et al.
Published: (2025)

Collaborative LLM Agents for C4 Software Architecture Design Automation
by: Szczepanik, Kamil, et al.
Published: (2025)

Procedural Game Level Design with Deep Reinforcement Learning
by: Özkan, Miraç Buğra
Published: (2025)

An Explainable Collaborative Dialogue System using a Theory of Mind
by: Cohen, Philip R., et al.
Published: (2023)

On Convex Optimal Value Functions For POSGs
by: Cunha, Rafael F., et al.
Published: (2023)

SIA: Self Improving AI with Harness & Weight Updates
by: Hebbar, Prannay, et al.
Published: (2026)

ROTATE: Regret-driven Open-ended Training for Ad Hoc Teamwork
by: Wang, Caroline, et al.
Published: (2025)

CIVIC: Cooperative Immersion Via Intelligent Credit-sharing in DRL-Powered Metaverse
by: Aboeleneen, Amr, et al.
Published: (2026)

BPMN to PDDL: Translating Business Workflows for AI Planning
by: Nie, Jasper, et al.
Published: (2025)

Multi-Agent Design Assistant for the Simulation of Inertial Fusion Energy
by: Shachar, Meir H., et al.
Published: (2025)

Ultra-Reduced-Impact-Encased-Logging (URIEL): propose a new method for selective sustainable logging and post-harvest silvicultural treatment in tropical forest using airborne robotics systems
by: Albiero, Daniel, et al.
Published: (2026)

PARNESS: A Paper Harness for End-to-End Automated Scientific Research with Dynamic Workflows, Full-Text Indexing, and Cross-Run Knowledge Accumulation
by: Wang, Yuchen, et al.
Published: (2026)

TRIZ Agents: A Multi-Agent LLM Approach for TRIZ-Based Innovation
by: Szczepanik, Kamil, et al.
Published: (2025)

LLM-Assisted Iterative Evolution with Swarm Intelligence Toward SuperBrain
by: Weigang, Li, et al.
Published: (2025)

AI Agents: Evolution, Architecture, and Real-World Applications
by: Krishnan, Naveen
Published: (2025)

When Outcome Looks Right But Discipline Fails: Trace-Based Evaluation Under Hidden Competitor State
by: Zhu, Peiying, et al.
Published: (2026)

Adaptive Minds: Empowering Agents with LoRA-as-Tools
by: Shekar, Pavan C, et al.
Published: (2025)

Centrally Coordinated Multi-Agent Reinforcement Learning for Power Grid Topology Control
by: de Mol, Barbera, et al.
Published: (2025)

Rewarding Beliefs, Not Actions: Consistency-Guided Credit Assignment for Long-Horizon Agents
by: Tang, Wenjie, et al.
Published: (2026)

AgensFlow: A Coordination-Policy Substrate for Multi-Agent Systems
by: Koenigstein, Nicole
Published: (2026)

Deployment-Time Reliability of Learned Robot Policies
by: Agia, Christopher
Published: (2026)

EcoNet: Multiagent Planning and Control Of Household Energy Resources Using Active Inference
by: Boik, John C., et al.
Published: (2025)

Intention Communication and Hypothesis Likelihood in Game-Theoretic Motion Planning
by: Chahine, Makram, et al.
Published: (2022)

DM$^2$: Decentralized Multi-Agent Reinforcement Learning for Distribution Matching
by: Wang, Caroline, et al.
Published: (2022)

From Idea to CAD: A Language Model-Driven Multi-Agent System for Collaborative Design
by: Ocker, Felix, et al.
Published: (2025)

How Generation Architecture Shapes Code Complexity in Multi-Agent LLM Systems: A Paired Study on HumanEval
by: Ashrafi, Nazmus
Published: (2026)

A Systematic Study of Multi-Agent Deep Reinforcement Learning for Safe and Robust Autonomous Highway Ramp Entry
by: Schester, Larry, et al.
Published: (2024)

Agentic UAVs: LLM-Driven Autonomy with Integrated Tool-Calling and Cognitive Reasoning
by: Koubaa, Anis, et al.
Published: (2025)

SoccerRef-Agents: Multi-Agent System for Automated Soccer Refereeing
by: Meng, Zi, et al.
Published: (2026)

BACE: LLM-based Code Generation through Bayesian Anchored Co-Evolution of Code and Test Populations
by: Silva, Kaushitha, et al.
Published: (2026)

Beyond Prompt Engineering: Neuro-Symbolic-Causal Architecture for Robust Multi-Objective AI Agents
by: Akarlar, Gokturk Aytug
Published: (2025)