Cover Image

SKATE, a Scalable Tournament Eval: Weaker LLMs differentiate between stronger ones using verifiable challenges

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Gould, Dewi S. W., Mlodozeniec, Bruno, Brown, Samuel F.
Format:	Preprint
Published:	2025
Subjects:	Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Influence Functions for Scalable Data Attribution in Diffusion Models
by: Mlodozeniec, Bruno, et al.
Published: (2024)

Smaller = Weaker? Benchmarking Robustness of Quantized LLMs in Code Generation
by: Fang, Sen, et al.
Published: (2025)

Weaker LLMs' Opinions Also Matter: Mixture of Opinions Enhances LLM's Mathematical Reasoning
by: Chen, Yanan, et al.
Published: (2025)

Implicit meta-learning may lead language models to trust more reliable sources
by: Krasheninnikov, Dmitrii, et al.
Published: (2023)

AirTrafficGen: Configurable Air Traffic Scenario Generation with Large Language Models
by: Gould, Dewi Sid William, et al.
Published: (2025)

Conversation for Non-verifiable Learning: Self-Evolving LLMs through Meta-Evaluation
by: Sui, Yuan, et al.
Published: (2026)

Explaining Tournament Solutions with Minimal Supports
by: Contet, Clément, et al.
Published: (2025)

Air Traffic Controller Task Demand via Graph Neural Networks: An Interpretable Approach to Airspace Complexity
by: Henderson, Edward, et al.
Published: (2025)

GeoSym127K: Scalable Symbolically-verifiable Synthesis for Multimodal Geometric Reasoning
by: Jing, Jinhao, et al.
Published: (2026)

SAGE-Eval: Evaluating LLMs for Systematic Generalizations of Safety Facts
by: Yueh-Han, Chen, et al.
Published: (2025)

Completed Hyperparameter Transfer across Modules, Width, Depth, Batch and Duration
by: Mlodozeniec, Bruno, et al.
Published: (2025)

A framework for assuring the accuracy and fidelity of an AI-enabled Digital Twin of en route UK airspace
by: Keane, Adam, et al.
Published: (2026)

Smaller, Weaker, Yet Better: Training LLM Reasoners via Compute-Optimal Sampling
by: Bansal, Hritik, et al.
Published: (2024)

Fusion-Eval: Integrating Assistant Evaluators with LLMs
by: Shu, Lei, et al.
Published: (2023)

TruthEval: A Dataset to Evaluate LLM Truthfulness and Reliability
by: Khatun, Aisha, et al.
Published: (2024)

Soft Tournament Equilibrium
by: Alqithami, Saad
Published: (2026)

Tournament-GRPO: Group-Wise Tournament Rewards for Reinforcement Learning in Open-Ended Long-Form Generation
by: Yang, Zixuan, et al.
Published: (2026)

ITLC at SemEval-2026 Task 11: Normalization and Deterministic Parsing for Formal Reasoning in LLMs
by: Muhamad, Wicaksono Leksono, et al.
Published: (2026)

AtelierEval: Agentic Evaluation of Humans & LLMs as Text-to-Image Prompters
by: Luo, Hanjun, et al.
Published: (2026)

Distributional Training Data Attribution: What do Influence Functions Sample?
by: Mlodozeniec, Bruno, et al.
Published: (2025)

Not Yet: Humans Outperform LLMs in a Colonel Blotto Tournament
by: Dagaev, Dmitry, et al.
Published: (2026)

TofuEval: Evaluating Hallucinations of LLMs on Topic-Focused Dialogue Summarization
by: Tang, Liyan, et al.
Published: (2024)

AI Annotation Orchestration: Evaluating LLM verifiers to Improve the Quality of LLM Annotations in Learning Analytics
by: Ahtisham, Bakhtawar, et al.
Published: (2025)

TAM-Eval: Evaluating LLMs for Automated Unit Test Maintenance
by: Bruches, Elena, et al.
Published: (2026)

A Positive Case for Faithfulness: LLM Self-Explanations Help Predict Model Behavior
by: Mayne, Harry, et al.
Published: (2026)

ContractEval: Benchmarking LLMs for Clause-Level Legal Risk Identification in Commercial Contracts
by: Liu, Shuang, et al.
Published: (2025)

Trust, but verify
by: Yuan, Michael J., et al.
Published: (2025)

Query Complexity of Tournament Solutions
by: Maiti, Arnab, et al.
Published: (2016)

AmbiGraph-Eval: Can LLMs Effectively Handle Ambiguous Graph Queries?
by: Tian, Yuchen, et al.
Published: (2025)

MM-Eval: A Hierarchical Benchmark for Modern Mongolian Evaluation in LLMs
by: Zhang, Mengyuan, et al.
Published: (2024)

Parameterized Analysis of Bribery in Challenge the Champ Tournaments
by: Chaudhary, Juhi, et al.
Published: (2024)

RouterEval: A Comprehensive Benchmark for Routing LLMs to Explore Model-level Scaling Up in LLMs
by: Huang, Zhongzhan, et al.
Published: (2025)

Do AI models help produce verified bug fixes?
by: Huang, Li, et al.
Published: (2025)

JudgeSQL: Reasoning over SQL Candidates with Weighted Consensus Tournament
by: Bai, Jiayuan, et al.
Published: (2025)

ACSE-Eval: Can LLMs threat model real-world cloud infrastructure?
by: Munshi, Sarthak, et al.
Published: (2025)

MMCircuitEval: A Comprehensive Multimodal Circuit-Focused Benchmark for Evaluating LLMs
by: Zhao, Chenchen, et al.
Published: (2025)

GAOKAO-Eval: Does high scores truly reflect strong capabilities in LLMs?
by: Lei, Zhikai, et al.
Published: (2024)

A Multi-Agent Pokemon Tournament for Evaluating Strategic Reasoning of Large Language Models
by: Yashwanth, Tadisetty Sai, et al.
Published: (2025)

Misinforming LLMs: vulnerabilities, challenges and opportunities
by: Zhou, Bo, et al.
Published: (2024)

Cer-Eval: Certifiable and Cost-Efficient Evaluation Framework for LLMs
by: Wang, Ganghua, et al.
Published: (2025)