Cover Image

ELABORATION: A Comprehensive Benchmark on Human-LLM Competitive Programming

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yang, Xinwei, Liu, Zhaofeng, Huang, Chen, Zhang, Jiashuai, Zhang, Tong, Zhang, Yifan, Lei, Wenqiang
Format:	Preprint
Published:	2025
Subjects:	Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

CANDY: Benchmarking LLMs' Limitations and Assistive Potential in Chinese Misinformation Fact-Checking
by: Guo, Ruiling, et al.
Published: (2025)

Cross-Space Adaptive Filter: Integrating Graph Topology and Node Attributes for Alleviating the Over-smoothing Problem
by: Huang, Chen, et al.
Published: (2024)

TravelEval: A Comprehensive Benchmarking Framework for Evaluating LLM-Powered Travel Planning Agents
by: Chen, Weiyi, et al.
Published: (2026)

Towards Better Generalization via Distributional Input Projection Network
by: Hao, Yifan, et al.
Published: (2025)

CogToM: A Comprehensive Theory of Mind Benchmark inspired by Human Cognition for Large Language Models
by: Tong, Haibo, et al.
Published: (2026)

E2Edev: Benchmarking Large Language Models in End-to-End Software Development Task
by: Liu, Jingyao, et al.
Published: (2025)

Benchmarking LLM Tool-Use in the Wild
by: Yu, Peijie, et al.
Published: (2026)

SkillGenBench: Benchmarking Skill Generation Pipelines for LLM Agents
by: Zhou, Yifan, et al.
Published: (2026)

Advancing ESG Intelligence: An Expert-level Agent and Comprehensive Benchmark for Sustainable Finance
by: Zhao, Yilei, et al.
Published: (2026)

The Emotional Baby Is Truly Deadly: Does your Multimodal Large Reasoning Model Have Emotional Flattery towards Humans?
by: Xun, Yuan, et al.
Published: (2025)

Multimodal Reasoning with LLM for Encrypted Traffic Interpretation: A Benchmark
by: Zhang, Longgang, et al.
Published: (2026)

Towards Analyzing and Understanding the Limitations of DPO: A Theoretical Perspective
by: Feng, Duanyu, et al.
Published: (2024)

PhysReason: A Comprehensive Benchmark towards Physics-Based Reasoning
by: Zhang, Xinyu, et al.
Published: (2025)

UGPhysics: A Comprehensive Benchmark for Undergraduate Physics Reasoning with Large Language Models
by: Xu, Xin, et al.
Published: (2025)

RealUnify: Do Unified Models Truly Benefit from Unification? A Comprehensive Benchmark
by: Shi, Yang, et al.
Published: (2025)

VidCapBench: A Comprehensive Benchmark of Video Captioning for Controllable Text-to-Video Generation
by: Chen, Xinlong, et al.
Published: (2025)

BenchCAD: A Comprehensive, Industry-Standard Benchmark for Programmatic CAD
by: Zhang, Haozhe, et al.
Published: (2026)

Evaluation of Retrieval-Augmented Generation: A Survey
by: Yu, Hao, et al.
Published: (2024)

Solvita: Enhancing Large Language Models for Competitive Programming via Agentic Evolution
by: Li, Han, et al.
Published: (2026)

Competition-Level Problems are Effective LLM Evaluators
by: Huang, Yiming, et al.
Published: (2023)

LLMRouterBench: A Massive Benchmark and Unified Framework for LLM Routing
by: Li, Hao, et al.
Published: (2026)

When Human Preferences Flip: An Instance-Dependent Robust Loss for RLHF
by: Xu, Yifan, et al.
Published: (2025)

OpenGLT: A Comprehensive Benchmark of Graph Neural Networks for Graph-Level Tasks
by: Li, Haoyang, et al.
Published: (2025)

CodeApex: A Bilingual Programming Evaluation Benchmark for Large Language Models
by: Fu, Lingyue, et al.
Published: (2023)

MCPAgentBench: A Real-world Task Benchmark for Evaluating LLM Agent MCP Tool Use
by: Liu, Wenrui, et al.
Published: (2025)

UA-Code-Bench: A Competitive Programming Benchmark for Evaluating LLM Code Generation in Ukrainian
by: Syromiatnikov, Mykyta, et al.
Published: (2025)

Adaptive Layerwise Perturbation: Unifying Off-Policy Corrections for LLM RL
by: Ye, Chenlu, et al.
Published: (2026)

Face-Human-Bench: A Comprehensive Benchmark of Face and Human Understanding for Multi-modal Assistants
by: Qin, Lixiong, et al.
Published: (2025)

MFE-ETP: A Comprehensive Evaluation Benchmark for Multi-modal Foundation Models on Embodied Task Planning
by: Zhang, Min, et al.
Published: (2024)

OCDB: Revisiting Causal Discovery with a Comprehensive Benchmark and Evaluation Framework
by: Zhou, Wei, et al.
Published: (2024)

ArenaBencher: Automatic Benchmark Evolution via Multi-Model Competitive Evaluation
by: Liu, Qin, et al.
Published: (2025)

Legend: Leveraging Representation Engineering to Annotate Safety Margin for Preference Datasets
by: Feng, Duanyu, et al.
Published: (2024)

Human-centered In-building Embodied Delivery Benchmark
by: Xu, Zhuoqun, et al.
Published: (2024)

BackdoorLLM: A Comprehensive Benchmark for Backdoor Attacks and Defenses on Large Language Models
by: Li, Yige, et al.
Published: (2024)

Beyond Prompt: Fine-grained Simulation of Cognitively Impaired Standardized Patients via Stochastic Steering
by: Zhang, Weikang, et al.
Published: (2026)

Cooperative-Competitive Team Play of Real-World Craft Robots
by: Zhao, Rui, et al.
Published: (2026)

Benchmarking GPT-4 against Human Translators: A Comprehensive Evaluation Across Languages, Domains, and Expertise Levels
by: Yan, Jianhao, et al.
Published: (2024)

VeriContest: A Competitive-Programming Benchmark for Verifiable Code Generation
by: Xie, Zichen, et al.
Published: (2026)

TEG-DB: A Comprehensive Dataset and Benchmark of Textual-Edge Graphs
by: Li, Zhuofeng, et al.
Published: (2024)

RefineRL: Advancing Competitive Programming with Self-Refinement Reinforcement Learning
by: Fu, Shaopeng, et al.
Published: (2026)