Image de couverture de livre

OIBench: Benchmarking Strong Reasoning Models with Olympiad in Informatics

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Zhu, Yaoming, Wang, Junxin, Li, Yiyang, Qiu, Lin, Wang, ZongYu, Xu, Jun, Cao, Xuezhi, Wei, Yuhuai, Wang, Mingshi, Cai, Xunliang, Ma, Rong
Format:	Preprint
Publié:	2025
Sujets:	Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

LiveOIBench: Can Large Language Models Outperform Human Contestants in Informatics Olympiads?
par: Zou, Kaijian, et autres
Publié: (2025)

Meeseeks: A Feedback-Driven, Iterative Self-Correction Benchmark evaluating LLMs' Instruction Following Capability
par: wang, Jiaming, et autres
Publié: (2025)

AMemGym: Interactive Memory Benchmarking for Assistants in Long-Horizon Conversations
par: Jiayang, Cheng, et autres
Publié: (2026)

Automatically Benchmarking LLM Code Agents through Agent-Driven Annotation and Evaluation
par: Fu, Lingyue, et autres
Publié: (2025)

SWE-Cycle: Benchmarking Code Agents across the Complete Issue Resolution Cycle
par: Guan, Hao, et autres
Publié: (2026)

AgentEscapeBench: Evaluating Out-of-Domain Tool-Grounded Reasoning in LLM Agents
par: Guo, Zhengkang, et autres
Publié: (2026)

Instance-level Randomization: Toward More Stable LLM Evaluations
par: Li, Yiyang, et autres
Publié: (2025)

KG-o1: Enhancing Multi-hop Question Answering in Large Language Models via Knowledge Graph Integration
par: Wang, Nan, et autres
Publié: (2025)

CoreCodeBench: Decoupling Code Intelligence via Fine-Grained Repository-Level Tasks
par: Fu, Lingyue, et autres
Publié: (2025)

LARY: A Latent Action Representation Yielding Benchmark for Generalizable Vision-to-Action Alignment
par: Nie, Dujun, et autres
Publié: (2026)

R-Horizon: How Far Can Your Large Reasoning Model Really Go in Breadth and Depth?
par: Lu, Yi, et autres
Publié: (2025)

Challenging the Boundaries of Reasoning: An Olympiad-Level Math Benchmark for Large Language Models
par: Sun, Haoxiang, et autres
Publié: (2025)

Why Not Act on What You Know? Unleashing Safety Potential of LLMs via Self-Aware Guard Enhancement
par: Ding, Peng, et autres
Publié: (2025)

CATArena: Evaluating Evolutionary Capabilities of Code Agents via Iterative Tournaments
par: Fu, Lingyue, et autres
Publié: (2025)

Making Mathematical Reasoning Adaptive
par: Lai, Zhejian, et autres
Publié: (2025)

General365: Benchmarking General Reasoning in Large Language Models Across Diverse and Challenging Tasks
par: Liu, Junlin, et autres
Publié: (2026)

Length Desensitization in Direct Preference Optimization
par: Liu, Wei, et autres
Publié: (2024)

Audio Turing Test: Benchmarking the Human-likeness of Large Language Model-based Text-to-Speech Systems in Chinese
par: Wang, Xihuai, et autres
Publié: (2025)

UNO-Bench: A Unified Benchmark for Exploring the Compositional Law Between Uni-modal and Omni-modal in Omni Models
par: Chen, Chen, et autres
Publié: (2025)

Friend or Foe: How LLMs' Safety Mind Gets Fooled by Intent Shift Attack
par: Ding, Peng, et autres
Publié: (2025)

Proving Olympiad Algebraic Inequalities without Human Demonstrations
par: Wei, Chenrui, et autres
Publié: (2024)

Chain-of-Thought Reasoning Without Prompting
par: Wang, Xuezhi, et autres
Publié: (2024)

AMO-Bench: Large Language Models Still Struggle in High School Math Competitions
par: An, Shengnan, et autres
Publié: (2025)

CogAtom: From Cognitive Atoms to Olympiad-level Mathematical Reasoning in Large Language Models
par: Chen, Zhuofan, et autres
Publié: (2025)

Long-horizon Reasoning Agent for Olympiad-Level Mathematical Problem Solving
par: Gao, Songyang, et autres
Publié: (2025)

RIMO: An Easy-to-Evaluate, Hard-to-Solve Olympiad Benchmark for Advanced Mathematical Reasoning
par: Chen, Ziye, et autres
Publié: (2025)

Proving Olympiad Inequalities by Synergizing LLMs and Symbolic Reasoning
par: Li, Zenan, et autres
Publié: (2025)

Achieving Gold-Medal-Level Olympiad Reasoning via Simple and Unified Scaling
par: Li, Yafu, et autres
Publié: (2026)

Hallu-PI: Evaluating Hallucination in Multi-modal Large Language Models within Perturbed Inputs
par: Ding, Peng, et autres
Publié: (2024)

The multiple points of maps from sphere to Euclidean space
par: Wang, Jun, et autres
Publié: (2021)

CombiGraph-Vis: A Curated Multimodal Olympiad Benchmark for Discrete Mathematical Reasoning
par: Mahdavi, Hamed, et autres
Publié: (2025)

OMIBench: Benchmarking Olympiad-Level Multi-Image Reasoning in Large Vision-Language Model
par: Chen, Qiguang, et autres
Publié: (2026)

EEFSUVA: A New Mathematical Olympiad Benchmark
par: Khatibi, Nicole N, et autres
Publié: (2025)

OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problems
par: He, Chaoqun, et autres
Publié: (2024)

Omni-MATH: A Universal Olympiad Level Mathematic Benchmark For Large Language Models
par: Gao, Bofei, et autres
Publié: (2024)

Strongly coupled giant-atom waveguide quantum electrodynamics
par: Wu, Zong-Wei, et autres
Publié: (2025)

LINGOLY: A Benchmark of Olympiad-Level Linguistic Reasoning Puzzles in Low-Resource and Extinct Languages
par: Bean, Andrew M., et autres
Publié: (2024)

Leveraging Dual Process Theory in Language Agent Framework for Real-time Simultaneous Human-AI Collaboration
par: Zhang, Shao, et autres
Publié: (2025)

Architected Nanomaterials Powering Optical Physical Unclonable Functions
par: Liulei Pan, et autres
Publié: (2026)

Rethinking the Sampling Criteria in Reinforcement Learning for LLM Reasoning: A Competence-Difficulty Alignment Perspective
par: Kong, Deyang, et autres
Publié: (2025)