Copertina

OIBench: Benchmarking Strong Reasoning Models with Olympiad in Informatics

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zhu, Yaoming, Wang, Junxin, Li, Yiyang, Qiu, Lin, Wang, ZongYu, Xu, Jun, Cao, Xuezhi, Wei, Yuhuai, Wang, Mingshi, Cai, Xunliang, Ma, Rong
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

LiveOIBench: Can Large Language Models Outperform Human Contestants in Informatics Olympiads?
di: Zou, Kaijian, et al.
Pubblicazione: (2025)

Meeseeks: A Feedback-Driven, Iterative Self-Correction Benchmark evaluating LLMs' Instruction Following Capability
di: wang, Jiaming, et al.
Pubblicazione: (2025)

AMemGym: Interactive Memory Benchmarking for Assistants in Long-Horizon Conversations
di: Jiayang, Cheng, et al.
Pubblicazione: (2026)

Automatically Benchmarking LLM Code Agents through Agent-Driven Annotation and Evaluation
di: Fu, Lingyue, et al.
Pubblicazione: (2025)

SWE-Cycle: Benchmarking Code Agents across the Complete Issue Resolution Cycle
di: Guan, Hao, et al.
Pubblicazione: (2026)

AgentEscapeBench: Evaluating Out-of-Domain Tool-Grounded Reasoning in LLM Agents
di: Guo, Zhengkang, et al.
Pubblicazione: (2026)

Instance-level Randomization: Toward More Stable LLM Evaluations
di: Li, Yiyang, et al.
Pubblicazione: (2025)

KG-o1: Enhancing Multi-hop Question Answering in Large Language Models via Knowledge Graph Integration
di: Wang, Nan, et al.
Pubblicazione: (2025)

CoreCodeBench: Decoupling Code Intelligence via Fine-Grained Repository-Level Tasks
di: Fu, Lingyue, et al.
Pubblicazione: (2025)

LARY: A Latent Action Representation Yielding Benchmark for Generalizable Vision-to-Action Alignment
di: Nie, Dujun, et al.
Pubblicazione: (2026)

R-Horizon: How Far Can Your Large Reasoning Model Really Go in Breadth and Depth?
di: Lu, Yi, et al.
Pubblicazione: (2025)

Challenging the Boundaries of Reasoning: An Olympiad-Level Math Benchmark for Large Language Models
di: Sun, Haoxiang, et al.
Pubblicazione: (2025)

Why Not Act on What You Know? Unleashing Safety Potential of LLMs via Self-Aware Guard Enhancement
di: Ding, Peng, et al.
Pubblicazione: (2025)

CATArena: Evaluating Evolutionary Capabilities of Code Agents via Iterative Tournaments
di: Fu, Lingyue, et al.
Pubblicazione: (2025)

Making Mathematical Reasoning Adaptive
di: Lai, Zhejian, et al.
Pubblicazione: (2025)

General365: Benchmarking General Reasoning in Large Language Models Across Diverse and Challenging Tasks
di: Liu, Junlin, et al.
Pubblicazione: (2026)

Length Desensitization in Direct Preference Optimization
di: Liu, Wei, et al.
Pubblicazione: (2024)

Audio Turing Test: Benchmarking the Human-likeness of Large Language Model-based Text-to-Speech Systems in Chinese
di: Wang, Xihuai, et al.
Pubblicazione: (2025)

UNO-Bench: A Unified Benchmark for Exploring the Compositional Law Between Uni-modal and Omni-modal in Omni Models
di: Chen, Chen, et al.
Pubblicazione: (2025)

Friend or Foe: How LLMs' Safety Mind Gets Fooled by Intent Shift Attack
di: Ding, Peng, et al.
Pubblicazione: (2025)

Proving Olympiad Algebraic Inequalities without Human Demonstrations
di: Wei, Chenrui, et al.
Pubblicazione: (2024)

Chain-of-Thought Reasoning Without Prompting
di: Wang, Xuezhi, et al.
Pubblicazione: (2024)

AMO-Bench: Large Language Models Still Struggle in High School Math Competitions
di: An, Shengnan, et al.
Pubblicazione: (2025)

CogAtom: From Cognitive Atoms to Olympiad-level Mathematical Reasoning in Large Language Models
di: Chen, Zhuofan, et al.
Pubblicazione: (2025)

Long-horizon Reasoning Agent for Olympiad-Level Mathematical Problem Solving
di: Gao, Songyang, et al.
Pubblicazione: (2025)

RIMO: An Easy-to-Evaluate, Hard-to-Solve Olympiad Benchmark for Advanced Mathematical Reasoning
di: Chen, Ziye, et al.
Pubblicazione: (2025)

Proving Olympiad Inequalities by Synergizing LLMs and Symbolic Reasoning
di: Li, Zenan, et al.
Pubblicazione: (2025)

Achieving Gold-Medal-Level Olympiad Reasoning via Simple and Unified Scaling
di: Li, Yafu, et al.
Pubblicazione: (2026)

The multiple points of maps from sphere to Euclidean space
di: Wang, Jun, et al.
Pubblicazione: (2021)

Hallu-PI: Evaluating Hallucination in Multi-modal Large Language Models within Perturbed Inputs
di: Ding, Peng, et al.
Pubblicazione: (2024)

CombiGraph-Vis: A Curated Multimodal Olympiad Benchmark for Discrete Mathematical Reasoning
di: Mahdavi, Hamed, et al.
Pubblicazione: (2025)

OMIBench: Benchmarking Olympiad-Level Multi-Image Reasoning in Large Vision-Language Model
di: Chen, Qiguang, et al.
Pubblicazione: (2026)

EEFSUVA: A New Mathematical Olympiad Benchmark
di: Khatibi, Nicole N, et al.
Pubblicazione: (2025)

OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problems
di: He, Chaoqun, et al.
Pubblicazione: (2024)

Omni-MATH: A Universal Olympiad Level Mathematic Benchmark For Large Language Models
di: Gao, Bofei, et al.
Pubblicazione: (2024)

Strongly coupled giant-atom waveguide quantum electrodynamics
di: Wu, Zong-Wei, et al.
Pubblicazione: (2025)

LINGOLY: A Benchmark of Olympiad-Level Linguistic Reasoning Puzzles in Low-Resource and Extinct Languages
di: Bean, Andrew M., et al.
Pubblicazione: (2024)

Leveraging Dual Process Theory in Language Agent Framework for Real-time Simultaneous Human-AI Collaboration
di: Zhang, Shao, et al.
Pubblicazione: (2025)

Architected Nanomaterials Powering Optical Physical Unclonable Functions
di: Liulei Pan, et al.
Pubblicazione: (2026)

Rethinking the Sampling Criteria in Reinforcement Learning for LLM Reasoning: A Competence-Difficulty Alignment Perspective
di: Kong, Deyang, et al.
Pubblicazione: (2025)