Saved in:
Bibliographic Details
Main Authors: Gao, Songyang, Gu, Yuzhe, Wu, Zijian, Kong, Lingkai, Zhang, Wenwei, Cai, Zhongrui, Zheng, Fan, Ma, Tianyou, Shen, Junhao, Zhao, Haiteng, Zhang, Duanyang, Zhang, Huilun, Liu, Kuikun, Lyu, Chengqi, Duan, Yanhui, Chen, Chiyu, Ma, Ningsheng, Gao, Jianfei, Lyu, Han, Lin, Dahua, Chen, Kai
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2512.10739
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914196796473344
author Gao, Songyang
Gu, Yuzhe
Wu, Zijian
Kong, Lingkai
Zhang, Wenwei
Cai, Zhongrui
Zheng, Fan
Ma, Tianyou
Shen, Junhao
Zhao, Haiteng
Zhang, Duanyang
Zhang, Huilun
Liu, Kuikun
Lyu, Chengqi
Duan, Yanhui
Chen, Chiyu
Ma, Ningsheng
Gao, Jianfei
Lyu, Han
Lin, Dahua
Chen, Kai
author_facet Gao, Songyang
Gu, Yuzhe
Wu, Zijian
Kong, Lingkai
Zhang, Wenwei
Cai, Zhongrui
Zheng, Fan
Ma, Tianyou
Shen, Junhao
Zhao, Haiteng
Zhang, Duanyang
Zhang, Huilun
Liu, Kuikun
Lyu, Chengqi
Duan, Yanhui
Chen, Chiyu
Ma, Ningsheng
Gao, Jianfei
Lyu, Han
Lin, Dahua
Chen, Kai
contents Large Reasoning Models (LRMs) have expanded the mathematical reasoning frontier through Chain-of-Thought (CoT) techniques and Reinforcement Learning with Verifiable Rewards (RLVR), capable of solving AIME-level problems. However, the performance of LRMs is heavily dependent on the extended reasoning context length. For solving ultra-hard problems like those in the International Mathematical Olympiad (IMO), the required reasoning complexity surpasses the space that an LRM can explore in a single round. Previous works attempt to extend the reasoning context of LRMs but remain prompt-based and built upon proprietary models, lacking systematic structures and training pipelines. Therefore, this paper introduces Intern-S1-MO, a long-horizon math agent that conducts multi-round hierarchical reasoning, composed of an LRM-based multi-agent system including reasoning, summary, and verification. By maintaining a compact memory in the form of lemmas, Intern-S1-MO can more freely explore the lemma-rich reasoning spaces in multiple reasoning stages, thereby breaking through the context constraints for IMO-level math problems. Furthermore, we propose OREAL-H, an RL framework for training the LRM using the online explored trajectories to simultaneously bootstrap the reasoning ability of LRM and elevate the overall performance of Intern-S1-MO. Experiments show that Intern-S1-MO can obtain 26 out of 35 points on the non-geometry problems of IMO2025, matching the performance of silver medalists. It also surpasses the current advanced LRMs on inference benchmarks such as HMMT2025, AIME2025, and CNMO2025. In addition, our agent officially participates in CMO2025 and achieves a score of 102/126 under the judgment of human experts, reaching the gold medal level.
format Preprint
id arxiv_https___arxiv_org_abs_2512_10739
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Long-horizon Reasoning Agent for Olympiad-Level Mathematical Problem Solving
Gao, Songyang
Gu, Yuzhe
Wu, Zijian
Kong, Lingkai
Zhang, Wenwei
Cai, Zhongrui
Zheng, Fan
Ma, Tianyou
Shen, Junhao
Zhao, Haiteng
Zhang, Duanyang
Zhang, Huilun
Liu, Kuikun
Lyu, Chengqi
Duan, Yanhui
Chen, Chiyu
Ma, Ningsheng
Gao, Jianfei
Lyu, Han
Lin, Dahua
Chen, Kai
Computation and Language
Artificial Intelligence
Large Reasoning Models (LRMs) have expanded the mathematical reasoning frontier through Chain-of-Thought (CoT) techniques and Reinforcement Learning with Verifiable Rewards (RLVR), capable of solving AIME-level problems. However, the performance of LRMs is heavily dependent on the extended reasoning context length. For solving ultra-hard problems like those in the International Mathematical Olympiad (IMO), the required reasoning complexity surpasses the space that an LRM can explore in a single round. Previous works attempt to extend the reasoning context of LRMs but remain prompt-based and built upon proprietary models, lacking systematic structures and training pipelines. Therefore, this paper introduces Intern-S1-MO, a long-horizon math agent that conducts multi-round hierarchical reasoning, composed of an LRM-based multi-agent system including reasoning, summary, and verification. By maintaining a compact memory in the form of lemmas, Intern-S1-MO can more freely explore the lemma-rich reasoning spaces in multiple reasoning stages, thereby breaking through the context constraints for IMO-level math problems. Furthermore, we propose OREAL-H, an RL framework for training the LRM using the online explored trajectories to simultaneously bootstrap the reasoning ability of LRM and elevate the overall performance of Intern-S1-MO. Experiments show that Intern-S1-MO can obtain 26 out of 35 points on the non-geometry problems of IMO2025, matching the performance of silver medalists. It also surpasses the current advanced LRMs on inference benchmarks such as HMMT2025, AIME2025, and CNMO2025. In addition, our agent officially participates in CMO2025 and achieves a score of 102/126 under the judgment of human experts, reaching the gold medal level.
title Long-horizon Reasoning Agent for Olympiad-Level Mathematical Problem Solving
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2512.10739