How RL Unlocks the Aha Moment in Geometric Interleaved Reasoning
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866911627565072384 |
|---|---|
| author | Zhang, Xiangxiang Jia, Caijun Li, Siyuan He, Dingyu Xiong, Xiya Sun, Zheng He, Honghao Wu, Yuchen Yu, Bihui Sun, Linzhuang Tan, Cheng Wei, Jingxuan |
| author_facet | Zhang, Xiangxiang Jia, Caijun Li, Siyuan He, Dingyu Xiong, Xiya Sun, Zheng He, Honghao Wu, Yuchen Yu, Bihui Sun, Linzhuang Tan, Cheng Wei, Jingxuan |
| contents | Solving complex geometric problems inherently requires interleaved reasoning: a tight alternation between constructing diagrams and performing logical deductions. Although recent Multimodal Large Language Models (MLLMs) have demonstrated strong capabilities in visual generation and plotting, we identify a counter-intuitive and underexplored phenomenon. Naively applying Supervised Fine-Tuning (SFT) on interleaved plot-solution data leads to a substantial degradation in reasoning performance compared to text-only baselines. We argue that this failure stems from a fundamental limitation of SFT, which primarily induces distributional alignment: the model learns to reproduce the surface format of interleaved plotting but fails to internalize the causal dependency between the generated plot and reasoning steps. To overcome this limitation, we propose Faire (Functional alignment for interleaved reasoning), a reinforcement learning framework that enforces three casual constraints to move beyond superficial imitation toward functional alignment. Extensive experiments show that Faire induces a qualitative shift in model behavior in which the plotting is effectively internalized, yielding competitive performance on challenging geometric reasoning benchmarks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_01070 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | How RL Unlocks the Aha Moment in Geometric Interleaved Reasoning Zhang, Xiangxiang Jia, Caijun Li, Siyuan He, Dingyu Xiong, Xiya Sun, Zheng He, Honghao Wu, Yuchen Yu, Bihui Sun, Linzhuang Tan, Cheng Wei, Jingxuan Computation and Language Solving complex geometric problems inherently requires interleaved reasoning: a tight alternation between constructing diagrams and performing logical deductions. Although recent Multimodal Large Language Models (MLLMs) have demonstrated strong capabilities in visual generation and plotting, we identify a counter-intuitive and underexplored phenomenon. Naively applying Supervised Fine-Tuning (SFT) on interleaved plot-solution data leads to a substantial degradation in reasoning performance compared to text-only baselines. We argue that this failure stems from a fundamental limitation of SFT, which primarily induces distributional alignment: the model learns to reproduce the surface format of interleaved plotting but fails to internalize the causal dependency between the generated plot and reasoning steps. To overcome this limitation, we propose Faire (Functional alignment for interleaved reasoning), a reinforcement learning framework that enforces three casual constraints to move beyond superficial imitation toward functional alignment. Extensive experiments show that Faire induces a qualitative shift in model behavior in which the plotting is effectively internalized, yielding competitive performance on challenging geometric reasoning benchmarks. |
| title | How RL Unlocks the Aha Moment in Geometric Interleaved Reasoning |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2603.01070 |