Saved in:
Bibliographic Details
Main Authors: Pan, Yicheng, Zhang, Zhenrong, Hu, Pengfei, Ma, Jiefeng, Du, Jun, Zhang, Jianshu, Liu, Quan, Gao, Jianqing, Ma, Feng
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2504.12773
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917987969138688
author Pan, Yicheng
Zhang, Zhenrong
Hu, Pengfei
Ma, Jiefeng
Du, Jun
Zhang, Jianshu
Liu, Quan
Gao, Jianqing
Ma, Feng
author_facet Pan, Yicheng
Zhang, Zhenrong
Hu, Pengfei
Ma, Jiefeng
Du, Jun
Zhang, Jianshu
Liu, Quan
Gao, Jianqing
Ma, Feng
contents Recent advances in Multimodal Large Language Models (MLLMs) have achieved remarkable progress in general domains and demonstrated promise in multimodal mathematical reasoning. However, applying MLLMs to geometry problem solving (GPS) remains challenging due to lack of accurate step-by-step solution data and severe hallucinations during reasoning. In this paper, we propose GeoGen, a pipeline that can automatically generates step-wise reasoning paths for geometry diagrams. By leveraging the precise symbolic reasoning, \textbf{GeoGen} produces large-scale, high-quality question-answer pairs. To further enhance the logical reasoning ability of MLLMs, we train \textbf{GeoLogic}, a Large Language Model (LLM) using synthetic data generated by GeoGen. Serving as a bridge between natural language and symbolic systems, GeoLogic enables symbolic tools to help verifying MLLM outputs, making the reasoning process more rigorous and alleviating hallucinations. Experimental results show that our approach consistently improves the performance of MLLMs, achieving remarkable results on benchmarks for geometric reasoning tasks. This improvement stems from our integration of the strengths of LLMs and symbolic systems, which enables a more reliable and interpretable approach for the GPS task. Codes are available at https://github.com/ycpNotFound/GeoGen.
format Preprint
id arxiv_https___arxiv_org_abs_2504_12773
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Enhancing the Geometric Problem-Solving Ability of Multimodal LLMs via Symbolic-Neural Integration
Pan, Yicheng
Zhang, Zhenrong
Hu, Pengfei
Ma, Jiefeng
Du, Jun
Zhang, Jianshu
Liu, Quan
Gao, Jianqing
Ma, Feng
Computation and Language
Artificial Intelligence
Recent advances in Multimodal Large Language Models (MLLMs) have achieved remarkable progress in general domains and demonstrated promise in multimodal mathematical reasoning. However, applying MLLMs to geometry problem solving (GPS) remains challenging due to lack of accurate step-by-step solution data and severe hallucinations during reasoning. In this paper, we propose GeoGen, a pipeline that can automatically generates step-wise reasoning paths for geometry diagrams. By leveraging the precise symbolic reasoning, \textbf{GeoGen} produces large-scale, high-quality question-answer pairs. To further enhance the logical reasoning ability of MLLMs, we train \textbf{GeoLogic}, a Large Language Model (LLM) using synthetic data generated by GeoGen. Serving as a bridge between natural language and symbolic systems, GeoLogic enables symbolic tools to help verifying MLLM outputs, making the reasoning process more rigorous and alleviating hallucinations. Experimental results show that our approach consistently improves the performance of MLLMs, achieving remarkable results on benchmarks for geometric reasoning tasks. This improvement stems from our integration of the strengths of LLMs and symbolic systems, which enables a more reliable and interpretable approach for the GPS task. Codes are available at https://github.com/ycpNotFound/GeoGen.
title Enhancing the Geometric Problem-Solving Ability of Multimodal LLMs via Symbolic-Neural Integration
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2504.12773