AgenticMath: Enhancing LLM Reasoning via Agentic-based Math Data Generation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Liu, Xianyang, Liu, Yilin, Wang, Shuai, Cheng, Hao, Estornell, Andrew, Zhao, Yuzhi, Shu, Jun, Wei, Jiaheng
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866918277377163264
author Liu, Xianyang
Liu, Yilin
Wang, Shuai
Cheng, Hao
Estornell, Andrew
Zhao, Yuzhi
Shu, Jun
Wei, Jiaheng
author_facet Liu, Xianyang
Liu, Yilin
Wang, Shuai
Cheng, Hao
Estornell, Andrew
Zhao, Yuzhi
Shu, Jun
Wei, Jiaheng
contents The creation of high-quality datasets to improve Large Language Model (LLM) reasoning remains a significant challenge, as current methods often suffer from generating low-quality/incorrect answers and limited information richness from available data sources. To address this, we propose AgenticMath, a novel agentic method for generating high-quality mathematical question-answer pairs to enhance the supervised fine-tuning of LLMs. Our method operates through four stages: (1) Seed Question Filter that selects questions with high information richness, complexity, and clarity; (2) an Agentic Question Rephrase step that employs a multi-agent system to generate diverse, logically consistent paraphrases; (3) an Answer Augment step where rewrite answers using chain-of-thought reasoning to enhance numerical and logical correctness, without reliance on human-provided labels; and (4) a final Question and Answer Evaluation that retains only the most superior pairs. Extensive experiments demonstrate that, fine-tuning 3B-8B parameter LLMs on AgenticMath generated datasets (comprising only 30-60K math samples) achieves competitive or superior performance on diverse in domain and out-of-domain mathematical reasoning benchmarks compared to baselines trained on much more data (e.g., 400K or 2.3M samples). Our work demonstrates that targeted, high-quality data generation is a more efficient path to improving mathematical reasoning in LLMs than large-scale, low-quality alternatives.
format Preprint
id arxiv_https___arxiv_org_abs_2510_19361
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle AgenticMath: Enhancing LLM Reasoning via Agentic-based Math Data Generation
Liu, Xianyang
Liu, Yilin
Wang, Shuai
Cheng, Hao
Estornell, Andrew
Zhao, Yuzhi
Shu, Jun
Wei, Jiaheng
Computation and Language
Artificial Intelligence
The creation of high-quality datasets to improve Large Language Model (LLM) reasoning remains a significant challenge, as current methods often suffer from generating low-quality/incorrect answers and limited information richness from available data sources. To address this, we propose AgenticMath, a novel agentic method for generating high-quality mathematical question-answer pairs to enhance the supervised fine-tuning of LLMs. Our method operates through four stages: (1) Seed Question Filter that selects questions with high information richness, complexity, and clarity; (2) an Agentic Question Rephrase step that employs a multi-agent system to generate diverse, logically consistent paraphrases; (3) an Answer Augment step where rewrite answers using chain-of-thought reasoning to enhance numerical and logical correctness, without reliance on human-provided labels; and (4) a final Question and Answer Evaluation that retains only the most superior pairs. Extensive experiments demonstrate that, fine-tuning 3B-8B parameter LLMs on AgenticMath generated datasets (comprising only 30-60K math samples) achieves competitive or superior performance on diverse in domain and out-of-domain mathematical reasoning benchmarks compared to baselines trained on much more data (e.g., 400K or 2.3M samples). Our work demonstrates that targeted, high-quality data generation is a more efficient path to improving mathematical reasoning in LLMs than large-scale, low-quality alternatives.
title AgenticMath: Enhancing LLM Reasoning via Agentic-based Math Data Generation
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2510.19361