Enhancing Reasoning Capabilities of LLMs via Principled Synthetic Logic Corpus

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Morishita, Terufumi, Morio, Gaku, Yamaguchi, Atsuki, Sogawa, Yasuhiro
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929644965462016
author Morishita, Terufumi
Morio, Gaku
Yamaguchi, Atsuki
Sogawa, Yasuhiro
author_facet Morishita, Terufumi
Morio, Gaku
Yamaguchi, Atsuki
Sogawa, Yasuhiro
contents Large language models (LLMs) are capable of solving a wide range of tasks, yet they have struggled with reasoning. To address this, we propose $\textbf{Additional Logic Training (ALT)}$, which aims to enhance LLMs' reasoning capabilities by program-generated logical reasoning samples. We first establish principles for designing high-quality samples by integrating symbolic logic theory and previous empirical insights. Then, based on these principles, we construct a synthetic corpus named $\textbf{Formal Logic Deduction Diverse}$ ($\textbf{FLD}$$_{\times 2}$), comprising numerous samples of multi-step deduction with unknown facts, diverse reasoning rules, diverse linguistic expressions, and challenging distractors. Finally, we empirically show that ALT on FLD$_{\times2}$ substantially enhances the reasoning capabilities of state-of-the-art LLMs, including LLaMA-3.1-70B. Improvements include gains of up to 30 points on logical reasoning benchmarks, up to 10 points on math and coding benchmarks, and 5 points on the benchmark suite BBH.
format Preprint
id arxiv_https___arxiv_org_abs_2411_12498
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Enhancing Reasoning Capabilities of LLMs via Principled Synthetic Logic Corpus
Morishita, Terufumi
Morio, Gaku
Yamaguchi, Atsuki
Sogawa, Yasuhiro
Machine Learning
Artificial Intelligence
Logic in Computer Science
Large language models (LLMs) are capable of solving a wide range of tasks, yet they have struggled with reasoning. To address this, we propose $\textbf{Additional Logic Training (ALT)}$, which aims to enhance LLMs' reasoning capabilities by program-generated logical reasoning samples. We first establish principles for designing high-quality samples by integrating symbolic logic theory and previous empirical insights. Then, based on these principles, we construct a synthetic corpus named $\textbf{Formal Logic Deduction Diverse}$ ($\textbf{FLD}$$_{\times 2}$), comprising numerous samples of multi-step deduction with unknown facts, diverse reasoning rules, diverse linguistic expressions, and challenging distractors. Finally, we empirically show that ALT on FLD$_{\times2}$ substantially enhances the reasoning capabilities of state-of-the-art LLMs, including LLaMA-3.1-70B. Improvements include gains of up to 30 points on logical reasoning benchmarks, up to 10 points on math and coding benchmarks, and 5 points on the benchmark suite BBH.
title Enhancing Reasoning Capabilities of LLMs via Principled Synthetic Logic Corpus
topic Machine Learning
Artificial Intelligence
Logic in Computer Science
url https://arxiv.org/abs/2411.12498