Learning Mathematical Rules with Large Language Models
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913563354857472 |
|---|---|
| author | Gorceix, Antoine Chenadec, Bastien Le Rammal, Ahmad Vadori, Nelson Veloso, Manuela |
| author_facet | Gorceix, Antoine Chenadec, Bastien Le Rammal, Ahmad Vadori, Nelson Veloso, Manuela |
| contents | In this paper, we study the ability of large language models to learn specific mathematical rules such as distributivity or simplifying equations. We present an empirical analysis of their ability to generalize these rules, as well as to reuse them in the context of word problems. For this purpose, we provide a rigorous methodology to build synthetic data incorporating such rules, and perform fine-tuning of large language models on such data. Our experiments show that our model can learn and generalize these rules to some extent, as well as suitably reuse them in the context of word problems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_16973 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Learning Mathematical Rules with Large Language Models Gorceix, Antoine Chenadec, Bastien Le Rammal, Ahmad Vadori, Nelson Veloso, Manuela Computation and Language Artificial Intelligence Machine Learning In this paper, we study the ability of large language models to learn specific mathematical rules such as distributivity or simplifying equations. We present an empirical analysis of their ability to generalize these rules, as well as to reuse them in the context of word problems. For this purpose, we provide a rigorous methodology to build synthetic data incorporating such rules, and perform fine-tuning of large language models on such data. Our experiments show that our model can learn and generalize these rules to some extent, as well as suitably reuse them in the context of word problems. |
| title | Learning Mathematical Rules with Large Language Models |
| topic | Computation and Language Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2410.16973 |