Mathematical Language Models: A Survey
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2023
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866916546209644544 |
|---|---|
| author | Liu, Wentao Hu, Hanglei Zhou, Jie Ding, Yuyang Li, Junsong Zeng, Jiayi He, Mengliang Chen, Qin Jiang, Bo Zhou, Aimin He, Liang |
| author_facet | Liu, Wentao Hu, Hanglei Zhou, Jie Ding, Yuyang Li, Junsong Zeng, Jiayi He, Mengliang Chen, Qin Jiang, Bo Zhou, Aimin He, Liang |
| contents | In recent years, there has been remarkable progress in leveraging Language Models (LMs), encompassing Pre-trained Language Models (PLMs) and Large-scale Language Models (LLMs), within the domain of mathematics. This paper conducts a comprehensive survey of mathematical LMs, systematically categorizing pivotal research endeavors from two distinct perspectives: tasks and methodologies. The landscape reveals a large number of proposed mathematical LLMs, which are further delineated into instruction learning, tool-based methods, fundamental CoT techniques, advanced CoT methodologies and multi-modal methods. To comprehend the benefits of mathematical LMs more thoroughly, we carry out an in-depth contrast of their characteristics and performance. In addition, our survey entails the compilation of over 60 mathematical datasets, including training datasets, benchmark datasets, and augmented datasets. Addressing the primary challenges and delineating future trajectories within the field of mathematical LMs, this survey is poised to facilitate and inspire future innovation among researchers invested in advancing this domain. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2312_07622 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Mathematical Language Models: A Survey Liu, Wentao Hu, Hanglei Zhou, Jie Ding, Yuyang Li, Junsong Zeng, Jiayi He, Mengliang Chen, Qin Jiang, Bo Zhou, Aimin He, Liang Computation and Language In recent years, there has been remarkable progress in leveraging Language Models (LMs), encompassing Pre-trained Language Models (PLMs) and Large-scale Language Models (LLMs), within the domain of mathematics. This paper conducts a comprehensive survey of mathematical LMs, systematically categorizing pivotal research endeavors from two distinct perspectives: tasks and methodologies. The landscape reveals a large number of proposed mathematical LLMs, which are further delineated into instruction learning, tool-based methods, fundamental CoT techniques, advanced CoT methodologies and multi-modal methods. To comprehend the benefits of mathematical LMs more thoroughly, we carry out an in-depth contrast of their characteristics and performance. In addition, our survey entails the compilation of over 60 mathematical datasets, including training datasets, benchmark datasets, and augmented datasets. Addressing the primary challenges and delineating future trajectories within the field of mathematical LMs, this survey is poised to facilitate and inspire future innovation among researchers invested in advancing this domain. |
| title | Mathematical Language Models: A Survey |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2312.07622 |