Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914965110128640 |
|---|---|
| author | Zhang, Zhihan Ge, Tao Liang, Zhenwen Yu, Wenhao Yu, Dian Jia, Mengzhao Yu, Dong Jiang, Meng |
| author_facet | Zhang, Zhihan Ge, Tao Liang, Zhenwen Yu, Wenhao Yu, Dian Jia, Mengzhao Yu, Dong Jiang, Meng |
| contents | Supervised fine-tuning enhances the problem-solving abilities of language models across various mathematical reasoning tasks. To maximize such benefits, existing research focuses on broadening the training set with various data augmentation techniques, which is effective for standard single-round question-answering settings. Our work introduces a novel technique aimed at cultivating a deeper understanding of the training problems at hand, enhancing performance not only in standard settings but also in more complex scenarios that require reflective thinking. Specifically, we propose reflective augmentation, a method that embeds problem reflection into each training instance. It trains the model to consider alternative perspectives and engage with abstractions and analogies, thereby fostering a thorough comprehension through reflective reasoning. Extensive experiments validate the achievement of our aim, underscoring the unique advantages of our method and its complementary nature relative to existing augmentation techniques. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_12050 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning Zhang, Zhihan Ge, Tao Liang, Zhenwen Yu, Wenhao Yu, Dian Jia, Mengzhao Yu, Dong Jiang, Meng Computation and Language Supervised fine-tuning enhances the problem-solving abilities of language models across various mathematical reasoning tasks. To maximize such benefits, existing research focuses on broadening the training set with various data augmentation techniques, which is effective for standard single-round question-answering settings. Our work introduces a novel technique aimed at cultivating a deeper understanding of the training problems at hand, enhancing performance not only in standard settings but also in more complex scenarios that require reflective thinking. Specifically, we propose reflective augmentation, a method that embeds problem reflection into each training instance. It trains the model to consider alternative perspectives and engage with abstractions and analogies, thereby fostering a thorough comprehension through reflective reasoning. Extensive experiments validate the achievement of our aim, underscoring the unique advantages of our method and its complementary nature relative to existing augmentation techniques. |
| title | Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2406.12050 |