Kwai-STaR: Transform LLMs into State-Transition Reasoners
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866916478022844416 |
|---|---|
| author | Lu, Xingyu Hu, Yuhang Liu, Changyi Zhang, Tianke Yang, Zhenyu Ding, Zhixiang Qian, Shengsheng Du, Meng Kang, Ruiwen Tang, Kaiyu Yang, Fan Gao, Tingting Zhang, Di Zheng, Hai-Tao Wen, Bin |
| author_facet | Lu, Xingyu Hu, Yuhang Liu, Changyi Zhang, Tianke Yang, Zhenyu Ding, Zhixiang Qian, Shengsheng Du, Meng Kang, Ruiwen Tang, Kaiyu Yang, Fan Gao, Tingting Zhang, Di Zheng, Hai-Tao Wen, Bin |
| contents | Mathematical reasoning presents a significant challenge to the cognitive capabilities of LLMs. Various methods have been proposed to enhance the mathematical ability of LLMs. However, few recognize the value of state transition for LLM reasoning. In this work, we define mathematical problem-solving as a process of transiting from an initial unsolved state to the final resolved state, and propose Kwai-STaR framework, which transforms LLMs into State-Transition Reasoners to improve their intuitive reasoning capabilities. Our approach comprises three main steps: (1) Define the state space tailored to the mathematical reasoning. (2) Generate state-transition data based on the state space. (3) Convert original LLMs into State-Transition Reasoners via a curricular training strategy. Our experiments validate the effectiveness of Kwai-STaR in enhancing mathematical reasoning: After training on the small-scale Kwai-STaR dataset, general LLMs, including Mistral-7B and LLaMA-3, achieve considerable performance gain on the GSM8K and GSM-Hard dataset. Additionally, the state transition-based design endows Kwai-STaR with remarkable training and inference efficiency. Further experiments are underway to establish the generality of Kwai-STaR. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_04799 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Kwai-STaR: Transform LLMs into State-Transition Reasoners Lu, Xingyu Hu, Yuhang Liu, Changyi Zhang, Tianke Yang, Zhenyu Ding, Zhixiang Qian, Shengsheng Du, Meng Kang, Ruiwen Tang, Kaiyu Yang, Fan Gao, Tingting Zhang, Di Zheng, Hai-Tao Wen, Bin Computation and Language Artificial Intelligence Mathematical reasoning presents a significant challenge to the cognitive capabilities of LLMs. Various methods have been proposed to enhance the mathematical ability of LLMs. However, few recognize the value of state transition for LLM reasoning. In this work, we define mathematical problem-solving as a process of transiting from an initial unsolved state to the final resolved state, and propose Kwai-STaR framework, which transforms LLMs into State-Transition Reasoners to improve their intuitive reasoning capabilities. Our approach comprises three main steps: (1) Define the state space tailored to the mathematical reasoning. (2) Generate state-transition data based on the state space. (3) Convert original LLMs into State-Transition Reasoners via a curricular training strategy. Our experiments validate the effectiveness of Kwai-STaR in enhancing mathematical reasoning: After training on the small-scale Kwai-STaR dataset, general LLMs, including Mistral-7B and LLaMA-3, achieve considerable performance gain on the GSM8K and GSM-Hard dataset. Additionally, the state transition-based design endows Kwai-STaR with remarkable training and inference efficiency. Further experiments are underway to establish the generality of Kwai-STaR. |
| title | Kwai-STaR: Transform LLMs into State-Transition Reasoners |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2411.04799 |