Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2605.18261 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916022887383040 |
|---|---|
| author | Yuan, Zhonghang Wang, Zhefan Hu, Fang Chen, Zihong Li, Jinzhe Li, Gang Ying, Jie Kong, Huanjun Zhang, Songyang Dong, Nanqing |
| author_facet | Yuan, Zhonghang Wang, Zhefan Hu, Fang Chen, Zihong Li, Jinzhe Li, Gang Ying, Jie Kong, Huanjun Zhang, Songyang Dong, Nanqing |
| contents | Reinforcement learning with verifiable rewards (RLVR) has demonstrated promising potential to enhance the reasoning capabilities of large language models (LLMs) in domains such as mathematics and coding. However, its applications on knowledge-intensive domains have not been effectively explored due to the scarcity of high-quality verifiable data. Furthermore, current RLVR focuses solely on the correctness of final answers, leading to the limitations of flawed reasoning and sparse reward signals. In this work, we propose Knowledge-to-Verification (K2V), a framework that extends RLVR to knowledge-intensive domains through automated verifiable data synthesis, while enabling verification of the LLM's reasoning process. Extensive experiments demonstrate that K2V enhances the reasoning of LLM in knowledge-intensive domains without significantly compromising the model's general capabilities. This study also suggests that integrating automated data synthesis with reasoning verification is a promising direction to enhance model capabilities in these broader domains. Code is available at https://github.com/SeedScientist/K2V. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2605_18261 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Knowledge-to-Verification: Exploring RLVR for LLMs in Knowledge-Intensive Domains Yuan, Zhonghang Wang, Zhefan Hu, Fang Chen, Zihong Li, Jinzhe Li, Gang Ying, Jie Kong, Huanjun Zhang, Songyang Dong, Nanqing Computation and Language Reinforcement learning with verifiable rewards (RLVR) has demonstrated promising potential to enhance the reasoning capabilities of large language models (LLMs) in domains such as mathematics and coding. However, its applications on knowledge-intensive domains have not been effectively explored due to the scarcity of high-quality verifiable data. Furthermore, current RLVR focuses solely on the correctness of final answers, leading to the limitations of flawed reasoning and sparse reward signals. In this work, we propose Knowledge-to-Verification (K2V), a framework that extends RLVR to knowledge-intensive domains through automated verifiable data synthesis, while enabling verification of the LLM's reasoning process. Extensive experiments demonstrate that K2V enhances the reasoning of LLM in knowledge-intensive domains without significantly compromising the model's general capabilities. This study also suggests that integrating automated data synthesis with reasoning verification is a promising direction to enhance model capabilities in these broader domains. Code is available at https://github.com/SeedScientist/K2V. |
| title | Knowledge-to-Verification: Exploring RLVR for LLMs in Knowledge-Intensive Domains |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2605.18261 |