A Stitch in Time Saves Nine: Proactive Self-Refinement for Language Models
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912628885946368 |
|---|---|
| author | Han, Jinyi Wang, Xinyi Zhao, Haiquan li, Tingyun Jiang, Zishang Jiang, Sihang Liang, Jiaqing Lin, Xin Zhou, Weikang Sun, Zeye Yu, Fei Xiao, Yanghua |
| author_facet | Han, Jinyi Wang, Xinyi Zhao, Haiquan li, Tingyun Jiang, Zishang Jiang, Sihang Liang, Jiaqing Lin, Xin Zhou, Weikang Sun, Zeye Yu, Fei Xiao, Yanghua |
| contents | Recent advances in self-refinement have demonstrated significant potential for improving the outputs of large language models (LLMs) through iterative refinement. However, most existing self-refinement methods rely on a reactive process with a fixed number of iterations, making it difficult to determine the optimal timing and content of refinement based on the evolving generation context. Inspired by the way humans dynamically refine their thoughts during execution, we propose ProActive Self-Refinement (PASR), a novel method that enables LLMs to refine their outputs during the generation process. Unlike methods that regenerate entire responses, PASR proactively decides whether, when, and how to refine based on the model's internal state and evolving context. We conduct extensive experiments on a diverse set of 10 tasks to evaluate the effectiveness of PASR. Experimental results show that PASR significantly enhances problem-solving performance. In particular, on Qwen3-8B, PASR reduces average token consumption by 41.6% compared to standard generation, while also achieving an 8.2% improvement in accuracy. Our code and baselines used in the paper are available on GitHub. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_12903 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | A Stitch in Time Saves Nine: Proactive Self-Refinement for Language Models Han, Jinyi Wang, Xinyi Zhao, Haiquan li, Tingyun Jiang, Zishang Jiang, Sihang Liang, Jiaqing Lin, Xin Zhou, Weikang Sun, Zeye Yu, Fei Xiao, Yanghua Computation and Language Artificial Intelligence Recent advances in self-refinement have demonstrated significant potential for improving the outputs of large language models (LLMs) through iterative refinement. However, most existing self-refinement methods rely on a reactive process with a fixed number of iterations, making it difficult to determine the optimal timing and content of refinement based on the evolving generation context. Inspired by the way humans dynamically refine their thoughts during execution, we propose ProActive Self-Refinement (PASR), a novel method that enables LLMs to refine their outputs during the generation process. Unlike methods that regenerate entire responses, PASR proactively decides whether, when, and how to refine based on the model's internal state and evolving context. We conduct extensive experiments on a diverse set of 10 tasks to evaluate the effectiveness of PASR. Experimental results show that PASR significantly enhances problem-solving performance. In particular, on Qwen3-8B, PASR reduces average token consumption by 41.6% compared to standard generation, while also achieving an 8.2% improvement in accuracy. Our code and baselines used in the paper are available on GitHub. |
| title | A Stitch in Time Saves Nine: Proactive Self-Refinement for Language Models |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2508.12903 |