EvoCurr: Self-evolving Curriculum with Behavior Code Generation for Complex Decision-making

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Cheng, Yang, Wang, Zilai, Ma, Weiyu, Zhu, Wenhui, Deng, Yue, Zhao, Jian
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911111957184512
author Cheng, Yang
Wang, Zilai
Ma, Weiyu
Zhu, Wenhui
Deng, Yue
Zhao, Jian
author_facet Cheng, Yang
Wang, Zilai
Ma, Weiyu
Zhu, Wenhui
Deng, Yue
Zhao, Jian
contents Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse domains, including programming, planning, and decision-making. However, their performance often degrades when faced with highly complex problem instances that require deep reasoning over long horizons. In such cases, direct problem-solving approaches can lead to inefficiency or failure due to the lack of structured intermediate guidance. To address this, we propose a novel self-evolve framework, EvoCurr, in which a dedicated curriculum-generation LLM constructs a sequence of problem instances with gradually increasing difficulty, tailored to the solver LLM's learning progress. The curriculum dynamically adapts easing challenges when the solver struggles and escalating them when success is consistent, thus maintaining an optimal learning trajectory. This approach enables the solver LLM, implemented as a code-generation model producing Python decision-tree scripts, to progressively acquire the skills needed for complex decision-making tasks. Experimental results on challenging decision-making benchmarks show that our method significantly improves task success rates and solution efficiency compared to direct-solving baselines. These findings suggest that LLM-driven curriculum learning holds strong potential for enhancing automated reasoning in real-world, high-complexity domains.
format Preprint
id arxiv_https___arxiv_org_abs_2508_09586
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle EvoCurr: Self-evolving Curriculum with Behavior Code Generation for Complex Decision-making
Cheng, Yang
Wang, Zilai
Ma, Weiyu
Zhu, Wenhui
Deng, Yue
Zhao, Jian
Artificial Intelligence
Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse domains, including programming, planning, and decision-making. However, their performance often degrades when faced with highly complex problem instances that require deep reasoning over long horizons. In such cases, direct problem-solving approaches can lead to inefficiency or failure due to the lack of structured intermediate guidance. To address this, we propose a novel self-evolve framework, EvoCurr, in which a dedicated curriculum-generation LLM constructs a sequence of problem instances with gradually increasing difficulty, tailored to the solver LLM's learning progress. The curriculum dynamically adapts easing challenges when the solver struggles and escalating them when success is consistent, thus maintaining an optimal learning trajectory. This approach enables the solver LLM, implemented as a code-generation model producing Python decision-tree scripts, to progressively acquire the skills needed for complex decision-making tasks. Experimental results on challenging decision-making benchmarks show that our method significantly improves task success rates and solution efficiency compared to direct-solving baselines. These findings suggest that LLM-driven curriculum learning holds strong potential for enhancing automated reasoning in real-world, high-complexity domains.
title EvoCurr: Self-evolving Curriculum with Behavior Code Generation for Complex Decision-making
topic Artificial Intelligence
url https://arxiv.org/abs/2508.09586