Strategy-Induct: Task-Level Strategy Induction for Instruction Generation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Chen, Po-Chun, Huang, Hen-Hsen, Chen, Hsin-Hsi
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917515626545152
author Chen, Po-Chun
Huang, Hen-Hsen
Chen, Hsin-Hsi
author_facet Chen, Po-Chun
Huang, Hen-Hsen
Chen, Hsin-Hsi
contents Designing effective task-level prompts is crucial for improving the performance of Large Language Models (LLMs). While prior work on instruction induction demonstrates that LLMs can infer better instructions with limited examples, existing approaches often rely on input-output pairs, where obtaining labeled answers can be difficult or costly. To address this limitation, we propose Strategy-Induct, a framework that derives task-level instructions solely from a small set of example questions without requiring labeled answers. Our approach first prompts the model to generate explicit reasoning strategies for each question, forming (strategy, question) pairs. These pairs are then used to induce a task instruction that guides reasoning. Experiments across multiple tasks and model scales demonstrate that Strategy-Induct outperforms state-of-the-art methods in question-only settings. Furthermore, we observe that jointly utilizing LLMs and Large Reasoning Models across task instruction generation and inference may lead to further performance improvements.
format Preprint
id arxiv_https___arxiv_org_abs_2605_20924
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Strategy-Induct: Task-Level Strategy Induction for Instruction Generation
Chen, Po-Chun
Huang, Hen-Hsen
Chen, Hsin-Hsi
Computation and Language
Artificial Intelligence
Designing effective task-level prompts is crucial for improving the performance of Large Language Models (LLMs). While prior work on instruction induction demonstrates that LLMs can infer better instructions with limited examples, existing approaches often rely on input-output pairs, where obtaining labeled answers can be difficult or costly. To address this limitation, we propose Strategy-Induct, a framework that derives task-level instructions solely from a small set of example questions without requiring labeled answers. Our approach first prompts the model to generate explicit reasoning strategies for each question, forming (strategy, question) pairs. These pairs are then used to induce a task instruction that guides reasoning. Experiments across multiple tasks and model scales demonstrate that Strategy-Induct outperforms state-of-the-art methods in question-only settings. Furthermore, we observe that jointly utilizing LLMs and Large Reasoning Models across task instruction generation and inference may lead to further performance improvements.
title Strategy-Induct: Task-Level Strategy Induction for Instruction Generation
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2605.20924