Reprompting: Automated Chain-of-Thought Prompt Inference Through Gibbs Sampling
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , |
|---|---|
| Format: | Preprint |
| Publié: |
2023
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866913360005562368 |
|---|---|
| author | Xu, Weijia Banburski-Fahey, Andrzej Jojic, Nebojsa |
| author_facet | Xu, Weijia Banburski-Fahey, Andrzej Jojic, Nebojsa |
| contents | We introduce Reprompting, an iterative sampling algorithm that automatically learns the Chain-of-Thought (CoT) recipes for a given task without human intervention. Through Gibbs sampling, Reprompting infers the CoT recipes that work consistently well for a set of training samples by iteratively sampling new recipes using previously sampled recipes as parent prompts to solve other training problems. We conduct extensive experiments on 20 challenging reasoning tasks. Results show that Reprompting outperforms human-written CoT prompts substantially by +9.4 points on average. It also achieves consistently better performance than the state-of-the-art prompt optimization and decoding algorithms. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2305_09993 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Reprompting: Automated Chain-of-Thought Prompt Inference Through Gibbs Sampling Xu, Weijia Banburski-Fahey, Andrzej Jojic, Nebojsa Machine Learning Artificial Intelligence Computation and Language We introduce Reprompting, an iterative sampling algorithm that automatically learns the Chain-of-Thought (CoT) recipes for a given task without human intervention. Through Gibbs sampling, Reprompting infers the CoT recipes that work consistently well for a set of training samples by iteratively sampling new recipes using previously sampled recipes as parent prompts to solve other training problems. We conduct extensive experiments on 20 challenging reasoning tasks. Results show that Reprompting outperforms human-written CoT prompts substantially by +9.4 points on average. It also achieves consistently better performance than the state-of-the-art prompt optimization and decoding algorithms. |
| title | Reprompting: Automated Chain-of-Thought Prompt Inference Through Gibbs Sampling |
| topic | Machine Learning Artificial Intelligence Computation and Language |
| url | https://arxiv.org/abs/2305.09993 |