LLM-Guided Compositional Program Synthesis

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Khan, Ruhma, Gulwani, Sumit, Le, Vu, Radhakrishna, Arjun, Tiwari, Ashish, Verbruggen, Gust
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916657825316864
author Khan, Ruhma
Gulwani, Sumit
Le, Vu
Radhakrishna, Arjun
Tiwari, Ashish
Verbruggen, Gust
author_facet Khan, Ruhma
Gulwani, Sumit
Le, Vu
Radhakrishna, Arjun
Tiwari, Ashish
Verbruggen, Gust
contents Program synthesis from input-output examples, also called programming by example (PBE), has had tremendous impact on automating end-user tasks. Large language models (LLMs) have the ability to solve PBE tasks by generating code in different target languages, but they can fail unpredictably. To recover for failure, most approaches, such as self-reflection, use the LLM to solve the same task, but with a richer context. We introduce a novel technique that recovers from failure by constructing simpler subtasks for the LLM to solve. Our approach performs compositional program synthesis using LLMs, where LLM not only guides the decomposition of the PBE task into subtasks, but also solves the subtasks. We present different strategies for decomposing the original task. We experimentally show that our approach can solve challenging task instances that are not solved by self-reflection alone.
format Preprint
id arxiv_https___arxiv_org_abs_2503_15540
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle LLM-Guided Compositional Program Synthesis
Khan, Ruhma
Gulwani, Sumit
Le, Vu
Radhakrishna, Arjun
Tiwari, Ashish
Verbruggen, Gust
Programming Languages
Software Engineering
Program synthesis from input-output examples, also called programming by example (PBE), has had tremendous impact on automating end-user tasks. Large language models (LLMs) have the ability to solve PBE tasks by generating code in different target languages, but they can fail unpredictably. To recover for failure, most approaches, such as self-reflection, use the LLM to solve the same task, but with a richer context. We introduce a novel technique that recovers from failure by constructing simpler subtasks for the LLM to solve. Our approach performs compositional program synthesis using LLMs, where LLM not only guides the decomposition of the PBE task into subtasks, but also solves the subtasks. We present different strategies for decomposing the original task. We experimentally show that our approach can solve challenging task instances that are not solved by self-reflection alone.
title LLM-Guided Compositional Program Synthesis
topic Programming Languages
Software Engineering
url https://arxiv.org/abs/2503.15540