Using a Feedback Loop for LLM-based Infrastructure as Code Generation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Palavalli, Mayur Amarnath, Santolucito, Mark
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915039575801856
author Palavalli, Mayur Amarnath
Santolucito, Mark
author_facet Palavalli, Mayur Amarnath
Santolucito, Mark
contents Code generation with Large Language Models (LLMs) has helped to increase software developer productivity in coding tasks, but has yet to have significant impact on the tasks of software developers that surround this code. In particular, the challenge of infrastructure management remains an open question. We investigate the ability of an LLM agent to construct infrastructure using the Infrastructure as Code (IaC) paradigm. We particularly investigate the use of a feedback loop that returns errors and warnings on the generated IaC to allow the LLM agent to improve the code. We find that, for each iteration of the loop, its effectiveness decreases exponentially until it plateaus at a certain point and becomes ineffective.
format Preprint
id arxiv_https___arxiv_org_abs_2411_19043
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Using a Feedback Loop for LLM-based Infrastructure as Code Generation
Palavalli, Mayur Amarnath
Santolucito, Mark
Software Engineering
Artificial Intelligence
Code generation with Large Language Models (LLMs) has helped to increase software developer productivity in coding tasks, but has yet to have significant impact on the tasks of software developers that surround this code. In particular, the challenge of infrastructure management remains an open question. We investigate the ability of an LLM agent to construct infrastructure using the Infrastructure as Code (IaC) paradigm. We particularly investigate the use of a feedback loop that returns errors and warnings on the generated IaC to allow the LLM agent to improve the code. We find that, for each iteration of the loop, its effectiveness decreases exponentially until it plateaus at a certain point and becomes ineffective.
title Using a Feedback Loop for LLM-based Infrastructure as Code Generation
topic Software Engineering
Artificial Intelligence
url https://arxiv.org/abs/2411.19043