SpeCrawler: Generating OpenAPI Specifications from API Documentation Using Large Language Models

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Lazar, Koren, Vetzler, Matan, Uziel, Guy, Boaz, David, Goldbraich, Esther, Amid, David, Anaby-Tavor, Ateret
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909111381131264
author Lazar, Koren
Vetzler, Matan
Uziel, Guy
Boaz, David
Goldbraich, Esther
Amid, David
Anaby-Tavor, Ateret
author_facet Lazar, Koren
Vetzler, Matan
Uziel, Guy
Boaz, David
Goldbraich, Esther
Amid, David
Anaby-Tavor, Ateret
contents In the digital era, the widespread use of APIs is evident. However, scalable utilization of APIs poses a challenge due to structure divergence observed in online API documentation. This underscores the need for automatic tools to facilitate API consumption. A viable approach involves the conversion of documentation into an API Specification format. While previous attempts have been made using rule-based methods, these approaches encountered difficulties in generalizing across diverse documentation. In this paper we introduce SpeCrawler, a comprehensive system that utilizes large language models (LLMs) to generate OpenAPI Specifications from diverse API documentation through a carefully crafted pipeline. By creating a standardized format for numerous APIs, SpeCrawler aids in streamlining integration processes within API orchestrating systems and facilitating the incorporation of tools into LLMs. The paper explores SpeCrawler's methodology, supported by empirical evidence and case studies, demonstrating its efficacy through LLM capabilities.
format Preprint
id arxiv_https___arxiv_org_abs_2402_11625
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle SpeCrawler: Generating OpenAPI Specifications from API Documentation Using Large Language Models
Lazar, Koren
Vetzler, Matan
Uziel, Guy
Boaz, David
Goldbraich, Esther
Amid, David
Anaby-Tavor, Ateret
Computation and Language
In the digital era, the widespread use of APIs is evident. However, scalable utilization of APIs poses a challenge due to structure divergence observed in online API documentation. This underscores the need for automatic tools to facilitate API consumption. A viable approach involves the conversion of documentation into an API Specification format. While previous attempts have been made using rule-based methods, these approaches encountered difficulties in generalizing across diverse documentation. In this paper we introduce SpeCrawler, a comprehensive system that utilizes large language models (LLMs) to generate OpenAPI Specifications from diverse API documentation through a carefully crafted pipeline. By creating a standardized format for numerous APIs, SpeCrawler aids in streamlining integration processes within API orchestrating systems and facilitating the incorporation of tools into LLMs. The paper explores SpeCrawler's methodology, supported by empirical evidence and case studies, demonstrating its efficacy through LLM capabilities.
title SpeCrawler: Generating OpenAPI Specifications from API Documentation Using Large Language Models
topic Computation and Language
url https://arxiv.org/abs/2402.11625