RESTestBench: A Benchmark for Evaluating the Effectiveness of LLM-Generated REST API Test Cases from NL Requirements
Fuente:
arXiv
Guardado en:
| Autores principales: | Kogler, Leon, Hangler, Stefan, Ehrhart, Maximilian, Dornauer, Benedikt, Wuersching, Roland, Schrammel, Peter |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
RESTifAI: LLM-Based Workflow for Reusable REST API Testing
por: Kogler, Leon, et al.
Publicado: (2025)
por: Kogler, Leon, et al.
Publicado: (2025)
Automating REST API Postman Test Cases Using LLM
por: Sri, S Deepika, et al.
Publicado: (2024)
por: Sri, S Deepika, et al.
Publicado: (2024)
Retrieval-Augmented Generation in Industry: An Interview Study on Use Cases, Requirements, Challenges, and Evaluation
por: Brehme, Lorenz, et al.
Publicado: (2025)
por: Brehme, Lorenz, et al.
Publicado: (2025)
Generating REST API Tests With Descriptive Names
por: Garrett, Philip, et al.
Publicado: (2025)
por: Garrett, Philip, et al.
Publicado: (2025)
LlamaRestTest: Effective REST API Testing with Small Language Models
por: Kim, Myeongsoo, et al.
Publicado: (2025)
por: Kim, Myeongsoo, et al.
Publicado: (2025)
You Can REST Now: Automated REST API Documentation and Testing via LLM-Assisted Request Mutations
por: Decrop, Alix, et al.
Publicado: (2024)
por: Decrop, Alix, et al.
Publicado: (2024)
Developer Perspectives on REST API Usability: A Study of REST API Guidelines
por: Peldszus, Sven, et al.
Publicado: (2026)
por: Peldszus, Sven, et al.
Publicado: (2026)
Log-based, Business-aware REST API Testing
por: Yang, Ding, et al.
Publicado: (2026)
por: Yang, Ding, et al.
Publicado: (2026)
Combining TSL and LLM to Automate REST API Testing: A Comparative Study
por: Barradas, Thiago, et al.
Publicado: (2025)
por: Barradas, Thiago, et al.
Publicado: (2025)
Reinforcement Learning-Based REST API Testing with Multi-Coverage
por: Nguyen, Tien-Quang, et al.
Publicado: (2024)
por: Nguyen, Tien-Quang, et al.
Publicado: (2024)
Leveraging Large Language Models to Improve REST API Testing
por: Kim, Myeongsoo, et al.
Publicado: (2023)
por: Kim, Myeongsoo, et al.
Publicado: (2023)
Assessing REST API Test Generation Strategies with Log Coverage
por: Reinikainen, Nana, et al.
Publicado: (2026)
por: Reinikainen, Nana, et al.
Publicado: (2026)
Prompt-Based REST API Test Amplification in Industry: An Experience Report
por: Bardakci, Tolgahan, et al.
Publicado: (2026)
por: Bardakci, Tolgahan, et al.
Publicado: (2026)
A Multi-Agent Approach for REST API Testing with Semantic Graphs and LLM-Driven Inputs
por: Kim, Myeongsoo, et al.
Publicado: (2024)
por: Kim, Myeongsoo, et al.
Publicado: (2024)
Detecting and Mitigating Flakiness in REST API Fuzzing
por: Zhang, Man, et al.
Publicado: (2026)
por: Zhang, Man, et al.
Publicado: (2026)
REST API Testing in DevOps: A Study on an Evolving Healthcare IoT Application
por: Sartaj, Hassan, et al.
Publicado: (2024)
por: Sartaj, Hassan, et al.
Publicado: (2024)
OpenAI for OpenAPI: Automated generation of REST API specification via LLMs
por: Chen, Hao, et al.
Publicado: (2026)
por: Chen, Hao, et al.
Publicado: (2026)
Agentic LLMs for REST API Test Amplification: A Comparative Study Across Cloud Applications
por: Besjes, Jarne, et al.
Publicado: (2025)
por: Besjes, Jarne, et al.
Publicado: (2025)
AutoRestTest: A Tool for Automated REST API Testing Using LLMs and MARL
por: Stennett, Tyler, et al.
Publicado: (2025)
por: Stennett, Tyler, et al.
Publicado: (2025)
From REST to MCP: An Empirical Study of API Wrapping and Automated Server Generation for LLM Agents
por: Mastouri, Meriem, et al.
Publicado: (2025)
por: Mastouri, Meriem, et al.
Publicado: (2025)
WuppieFuzz: Coverage-Guided, Stateful REST API Fuzzing
por: Rooijakkers, Thomas, et al.
Publicado: (2025)
por: Rooijakkers, Thomas, et al.
Publicado: (2025)
DeepREST: Automated Test Case Generation for REST APIs Exploiting Deep Reinforcement Learning
por: Corradini, Davide, et al.
Publicado: (2024)
por: Corradini, Davide, et al.
Publicado: (2024)
APITestGenie: Generating Web API Tests from Requirements and API Specifications with LLMs
por: Pereira, André, et al.
Publicado: (2026)
por: Pereira, André, et al.
Publicado: (2026)
PandasBench: A Benchmark for the Pandas API
por: Broihier, Alex, et al.
Publicado: (2025)
por: Broihier, Alex, et al.
Publicado: (2025)
Making OpenAPI Documentation Agent-Ready: Detecting Documentation and REST Smells with a Multi-Agent LLM System
por: Lima, Rayfran Rocha, et al.
Publicado: (2026)
por: Lima, Rayfran Rocha, et al.
Publicado: (2026)
APIRL: Deep Reinforcement Learning for REST API Fuzzing
por: Foley, Myles, et al.
Publicado: (2024)
por: Foley, Myles, et al.
Publicado: (2024)
MermaidSeqBench: An Evaluation Benchmark for NL-to-Mermaid Sequence Diagram Generation
por: Shbita, Basel, et al.
Publicado: (2025)
por: Shbita, Basel, et al.
Publicado: (2025)
Automated Program Repair Based on REST API Specifications Using Large Language Models
por: Yamagishi, Katsuki, et al.
Publicado: (2025)
por: Yamagishi, Katsuki, et al.
Publicado: (2025)
ToolFactory: Automating Tool Generation by Leveraging LLM to Understand REST API Documentations
por: Ni, Xinyi, et al.
Publicado: (2025)
por: Ni, Xinyi, et al.
Publicado: (2025)
FireBench: Evaluating Instruction Following in Enterprise and API-Driven LLM Applications
por: Zhang, Yunfan, et al.
Publicado: (2026)
por: Zhang, Yunfan, et al.
Publicado: (2026)
Enhancing REST API Fuzzing with Access Policy Violation Checks and Injection Attacks
por: Sahin, Omur, et al.
Publicado: (2026)
por: Sahin, Omur, et al.
Publicado: (2026)
WFC/WFD: Web Fuzzing Commons, Dataset and Guidelines to Support Experimentation in REST API Fuzzing
por: Sahin, Omur, et al.
Publicado: (2025)
por: Sahin, Omur, et al.
Publicado: (2025)
Test Amplification for REST APIs via Single and Multi-Agent LLM Systems
por: Nooyens, Robbe, et al.
Publicado: (2025)
por: Nooyens, Robbe, et al.
Publicado: (2025)
Generating Test Scenarios from NL Requirements using Retrieval-Augmented LLMs: An Industrial Study
por: Arora, Chetan, et al.
Publicado: (2024)
por: Arora, Chetan, et al.
Publicado: (2024)
FuzzTheREST: An Intelligent Automated Black-box RESTful API Fuzzer
por: Dias, Tiago, et al.
Publicado: (2024)
por: Dias, Tiago, et al.
Publicado: (2024)
LogiAgent: Automated Logical Testing for REST Systems with LLM-Based Multi-Agents
por: Zhang, Ke, et al.
Publicado: (2025)
por: Zhang, Ke, et al.
Publicado: (2025)
SATORI: Static Test Oracle Generation for REST APIs
por: Alonso, Juan C., et al.
Publicado: (2025)
por: Alonso, Juan C., et al.
Publicado: (2025)
A Framework for Testing and Adapting REST APIs as LLM Tools
por: Bandlamudi, Jayachandu, et al.
Publicado: (2025)
por: Bandlamudi, Jayachandu, et al.
Publicado: (2025)
Evaluating and Mitigating Errors in LLM-Generated Web API Integrations
por: Maninger, Daniel, et al.
Publicado: (2025)
por: Maninger, Daniel, et al.
Publicado: (2025)
MioHint: LLM-assisted Mutation for Whitebox API Testing
por: Li, Jia, et al.
Publicado: (2025)
por: Li, Jia, et al.
Publicado: (2025)
Ejemplares similares
-
RESTifAI: LLM-Based Workflow for Reusable REST API Testing
por: Kogler, Leon, et al.
Publicado: (2025) -
Automating REST API Postman Test Cases Using LLM
por: Sri, S Deepika, et al.
Publicado: (2024) -
Retrieval-Augmented Generation in Industry: An Interview Study on Use Cases, Requirements, Challenges, and Evaluation
por: Brehme, Lorenz, et al.
Publicado: (2025) -
Generating REST API Tests With Descriptive Names
por: Garrett, Philip, et al.
Publicado: (2025) -
LlamaRestTest: Effective REST API Testing with Small Language Models
por: Kim, Myeongsoo, et al.
Publicado: (2025)