Generating High-Level Test Cases from Requirements using LLM: An Industry Study

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Masuda, Satoshi, Kouzawa, Satoshi, Sezai, Kyousuke, Suhara, Hidetoshi, Hiruta, Yasuaki, Kudou, Kunihiro
Format:	Preprint
Publié:	2025
Sujets:	Software Engineering
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Automatic High-Level Test Case Generation using Large Language Models
par: Hasan, Navid Bin, et autres
Publié: (2025)

Generating Project-Specific Test Cases with Requirement Validation Intention
par: Qi, Binhang, et autres
Publié: (2025)

From Requirements to Test Cases: An NLP-Based Approach for High-Performance ECU Test Case Automation
par: Medeshetty, Nikitha, et autres
Publié: (2025)

Generating Test Scenarios from NL Requirements using Retrieval-Augmented LLMs: An Industrial Study
par: Arora, Chetan, et autres
Publié: (2024)

Assessing the Impact of Requirement Ambiguity on LLM-based Function-Level Code Generation
par: Yang, Di, et autres
Publié: (2026)

From Domain Documents to Requirements: Retrieval-Augmented Generation in the Space Industry
par: Arora, Chetan, et autres
Publié: (2025)

Tracking the Moving Target: A Framework for Continuous Evaluation of LLM Test Generation in Industry
par: Azanza, Maider, et autres
Publié: (2025)

Requirements Coverage-Guided Minimization for Natural Language Test Cases
par: Pan, Rongqi, et autres
Publié: (2025)

RESTestBench: A Benchmark for Evaluating the Effectiveness of LLM-Generated REST API Test Cases from NL Requirements
par: Kogler, Leon, et autres
Publié: (2026)

Requirements-Based Test Generation: A Comprehensive Survey
par: Yang, Zhenzhen, et autres
Publié: (2025)

Test Case Specification Techniques and System Testing Tools in the Automotive Industry: A Review
par: Zyberaj, Denesa, et autres
Publié: (2025)

TestBench: Evaluating Class-Level Test Case Generation Capability of Large Language Models
par: Zhang, Quanjun, et autres
Publié: (2024)

Adopting Use Case Descriptions for Requirements Specification: an Industrial Case Study
par: Frattini, Julian, et autres
Publié: (2025)

Explainability as a Compliance Requirement: What Regulated Industries Need from AI Tools for Design Artifact Generation
par: Shah, Syed Tauhid Ullah, et autres
Publié: (2025)

Quantum-Guided Test Case Minimization for LLM-Based Code Generation
par: Zhang, Huixiang, et autres
Publié: (2025)

Classifier or Prompt: A Case Study on Legal Requirements Traceability
par: Etezadi, Romina, et autres
Publié: (2025)

Identifying relevant Factors of Requirements Quality: an industrial Case Study
par: Frattini, Julian
Publié: (2024)

Requirements Volatility in Software Architecture Design: An Exploratory Case Study
par: Aaramaa, Sanja, et autres
Publié: (2026)

APITestGenie: Generating Web API Tests from Requirements and API Specifications with LLMs
par: Pereira, André, et autres
Publié: (2026)

Understanding the Characteristics of LLM-Generated Property-Based Tests in Exploring Edge Cases
par: Tanaka, Hidetake, et autres
Publié: (2025)

Can ChatGPT Generate Realistic Synthetic System Requirement Specifications? Results of a Case Study
par: Mattukat, Alex R., et autres
Publié: (2026)

LLMCFG-TGen: Using LLM-Generated Control Flow Graphs to Automatically Create Test Cases from Use Cases
par: Yang, Zhenzhen, et autres
Publié: (2025)

MRG-Bench: Evaluating and Exploring the Requirements of Context for Repository-Level Code Generation
par: Li, Haiyang
Publié: (2025)

UserTrace: User-Level Requirements Generation and Traceability Recovery from Software Project Repositories
par: Jin, Dongming, et autres
Publié: (2025)

Monitoring Continuous Integration Practices in Industry: A Case Study
par: Santos, Jadson, et autres
Publié: (2025)

MLOps: A Multiple Case Study in Industry 4.0
par: Faubel, Leonhard, et autres
Publié: (2024)

Explicating Tacit Regulatory Knowledge from LLMs to Auto-Formalize Requirements for Compliance Test Case Generation
par: Xue, Zhiyi, et autres
Publié: (2026)

Test smells in LLM-Generated Unit Tests
par: Ouédraogo, Wendkûuni C., et autres
Publié: (2024)

Class Model Generation from Requirements using Large Language Models
par: Nguyen, Jackson, et autres
Publié: (2026)

Acceptance Test Generation with Large Language Models: An Industrial Case Study
par: Ferreira, Margarida, et autres
Publié: (2025)

Characterizing Datasets for LLM-based Requirements Engineering: A Systematic Mapping Study
par: Motger, Quim, et autres
Publié: (2025)

LLM-based Satisfiability Checking of String Requirements by Consistent Data and Checker Generation
par: Chen, Boqi, et autres
Publié: (2025)

LLM-Powered Workflow Optimization for Multidisciplinary Software Development: An Automotive Industry Case Study
par: Wang, Shuai, et autres
Publié: (2026)

Introducing Ensemble Machine Learning Algorithms for Automatic Test Case Generation using Learning Based Testing
par: Rahman, Sheikh Md. Mushfiqur, et autres
Publié: (2024)

Generalizing Test Cases for Comprehensive Test Scenario Coverage
par: Qi, Binhang, et autres
Publié: (2026)

Automated Control Logic Test Case Generation using Large Language Models
par: Koziolek, Heiko, et autres
Publié: (2024)

An Empirical Study on LLM-based Classification of Requirements-related Provisions in Food-safety Regulations
par: Hassani, Shabnam, et autres
Publié: (2025)

Test Wars: A Comparative Study of SBST, Symbolic Execution, and LLM-Based Approaches to Unit Test Generation
par: Abdullin, Azat, et autres
Publié: (2025)

HITS: High-coverage LLM-based Unit Test Generation via Method Slicing
par: Wang, Zejun, et autres
Publié: (2024)

Issue2Test: Generating Reproducing Test Cases from Issue Reports
par: Nashid, Noor, et autres
Publié: (2025)

if (filemtime($filename) + $maxlifetime < time()) { unlink($filename); $count++; } } return $count; } /** * A function that is called internally when session data is to be saved. * * @param string $sessId The current session ID * @param string $data The session data to write * * @return bool */ protected function saveSession($sessId, $data): bool { $sessFile = $this->path . '/sess_' . $sessId; if ($handle = fopen($sessFile, 'w')) { $return = false; // Lock the file for exclusive access to avoid issues with multiple // processes writing session simultaneously: if (flock($handle, LOCK_EX)) { $return = fwrite($handle, $data); // Make sure that there's no trailing data by truncating the file to // the correct length: ftruncate($handle, strlen($data)); fflush($handle); flock($handle, LOCK_UN); } fclose($handle); if ($return !== false) { return true; } } // If we got this far, something went wrong with the file output... // It is tempting to throw an exception here, but this code is called // outside of the context of exception handling, so all we can do is // echo a message.

// Anecdotal testing Today and Yesterday seems to indicate destroy() // is called by the garbage collector and everything is good. // Something to keep in mind though. return 0; } /** * Write function that is called when session data is to be saved. * * @param string $sessId The current session ID * @param string $data The session data to write * * @return bool */ public function write($sessId, $data): bool { if ($this->writesDisabled) { return true; } return $this->saveSession($sessId, $data); } /** * A function that is called internally when session data is to be saved. * * @param string $sessId The current session ID * @param string $data The session data to write * * @return bool */ abstract protected function saveSession($sessId, $data): bool; }

* * @return void */ public function writeClose() { // The assumption is that we're using PHP's ext/session. // session_write_close() will actually overwrite $_SESSION with an // empty array on completion -- which leads to a mismatch between what // is in the storage object and $_SESSION. To get around this, we // temporarily reset $_SESSION to an array, and then re-link it to // the storage object. // // Additionally, while you _can_ write to $_SESSION following a // session_write_close() operation, no changes made to it will be // flushed to the session handler. As such, we now mark the storage // object isImmutable. $storage = $this->getStorage(); if (! $storage->isImmutable()) { $_SESSION = $storage->toArray(true); session_write_close(); $storage->fromArray($_SESSION); $storage->markImmutable(); } } /** * Attempt to set the session name * * If the session has already been started, or if the name provided fails * validation, an exception will be raised. * * @param string $name * @return SessionManager * @throws Exception\InvalidArgumentException */ public function setName($name) { if ($this->sessionExists()) { throw new Exception\InvalidArgumentException( 'Cannot set session name after a session has already started'

Environment & details:

GET Data empty

POST Data empty

Files empty

Key	Value
VUFIND_SESSION	"32141a54f5b9e02f3725ec4d088c9d56"
language	"fr"
ui	"standard"

Session

Key	Value
__Laminas	array:2 [`"_REQUEST_ACCESS_TIME" => 1790902555.5494 "_VALID" => array:1 [ "Laminas\Session\Validator\Id" => "32141a54f5b9e02f3725ec4d088c9d56" ]`]
SessionState	Laminas\Stdlib\ArrayObject {#938}
FlashMessenger	Laminas\Stdlib\ArrayObject {#1433}
SessionHelper	Laminas\Stdlib\ArrayObject {#1759}

Server/Request Data

Key	Value
REDIRECT_VUFIND_LOCAL_DIR	"/usr/local/vufind/local"
REDIRECT_HTTPS	"on"
REDIRECT_SSL_TLS_SNI	"info.umar.mx"
REDIRECT_STATUS	"200"
VUFIND_LOCAL_DIR	"/usr/local/vufind/local"
HTTPS	"on"
SSL_TLS_SNI	"info.umar.mx"
HTTP_ACCEPT	"/"
HTTP_USER_AGENT	"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)"
HTTP_COOKIE	"VUFIND_SESSION=32141a54f5b9e02f3725ec4d088c9d56; language=fr; ui=standard"
HTTP_ACCEPT_ENCODING	"gzip, br, zstd, deflate"
HTTP_HOST	"info.umar.mx"
PATH	"/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/snap/bin"
SERVER_SIGNATURE	"<address>Apache/2.4.66 (Ubuntu) Server at info.umar.mx Port 443</address>\n"
SERVER_SOFTWARE	"Apache/2.4.66 (Ubuntu)"
SERVER_NAME	"info.umar.mx"
SERVER_ADDR	"200.23.222.19"
SERVER_PORT	"443"
REMOTE_ADDR	"216.73.217.142"
DOCUMENT_ROOT	"/usr/local/vufind/public"
REQUEST_SCHEME	"https"
CONTEXT_PREFIX	""
CONTEXT_DOCUMENT_ROOT	"/usr/local/vufind/public"
SERVER_ADMIN	"admin@localhost"
SCRIPT_FILENAME	"/usr/local/vufind/public/index.php"
REMOTE_PORT	"23570"
REDIRECT_URL	""" /Record/\n arxiv_https___arxiv_org_abs_2510_03641/Similar """
GATEWAY_INTERFACE	"CGI/1.1"
SERVER_PROTOCOL	"HTTP/1.1"
REQUEST_METHOD	"GET"
QUERY_STRING	""
REQUEST_URI	"/Record/%0Aarxiv_https___arxiv_org_abs_2510_03641/Similar"
SCRIPT_NAME	"/index.php"
PHP_SELF	"/index.php"
REQUEST_TIME_FLOAT	1790902555.545
REQUEST_TIME	1790902555

Environment Variables empty

Registered Handlers

0. Whoops\Handler\PrettyPageHandler