Imagen de Portada

Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Yang, Zheyuan, Kuang, Zexi, Xia, Xue, Zhao, Yilun
Formato:	Preprint
Publicado:	2025
Materias:	Software Engineering Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Generalizing Test Cases for Comprehensive Test Scenario Coverage
por: Qi, Binhang, et al.
Publicado: (2026)

LLMs-Powered Real-Time Fault Injection: An Approach Toward Intelligent Fault Test Cases Generation
por: Abboush, Mohammad, et al.
Publicado: (2025)

Boundary Value Test Input Generation Using Prompt Engineering with LLMs: Fault Detection and Coverage Analysis
por: Guo, Xiujing, et al.
Publicado: (2025)

NovaQ: Improving Quantum Program Testing through Diversity-Guided Test Case Generation
por: Jin, Tiancheng, et al.
Publicado: (2025)

Testing with AI Agents: An Empirical Study of Test Generation Frequency, Quality, and Coverage
por: Yoshimoto, Suzuka, et al.
Publicado: (2026)

Requirements Coverage-Guided Minimization for Natural Language Test Cases
por: Pan, Rongqi, et al.
Publicado: (2025)

Can LLMs Generate Reliable Test Case Generators? A Study on Competition-Level Programming Problems
por: Cao, Yuhan, et al.
Publicado: (2025)

Automatically Learning a Precise Measurement for Fault Diagnosis Capability of Test Cases
por: Zhao, Yifan, et al.
Publicado: (2025)

CodeContests+: High-Quality Test Case Generation for Competitive Programming
por: Wang, Zihan, et al.
Publicado: (2025)

TAM-Eval: Evaluating LLMs for Automated Unit Test Maintenance
por: Bruches, Elena, et al.
Publicado: (2026)

Introducing Ensemble Machine Learning Algorithms for Automatic Test Case Generation using Learning Based Testing
por: Rahman, Sheikh Md. Mushfiqur, et al.
Publicado: (2024)

TestBench: Evaluating Class-Level Test Case Generation Capability of Large Language Models
por: Zhang, Quanjun, et al.
Publicado: (2024)

TestGenEval: A Real World Unit Test Generation and Test Completion Benchmark
por: Jain, Kush, et al.
Publicado: (2024)

Quantum Approximate Optimization Algorithm for Test Case Optimization
por: Wang, Xinyi, et al.
Publicado: (2023)

CodeContests-O: Powering LLMs via Feedback-Driven Iterative Test Case Generation
por: Cai, Jianfeng, et al.
Publicado: (2026)

Fix the Tests: Augmenting LLMs to Repair Test Cases with Static Collector and Neural Reranker
por: Liu, Jun, et al.
Publicado: (2024)

From Requirements to Test Cases: An NLP-Based Approach for High-Performance ECU Test Case Automation
por: Medeshetty, Nikitha, et al.
Publicado: (2025)

Generalized Coverage Criteria for Combinatorial Sequence Testing
por: Elyasaf, Achiya, et al.
Publicado: (2022)

Explicating Tacit Regulatory Knowledge from LLMs to Auto-Formalize Requirements for Compliance Test Case Generation
por: Xue, Zhiyi, et al.
Publicado: (2026)

Towards Leveraging LLMs to Generate Abstract Penetration Test Cases from Software Architecture
por: Jafari, Mahdi, et al.
Publicado: (2026)

GenFair: Systematic Test Generation for Fairness Fault Detection in Large Language Models
por: Srinivasan, Madhusudan, et al.
Publicado: (2025)

Issue2Test: Generating Reproducing Test Cases from Issue Reports
por: Nashid, Noor, et al.
Publicado: (2025)

Automatic High-Level Test Case Generation using Large Language Models
por: Hasan, Navid Bin, et al.
Publicado: (2025)

Automated Unit Test Case Generation: A Systematic Literature Review
por: Wang, Jason, et al.
Publicado: (2025)

CLOVER: A Test Case Generation Benchmark with Coverage, Long-Context, and Verification
por: Xu, Jiacheng, et al.
Publicado: (2025)

Exploring Sustainability in Scientific Software through Code Quality & Test Coverage Metrics
por: Rahman, Sheikh Md. Mushfiqur, et al.
Publicado: (2026)

PALM: Synergizing Program Analysis and LLMs to Enhance Rust Unit Test Coverage
por: Chu, Bei, et al.
Publicado: (2025)

ATGen: Adversarial Reinforcement Learning for Test Case Generation
por: Li, Qingyao, et al.
Publicado: (2025)

Test Case Generation for Dialogflow Task-Based Chatbots
por: Rapisarda, Rocco Gianni, et al.
Publicado: (2025)

SESR-Eval: Dataset for Evaluating LLMs in the Title-Abstract Screening of Systematic Reviews
por: Huotala, Aleksi, et al.
Publicado: (2025)

Generating High-Level Test Cases from Requirements using LLM: An Industry Study
por: Masuda, Satoshi, et al.
Publicado: (2025)

Assessing REST API Test Generation Strategies with Log Coverage
por: Reinikainen, Nana, et al.
Publicado: (2026)

Studying the Impact of Early Test Termination Due to Assertion Failure on Code Coverage and Spectrum-based Fault Localization
por: Uddin, Md. Ashraf, et al.
Publicado: (2025)

Dynamic Test Case Prioritization in Industrial Test Result Datasets
por: Torbunova, Alina, et al.
Publicado: (2024)

Enriching Automatic Test Case Generation by Extracting Relevant Test Inputs from Bug Reports
por: Ouédraogo, Wendkûuni C., et al.
Publicado: (2023)

Generating Project-Specific Test Cases with Requirement Validation Intention
por: Qi, Binhang, et al.
Publicado: (2025)

TESTEVAL: Benchmarking Large Language Models for Test Case Generation
por: Wang, Wenhan, et al.
Publicado: (2024)

HumanEval Pro and MBPP Pro: Evaluating Large Language Models on Self-invoking Code Generation
por: Yu, Zhaojian, et al.
Publicado: (2024)

Empirically Evaluating the Use of Bytecode for Diversity-Based Test Case Prioritisation
por: Elgendy, Islam T., et al.
Publicado: (2025)

Can My Microservice Tolerate an Unreliable Database? Resilience Testing with Fault Injection and Visualization
por: Assad, Michael, et al.
Publicado: (2024)