Copertina

Can We Classify Flaky Tests Using Only Test Code? An LLM-Based Empirical Study

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Berndt, Alexander, Bekmyradov, Vekil, Gemulla, Rainer, Kessel, Marcus, Bach, Thomas, Baltes, Sebastian
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Software Engineering
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

On the Flakiness of LLM-Generated Tests for Industrial and Open-Source Database Management Systems
di: Berndt, Alexander, et al.
Pubblicazione: (2026)

Do Test and Environmental Complexity Increase Flakiness? An Empirical Study of SAP HANA
di: Berndt, Alexander, et al.
Pubblicazione: (2024)

Flaky Tests in a Large Industrial Database Management System: An Empirical Study of Fixed Issue Reports for SAP HANA
di: Berndt, Alexander, et al.
Pubblicazione: (2026)

Taming Timeout Flakiness: An Empirical Study of SAP HANA
di: Berndt, Alexander, et al.
Pubblicazione: (2024)

The Vocabulary of Flaky Tests in the Context of SAP HANA
di: Berndt, Alexander, et al.
Pubblicazione: (2026)

230,439 Test Failures Later: An Empirical Evaluation of Flaky Failure Classifiers
di: Alshammari, Abdulrahman, et al.
Pubblicazione: (2024)

Systemic Flakiness: An Empirical Analysis of Co-Occurring Flaky Test Failures
di: Parry, Owain, et al.
Pubblicazione: (2025)

LLMs taking shortcuts in test generation: A study with SAP HANA and LevelDB
di: Bekmyradov, Vekil, et al.
Pubblicazione: (2026)

FlakyFix: Using Large Language Models for Predicting Flaky Test Fix Categories and Test Code Repair
di: Fatima, Sakina, et al.
Pubblicazione: (2023)

The Effects of Computational Resources on Flaky Tests
di: Silva, Denini, et al.
Pubblicazione: (2023)

Treating Run-time Execution History as a First-Class Citizen: Co-Versioning Run-time Behavior alongside Code
di: Kessel, Marcus
Pubblicazione: (2026)

A Dataset of Reproducible Flaky-Test Failures
di: Rafi, Suzzana, et al.
Pubblicazione: (2026)

NeuroFlake: A Neuro-Symbolic LLM Framework for Flaky Test Classification
di: Hoque, Khondaker Tasnia, et al.
Pubblicazione: (2026)

Using Large Language Models to Support Automation of Failure Management in CI/CD Pipelines: A Case Study in SAP HANA
di: Bui, Duong, et al.
Pubblicazione: (2026)

Reduction of Test Re-runs by Prioritizing Potential Order Dependent Flaky Tests
di: Iqbal, Hasnain, et al.
Pubblicazione: (2025)

Identifying Flaky Tests in Quantum Code: A Machine Learning Approach
di: Kaur, Khushdeep, et al.
Pubblicazione: (2025)

A Preliminary Study of Fixed Flaky Tests in Rust Projects on GitHub
di: Schroeder, Tom, et al.
Pubblicazione: (2025)

Towards Evaluation Guidelines for Empirical Studies involving LLMs
di: Wagner, Stefan, et al.
Pubblicazione: (2024)

A Systematic Evaluation of Environmental Flakiness in JavaScript Tests
di: Hashemi, Negar, et al.
Pubblicazione: (2026)

JS-TOD: Detecting Order-Dependent Flaky Tests in Jest
di: Hashemi, Negar, et al.
Pubblicazione: (2025)

Detecting and Evaluating Order-Dependent Flaky Tests in JavaScript
di: Hashemi, Negar, et al.
Pubblicazione: (2025)

Detecting Flaky Tests in Quantum Software: A Dynamic Approach
di: Kim, Dongchan, et al.
Pubblicazione: (2025)

Ethics of Care for Software Engineering
di: Serebrenik, Alexander, et al.
Pubblicazione: (2026)

Test-driven Software Experimentation with LASSO: an LLM Prompt Benchmarking Example
di: Kessel, Marcus
Pubblicazione: (2024)

LLM-Based Test-Driven Interactive Code Generation: User Study and Empirical Evaluation
di: Fakhoury, Sarah, et al.
Pubblicazione: (2024)

A Generic Approach to Fix Test Flakiness in Real-World Projects
di: Chen, Yang, et al.
Pubblicazione: (2024)

Testing the Untestable? An Empirical Study on the Testing Process of LLM-Powered Software Systems
di: Magalhaes, Cleyton, et al.
Pubblicazione: (2025)

Automated Test Validators for Flaky Cyber-Physical System Simulators: Approach and Evaluation
di: Jodat, Baharin A., et al.
Pubblicazione: (2025)

How Does Cognitive Capability and Personality Influence Problem Solving in Coding Interview Puzzles?
di: Hidellaarachchi, Dulaji, et al.
Pubblicazione: (2025)

FlakyGuard: Automatically Fixing Flaky Tests at Industry Scale
di: Li, Chengpeng, et al.
Pubblicazione: (2025)

Are Coding Agents Generating Over-Mocked Tests? An Empirical Study
di: Hora, Andre, et al.
Pubblicazione: (2026)

Understanding Self-Admitted Technical Debt in Test Code: An Empirical Study
di: Nakamura, Ibuki, et al.
Pubblicazione: (2025)

Information-Theoretic Detection of Unusual Source Code Changes
di: Torres, Adriano, et al.
Pubblicazione: (2025)

The Influence of Code Comments on the Perceived Helpfulness of Stack Overflow Posts
di: Figl, Kathrin, et al.
Pubblicazione: (2025)

WEFix: Intelligent Automatic Generation of Explicit Waits for Efficient Web End-to-End Flaky Tests
di: Liu, Xinyue, et al.
Pubblicazione: (2024)

UX Debt: Developers Borrow While Users Pay
di: Baltes, Sebastian, et al.
Pubblicazione: (2021)

A Multifaceted View on Discrimination in Software Development Careers
di: Chakraborty, Shalini, et al.
Pubblicazione: (2025)

Lost in Transition: The Struggle of Women Returning to Software Engineering Research after Career Breaks
di: Chakraborty, Shalini, et al.
Pubblicazione: (2025)

Teaching Literature Reviewing for Software Engineering Research
di: Baltes, Sebastian, et al.
Pubblicazione: (2024)

Scaling Test-Driven Code Generation from Functions to Classes: An Empirical Study
di: Liang, Yunhao, et al.
Pubblicazione: (2026)