Cover Image

A Metamorphic Testing Approach to Diagnosing Memorization in LLM-Based Program Repair

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	De Koning, Milan, Asgari, Ali, Derakhshanfar, Pouria, Panichella, Annibale
Format:	Preprint
Published:	2026
Subjects:	Software Engineering Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Metamorphic Testing of Deep Code Models: A Systematic Literature Review
by: Asgari, Ali, et al.
Published: (2025)

Test Wars: A Comparative Study of SBST, Symbolic Execution, and LLM-Based Approaches to Unit Test Generation
by: Abdullin, Azat, et al.
Published: (2025)

What Challenges Do Developers Face in AI Agent Systems? An Empirical Study on Stack Overflow & GitHub Issues
by: Asgari, Ali, et al.
Published: (2025)

TestSpark: IntelliJ IDEA's Ultimate Test Generation Companion
by: Sapozhnikov, Arkadii, et al.
Published: (2024)

Evolutionary Generative Fuzzing for Differential Testing of the Kotlin Compiler
by: Georgescu, Calin, et al.
Published: (2024)

Automated Test-Case Generation for REST APIs Using Model Inference Search Heuristic
by: Cao, Clinton, et al.
Published: (2024)

The Last Dependency Crusade: Solving Python Dependency Conflicts with LLMs
by: Bartlett, Antony, et al.
Published: (2025)

Validating LLM-Generated Programs with Metamorphic Prompt Testing
by: Wang, Xiaoyin, et al.
Published: (2024)

SBFT Tool Competition 2024 -- Python Test Case Generation Track
by: Erni, Nicolas, et al.
Published: (2024)

RepairAgent: An Autonomous, LLM-Based Agent for Program Repair
by: Bouzenia, Islem, et al.
Published: (2024)

Evaluating Human Trajectory Prediction with Metamorphic Testing
by: Spieker, Helge, et al.
Published: (2024)

On the Role of Fault Localization Context for LLM-Based Program Repair
by: Sepidband, Melika, et al.
Published: (2026)

ASSURE: Metamorphic Testing for AI-powered Browser Extensions
by: Gao, Xuanqi, et al.
Published: (2025)

Metamorphic Testing of Large Language Models for Natural Language Processing
by: Cho, Steven, et al.
Published: (2025)

LLM Test Generation via Iterative Hybrid Program Analysis
by: Gu, Sijia, et al.
Published: (2025)

Dynamic Cogeneration of Bug Reproduction Test in Agentic Program Repair
by: Cheng, Runxiang, et al.
Published: (2026)

MR-Coupler: Automated Metamorphic Test Generation via Functional Coupling Analysis
by: Xu, Congying, et al.
Published: (2026)

Towards Reliable Evaluation of Neural Program Repair with Natural Robustness Testing
by: Le-Cong, Thanh, et al.
Published: (2024)

Exploring and Lifting the Robustness of LLM-powered Automated Program Repair with Metamorphic Testing
by: Xue, Pengyu, et al.
Published: (2024)

Collaborative Agents for Automated Program Repair in Ruby
by: Akbarpour, Nikta, et al.
Published: (2025)

Multi-Agent Specification-based Metamorphic Testing of FMU-Based Simulations
by: Kulshreshtha, Ashir, et al.
Published: (2026)

Static Program Analysis Guided LLM Based Unit Test Generation
by: Roychowdhury, Sujoy, et al.
Published: (2025)

Adaptive Testing for LLM-Based Applications: A Diversity-based Approach
by: Yoon, Juyeon, et al.
Published: (2025)

MergeRepair: An Exploratory Study on Merging Task-Specific Adapters in Code LLMs for Automated Program Repair
by: Dehghan, Meghdad, et al.
Published: (2024)

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models
by: Hyun, Sangwon, et al.
Published: (2025)

Evaluating LLM-Based Test Generation Under Software Evolution
by: Haroon, Sabaat, et al.
Published: (2026)

Repair-R1: Better Test Before Repair
by: Hu, Haichuan, et al.
Published: (2025)

Integrating Various Software Artifacts for Better LLM-based Bug Localization and Program Repair
by: Feng, Qiong, et al.
Published: (2024)

Exploring the Potential of Conversational Test Suite Based Program Repair on SWE-bench
by: Cheshkov, Anton, et al.
Published: (2024)

Breaking the Silence: the Threats of Using LLMs in Software Engineering
by: Sallou, June, et al.
Published: (2023)

Metamorphic Testing for Audio Content Moderation Software
by: Wang, Wenxuan, et al.
Published: (2025)

Effective Black Box Testing of Sentiment Analysis Classification Networks
by: Karbasizadeh, Parsa, et al.
Published: (2024)

RepoRepair: Leveraging Code Documentation for Repository-Level Automated Program Repair
by: Pan, Zhongqiang, et al.
Published: (2026)

Practical Limits of Autonomous Test Repair: A Multi-Agent Case Study with LLM-Driven Discovery and Self-Correction
by: Lee, Hyukjoo
Published: (2026)

LGMT: Logic-Grounded Metamorphic Testing for Evaluating the Reasoning Reliability of LLMs
by: Zhou, Zenghui, et al.
Published: (2026)

Enhancing Automated Program Repair with Solution Design
by: Zhao, Jiuang, et al.
Published: (2024)

Evaluating Agent-based Program Repair at Google
by: Rondon, Pat, et al.
Published: (2025)

Evaluating the Generalizability of LLMs in Automated Program Repair
by: Li, Fengjie, et al.
Published: (2025)

Metamorphic Testing for Pose Estimation Systems
by: Duran, Matias, et al.
Published: (2025)

RefExpo: Unveiling Software Project Structures through Advanced Dependency Graph Extraction
by: Haratian, Vahid, et al.
Published: (2024)