Cover Image

Can GPT-4 Replicate Empirical Software Engineering Research?

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Liang, Jenny T., Badea, Carmen, Bird, Christian, DeLine, Robert, Ford, Denae, Forsgren, Nicole, Zimmermann, Thomas
Format:	Preprint
Published:	2023
Subjects:	Software Engineering Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

GEMS: Generative Expert Metric System through Iterative Prompt Priming
by: Cheng, Ti-Chung, et al.
Published: (2024)

AI Where It Matters: Where, Why, and How Developers Want AI Support in Daily Work
by: Choudhuri, Rudrajit, et al.
Published: (2025)

Investigating and Designing for Trust in AI-powered Code Generation Tools
by: Wang, Ruotong, et al.
Published: (2023)

To Copilot and Beyond: 22 AI Systems Developers Want Built
by: Choudhuri, Rudrajit, et al.
Published: (2026)

"Maybe We Need Some More Examples:" Individual and Team Drivers of Developer GenAI Tool Use
by: Miller, Courtney, et al.
Published: (2025)

Bayesian Data Analysis in Empirical Software Engineering Research
by: Furia, Carlo A., et al.
Published: (2018)

Future of Software Engineering Research: The SIGSOFT Perspective
by: Di Penta, Massimiliano, et al.
Published: (2026)

Exploring the Garden of Forking Paths in Empirical Software Engineering Research: A Multiverse Analysis
by: Cassee, Nathan, et al.
Published: (2025)

Beyond the Comfort Zone: Emerging Solutions to Overcome Challenges in Integrating LLMs into Software Products
by: Nahar, Nadia, et al.
Published: (2024)

Integrating Positionality Statements in Empirical Software Engineering Research
by: de Sousa, Breno Felix, et al.
Published: (2024)

Prompting in the Wild: An Empirical Study of Prompt Evolution in Software Repositories
by: Tafreshipour, Mahan, et al.
Published: (2024)

Teaching Empirical Research Methods in Software Engineering: An Editorial Introduction
by: Mendez, Daniel, et al.
Published: (2025)

Teaching Simulation as a Research Method in Empirical Software Engineering
by: de França, Breno Bernard Nicolau, et al.
Published: (2025)

Do Research Software Engineers and Software Engineering Researchers Speak the Same Language?
by: Kehrer, Timo, et al.
Published: (2025)

Replications, Revisions, and Reanalyses: Managing Variance Theories in Software Engineering
by: Frattini, Julian, et al.
Published: (2024)

Software Engineering Podcasts: An Empirical Study of Their Potential as a Research Resource
by: Wyrich, Marvin, et al.
Published: (2026)

LLM-Assisted Empirical Software Engineering: Systematic Literature Review and Research Agenda
by: Gomes, Victoria, et al.
Published: (2026)

An Empirical Study on Decision-Making Aspects in Responsible Software Engineering for AI
by: Rani, Lekshmi Murali, et al.
Published: (2025)

An Empirical Investigation of the Experiences of Dyslexic Software Engineers
by: Cruz, Marcos Vinicius, et al.
Published: (2025)

Oops!... I did it again. Conclusion (In-)Stability in Quantitative Empirical Software Engineering: A Large-Scale Analysis
by: Hoess, Nicole, et al.
Published: (2025)

An Empirical Study of Generative AI Adoption in Software Engineering
by: Giray, Görkem, et al.
Published: (2025)

Mitigating Omitted Variable Bias in Empirical Software Engineering
by: Furia, Carlo A., et al.
Published: (2025)

An Empirical Study of Speculative Decoding on Software Engineering Tasks
by: Li, Yijia, et al.
Published: (2026)

Towards Causal Analysis of Empirical Software Engineering Data: The Impact of Programming Languages on Coding Competitions
by: Furia, Carlo A., et al.
Published: (2023)

Empirical and Sustainability Aspects of Software Engineering Research in the Era of Large Language Models: A Reflection
by: Williams, David, et al.
Published: (2025)

How do Software Engineering Researchers Use GitHub? An Empirical Study of Artifacts & Impact
by: Alrashedy, Kamel, et al.
Published: (2023)

Agentic AI in the Software Development Lifecycle: Architecture, Empirical Evidence, and the Reshaping of Software Engineering
by: Bhati, Happy
Published: (2026)

Designing a Syllabus for a Course on Empirical Software Engineering
by: Avgeriou, Paris, et al.
Published: (2025)

Applying Bayesian Analysis Guidelines to Empirical Software Engineering Data: The Case of Programming Languages and Code Quality
by: Furia, Carlo A., et al.
Published: (2021)

Qualitative Research Methods in Software Engineering: Past, Present, and Future
by: Seaman, Carolyn, et al.
Published: (2025)

Semantic Reverse Engineering Legacy Software Applications with ChatGPT, Gemini AI, and Claude AI
by: Mancas, Christian, et al.
Published: (2026)

Empirical Studies on Adversarial Reverse Engineering with Students
by: Tab, et al.
Published: (2026)

Can LLMs Replace Human Evaluators? An Empirical Study of LLM-as-a-Judge in Software Engineering
by: Wang, Ruiqi, et al.
Published: (2025)

On the Replicability and Reproducibility of Deep Learning in Software Engineering
by: Liu, Chao, et al.
Published: (2020)

Hidden Figures in Software Engineering: A Replication Study Exploring Undergraduate Software Students' Awareness of Distinguished Scientists from Underrepresented Groups
by: Santos, Ronnie de Souza, et al.
Published: (2024)

Notes On Writing Effective Empirical Software Engineering Papers: An Opinionated Primer
by: Verdecchia, Roberto, et al.
Published: (2025)

Guidelines for Empirical Studies in Software Engineering involving Large Language Models
by: Baltes, Sebastian, et al.
Published: (2025)

Empirical Studies on Quantum Optimization for Software Engineering: A Systematic Analysis
by: Zhang, Man, et al.
Published: (2025)

Quantum Software Engineering and Potential of Quantum Computing in Software Engineering Research: A Review
by: Mandal, Ashis Kumar, et al.
Published: (2025)

Peer Code Review in Research Software Development: The Research Software Engineer Perspective
by: Malik, Md Ariful Islam, et al.
Published: (2025)