Cover Image

Analysis of LLMs vs Human Experts in Requirements Engineering

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Hymel, Cory, Johnson, Hiroe
Format:	Preprint
Published:	2025
Subjects:	Software Engineering Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Improving Performance of Commercially Available AI Products in a Multi-Agent Configuration
by: Hymel, Cory, et al.
Published: (2024)

The AI-Native Software Development Lifecycle: A Theoretical and Practical New Methodology
by: Hymel, Cory
Published: (2024)

From Inductive to Deductive: LLMs-Based Qualitative Data Analysis in Requirements Engineering
by: Shah, Syed Tauhid Ullah, et al.
Published: (2025)

AI-Assisted Requirements Engineering: An Empirical Evaluation Relative to Expert Judgment
by: Levy, Oz, et al.
Published: (2026)

Foundational Analysis of Safety Engineering Requirements (SAFER)
by: Chemo, Noga, et al.
Published: (2026)

Towards Requirements Engineering for RAG Systems
by: Sporsem, Tor, et al.
Published: (2025)

SEER: Sustainability Enhanced Engineering of Software Requirements
by: Roy, Mandira, et al.
Published: (2025)

Legal Requirements Analysis
by: Abualhaija, Sallam, et al.
Published: (2023)

Using LLMs in Software Requirements Specifications: An Empirical Evaluation
by: Krishna, Madhava, et al.
Published: (2024)

The Expert Validation Framework (EVF): Enabling Domain Expert Control in AI Engineering
by: Gren, Lucas, et al.
Published: (2026)

Generative AI for Requirements Engineering: A Systematic Literature Review
by: Cheng, Haowei, et al.
Published: (2024)

LogReasoner: Empowering LLMs with Expert-like Coarse-to-Fine Reasoning for Automated Log Analysis
by: Ma, Lipeng, et al.
Published: (2025)

Are LLMs Reliable Code Reviewers? Systematic Overcorrection in Requirement Conformance Judgement
by: Jin, Haolin, et al.
Published: (2026)

GPT-Powered Elicitation Interview Script Generator for Requirements Engineering Training
by: Görer, Binnur, et al.
Published: (2024)

LLMs: A Game-Changer for Software Engineers?
by: Haque, Md Asraful
Published: (2024)

Can LLMs Replace Human Evaluators? An Empirical Study of LLM-as-a-Judge in Software Engineering
by: Wang, Ruiqi, et al.
Published: (2025)

A Gray Literature Study on Fairness Requirements in AI-enabled Software Engineering
by: Nguyen, Thanh, et al.
Published: (2025)

Generative Language Models Potential for Requirement Engineering Applications: Insights into Current Strengths and Limitations
by: Saleem, Summra, et al.
Published: (2024)

LLMs for Qualitative Data Analysis Fail on Security-specificComments in Human Experiments
by: Camporese, Maria, et al.
Published: (2026)

ARLO: A Tailorable Approach for Transforming Natural Language Software Requirements into Architecture using LLMs
by: Helmi, Tooraj
Published: (2025)

Can We Make Code Green? Understanding Trade-Offs in LLMs vs. Human Code Optimizations
by: Rani, Pooja, et al.
Published: (2025)

Diverse LLMs vs. Vulnerabilities: Who Detects and Fixes Them Better?
by: Zibaeirad, Arastoo, et al.
Published: (2025)

Explicating Tacit Regulatory Knowledge from LLMs to Auto-Formalize Requirements for Compliance Test Case Generation
by: Xue, Zhiyi, et al.
Published: (2026)

Automated Non-Functional Requirements Generation in Software Engineering with Large Language Models: A Comparative Study
by: Almonte, Jomar Thomas, et al.
Published: (2025)

Synthline: A Product Line Approach for Synthetic Requirements Engineering Data Generation using Large Language Models
by: El-Hajjami, Abdelkarim, et al.
Published: (2025)

Towards Comprehensive Benchmarking Infrastructure for LLMs In Software Engineering
by: Rodriguez-Cardenas, Daniel, et al.
Published: (2026)

LLMs for Engineering: Teaching Models to Design High Powered Rockets
by: Simonds, Toby
Published: (2025)

Mapping the Trust Terrain: LLMs in Software Engineering -- Insights and Perspectives
by: Khati, Dipin, et al.
Published: (2025)

Goal2Story: A Multi-Agent Fleet based on Privately Enabled sLLMs for Impacting Mapping on Requirements Elicitation
by: Zou, Xinkai, et al.
Published: (2025)

How Mature is Requirements Engineering for AI-based Systems? A Systematic Mapping Study on Practices, Challenges, and Future Research Directions
by: Habiba, Umm-e-, et al.
Published: (2024)

Can LLMs Replace Humans During Code Chunking?
by: Glasz, Christopher, et al.
Published: (2025)

Refactoring with LLMs: Bridging Human Expertise and Machine Understanding
by: Piao, Yonnel Chen Kuang, et al.
Published: (2025)

Lifecycle-Aware code generation: Leveraging Software Engineering Phases in LLMs
by: Xing, Xing, et al.
Published: (2025)

Get on the Train or be Left on the Station: Using LLMs for Software Engineering Research
by: Trinkenreich, Bianca, et al.
Published: (2025)

GBQA: A Game Benchmark for Evaluating LLMs as Quality Assurance Engineers
by: Jiang, Shufan, et al.
Published: (2026)

Model See, Model Do? Exposure-Aware Evaluation of Bug-vs-Fix Preference in Code LLMs
by: Al-Kaswan, Ali, et al.
Published: (2026)

Can Requirements Engineering Support Explainable Artificial Intelligence? Towards a User-Centric Approach for Explainability Requirements
by: Umm-e-Habiba, et al.
Published: (2022)

Read, Extract, Classify: A Tool for Smarter Requirements Engineering
by: Bhattacharya, Paheli, et al.
Published: (2026)

PlotChain: Deterministic Checkpointed Evaluation of Multimodal LLMs on Engineering Plot Reading
by: Ravishankara, Mayank
Published: (2026)

Analysis on LLMs Performance for Code Summarization
by: Akib, Md. Ahnaf, et al.
Published: (2024)