Cover Image

An Empirical Exploration of ChatGPT's Ability to Support Problem Formulation Tasks for Mission Engineering and a Documentation of its Performance Variability

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ofsa, Max, Topcu, Taylan G.
Format:	Preprint
Published:	2025
Subjects:	Software Engineering Artificial Intelligence Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Jailbreaking ChatGPT via Prompt Engineering: An Empirical Study
by: Liu, Yi, et al.
Published: (2023)

Trust at Your Own Peril: A Mixed Methods Exploration of the Ability of Large Language Models to Generate Expert-Like Systems Engineering Artifacts and a Characterization of Failure Modes
by: Topcu, Taylan G., et al.
Published: (2025)

Assessing the Ability of ChatGPT to Screen Articles for Systematic Reviews
by: Syriani, Eugene, et al.
Published: (2023)

Exploring ChatGPT's Capabilities on Vulnerability Management
by: Liu, Peiyu, et al.
Published: (2023)

Evaluating Privacy Questions From Stack Overflow: Can ChatGPT Compete?
by: Delile, Zack, et al.
Published: (2023)

Evaluating ChatGPT-3.5 Efficiency in Solving Coding Problems of Different Complexity Levels: An Empirical Analysis
by: Li, Minda, et al.
Published: (2024)

On Repairing Quantum Programs Using ChatGPT
by: Guo, Xiaoyu, et al.
Published: (2024)

Unmasking the giant: A comprehensive evaluation of ChatGPT's proficiency in coding algorithms and data structures
by: Arefin, Sayed Erfan, et al.
Published: (2023)

An Analysis of Early-Stage Functional Safety Analysis Methods and Their Integration into Model-Based Systems Engineering
by: Shefa, Jannatul, et al.
Published: (2025)

Comprehensive Analysis of Transparency and Accessibility of ChatGPT, DeepSeek, And other SoTA Large Language Models
by: Sapkota, Ranjan, et al.
Published: (2025)

Can ChatGPT replace StackOverflow? A Study on Robustness and Reliability of Large Language Model Code Generation
by: Zhong, Li, et al.
Published: (2023)

Is Stack Overflow Obsolete? An Empirical Study of the Characteristics of ChatGPT Answers to Stack Overflow Questions
by: Kabir, Samia, et al.
Published: (2023)

Beyond Code Generation: An Observational Study of ChatGPT Usage in Software Engineering Practice
by: Khojah, Ranim, et al.
Published: (2024)

Do Prompt Patterns Affect Code Quality? A First Empirical Assessment of ChatGPT-Generated Code
by: Della Porta, Antonio, et al.
Published: (2025)

Safety Analysis in the Era of Large Language Models: A Case Study of STPA using ChatGPT
by: Qi, Yi, et al.
Published: (2023)

An Empirical Study of the Non-determinism of ChatGPT in Code Generation
by: Ouyang, Shuyin, et al.
Published: (2023)

Is ChatGPT a Good Software Librarian? An Exploratory Study on the Use of ChatGPT for Software Library Recommendations
by: Latendresse, Jasmine, et al.
Published: (2024)

Can ChatGPT Support Developers? An Empirical Evaluation of Large Language Models for Code Generation
by: Jin, Kailun, et al.
Published: (2024)

WIP: Assessing the Effectiveness of ChatGPT in Preparatory Testing Activities
by: Haldar, Susmita, et al.
Published: (2025)

Can ChatGPT support software verification?
by: Janßen, Christian, et al.
Published: (2023)

ChatGPT Incorrectness Detection in Software Reviews
by: Tanzil, Minaoar Hossain, et al.
Published: (2024)

An Empirical Study of ChatGPT-Related Projects and Their Issues on GitHub
by: Lin, Zheng, et al.
Published: (2024)

Experimental Analysis of Productive Interaction Strategy with ChatGPT: User Study on Function and Project-level Code Generation Tasks
by: Hyun, Sangwon, et al.
Published: (2025)

Exploring Zero-Shot App Review Classification with ChatGPT: Challenges and Potential
by: Chaudhary, Mohit, et al.
Published: (2025)

Which AI Technique Is Better to Classify Requirements? An Experiment with SVM, LSTM, and ChatGPT
by: El-Hajjami, Abdelkarim, et al.
Published: (2023)

WildCode: An Empirical Analysis of Code Generated by ChatGPT
by: Khanmohammadi, Kobra, et al.
Published: (2025)

Is ChatGPT 3 safe for students?
by: Kotovich, Julia, et al.
Published: (2024)

DevGPT: Studying Developer-ChatGPT Conversations
by: Xiao, Tao, et al.
Published: (2023)

Unveiling the Role of ChatGPT in Software Development: Insights from Developer-ChatGPT Interactions on GitHub
by: Li, Ruiyin, et al.
Published: (2025)

System Test Case Design from Requirements Specifications: Insights and Challenges of Using ChatGPT
by: Bhatia, Shreya, et al.
Published: (2024)

ChatGPT vs. DeepSeek: A Comparative Study on AI-Based Code Generation
by: Manik, Md Motaleb Hossen
Published: (2025)

Programming with AI: Evaluating ChatGPT, Gemini, AlphaCode, and GitHub Copilot for Programmers
by: Siam, Md Kamrul, et al.
Published: (2024)

Why Do Developers Engage with ChatGPT in Issue-Tracker? Investigating Usage and Reliance on ChatGPT-Generated Code
by: Das, Joy Krishan, et al.
Published: (2024)

Integrating Artificial Intelligence with Human Expertise: An In-depth Analysis of ChatGPT's Capabilities in Generating Metamorphic Relations
by: Zhang, Yifan, et al.
Published: (2025)

Evaluation of the Code Generation Capabilities of ChatGPT 4: A Comparative Analysis in 19 Programming Languages
by: Gilbert, L. C.
Published: (2025)

An Empirical Study on Developers Shared Conversations with ChatGPT in GitHub Pull Requests and Issues
by: Hao, Huizi, et al.
Published: (2024)

What Characteristics Make ChatGPT Effective for Software Issue Resolution? An Empirical Study of Task, Project, and Conversational Signals in GitHub Issues
by: Ehsani, Ramtin, et al.
Published: (2025)

Can GPT-4 Replicate Empirical Software Engineering Research?
by: Liang, Jenny T., et al.
Published: (2023)

Beyond ChatGPT: Enhancing Software Quality Assurance Tasks with Diverse LLMs and Validation Techniques
by: Widyasari, Ratnadira, et al.
Published: (2024)

Pros and Cons! Evaluating ChatGPT on Software Vulnerability
by: Yin, Xin
Published: (2024)