Comparing Open-Source and Commercial LLMs for Domain-Specific Analysis and Reporting: Software Engineering Challenges and Design Trade-offs
Fuente:
arXiv
Saved in:
| Main Authors: | Koraag, Theo, Wagner, Niklas, Dobslaw, Felix, Gren, Lucas |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
The Expert Validation Framework (EVF): Enabling Domain Expert Control in AI Engineering
by: Gren, Lucas, et al.
Published: (2026)
by: Gren, Lucas, et al.
Published: (2026)
From Group Psychology to Software Engineering Research to Automotive R&D: Measuring Team Development at Volvo Cars
by: Gren, Lucas, et al.
Published: (2024)
by: Gren, Lucas, et al.
Published: (2024)
The Social Psychology of Software Security (Psycurity)
by: Gren, Lucas, et al.
Published: (2024)
by: Gren, Lucas, et al.
Published: (2024)
Prototypical Leadership in Agile Software Development
by: Dawood, Jina, et al.
Published: (2024)
by: Dawood, Jina, et al.
Published: (2024)
Cross-Functional AI Task Forces (X-FAITs) for AI Transformation of Software Organizations
by: Gren, Lucas, et al.
Published: (2025)
by: Gren, Lucas, et al.
Published: (2025)
Challenges in Testing Large Language Model Based Software: A Faceted Taxonomy
by: Dobslaw, Felix, et al.
Published: (2025)
by: Dobslaw, Felix, et al.
Published: (2025)
Automatic techniques for issue report classification: A systematic mapping study
by: Laiq, Muhammad, et al.
Published: (2025)
by: Laiq, Muhammad, et al.
Published: (2025)
Investigating team maturity in an agile automotive reorganization
by: Gren, Lucas, et al.
Published: (2024)
by: Gren, Lucas, et al.
Published: (2024)
Systematic Literature Review of Commercial Participation in Open Source Software
by: Li, Xuetao, et al.
Published: (2024)
by: Li, Xuetao, et al.
Published: (2024)
Understanding on the Edge: LLM-generated Boundary Test Explanations
by: Akbarova, Sabinakhon, et al.
Published: (2026)
by: Akbarova, Sabinakhon, et al.
Published: (2026)
A Method to Assess and Argue for Practical Significance in Software Engineering
by: Torkar, Richard, et al.
Published: (2018)
by: Torkar, Richard, et al.
Published: (2018)
Context Engineering for AI Agents in Open-Source Software
by: Mohsenimofidi, Seyedmoein, et al.
Published: (2025)
by: Mohsenimofidi, Seyedmoein, et al.
Published: (2025)
Don't Disturb Me: Challenges of Interacting with SoftwareBots on Open Source Software Projects
by: Wessel, Mairieli, et al.
Published: (2021)
by: Wessel, Mairieli, et al.
Published: (2021)
Exploring Individual Factors in the Adoption of LLMs for Specific Software Engineering Purposes
by: Lambiase, Stefano, et al.
Published: (2025)
by: Lambiase, Stefano, et al.
Published: (2025)
SETBVE: Quality-Diversity Driven Exploration of Software Boundary Behaviors
by: Akbarova, Sabinakhon, et al.
Published: (2025)
by: Akbarova, Sabinakhon, et al.
Published: (2025)
An Overview and Catalogue of Dependency Challenges in Open Source Software Package Registries
by: Mens, Tom, et al.
Published: (2024)
by: Mens, Tom, et al.
Published: (2024)
SEMODS: A Validated Dataset of Open-Source Software Engineering Models
by: González, Alexandra, et al.
Published: (2026)
by: González, Alexandra, et al.
Published: (2026)
LLMs in Coding and their Impact on the Commercial Software Engineering Landscape
by: Belozerov, Vladislav, et al.
Published: (2025)
by: Belozerov, Vladislav, et al.
Published: (2025)
Building Collaborative Learning: Exploring Social Annotation in Introductory Programming
by: Neto, Francisco Gomes de Oliveira, et al.
Published: (2024)
by: Neto, Francisco Gomes de Oliveira, et al.
Published: (2024)
Privacy by Design: Aligning GDPR and Software Engineering Specifications with a Requirements Engineering Approach
by: Kosenkov, Oleksandr, et al.
Published: (2025)
by: Kosenkov, Oleksandr, et al.
Published: (2025)
Fairness Across Fields: Comparing Software Engineering and Human Sciences Perspectives
by: Valenca, Lucas, et al.
Published: (2026)
by: Valenca, Lucas, et al.
Published: (2026)
Open Source Software Development Tool Installation: Challenges and Strategies For Novice Developers
by: Salerno, Larissa, et al.
Published: (2024)
by: Salerno, Larissa, et al.
Published: (2024)
Automated Extraction and Analysis of Developer's Rationale in Open Source Software
by: Dhaouadi, Mouna, et al.
Published: (2025)
by: Dhaouadi, Mouna, et al.
Published: (2025)
Demystifying Feature Requests: Leveraging LLMs to Refine Feature Requests in Open-Source Software
by: KC, Pragyan, et al.
Published: (2025)
by: KC, Pragyan, et al.
Published: (2025)
Building Software Engineering Capacity through a University Open Source Program Office
by: Holdener, Ekaterina, et al.
Published: (2024)
by: Holdener, Ekaterina, et al.
Published: (2024)
On Categorizing Open Source Software Security Vulnerability Reporting Mechanisms on GitHub
by: Kancharoendee, Sushawapak, et al.
Published: (2025)
by: Kancharoendee, Sushawapak, et al.
Published: (2025)
Automated Extract Method Refactoring with Open-Source LLMs: A Comparative Study
by: Chand, Sivajeet, et al.
Published: (2025)
by: Chand, Sivajeet, et al.
Published: (2025)
Measuring Software Development Waste in Open-Source Software Projects
by: Varanasi, Dhiraj SM, et al.
Published: (2024)
by: Varanasi, Dhiraj SM, et al.
Published: (2024)
Measuring Software Innovation with Open Source Software Development Data
by: Brown, Eva Maxfield, et al.
Published: (2024)
by: Brown, Eva Maxfield, et al.
Published: (2024)
An Integrated Open Source Software System for the Generation and Analysis of Subject-Specific Blood Flow Simulation Ensembles
by: Leistikow, Simon, et al.
Published: (2025)
by: Leistikow, Simon, et al.
Published: (2025)
Software Engineering as a Domain to Formalize
by: Meyer, Bertrand
Published: (2025)
by: Meyer, Bertrand
Published: (2025)
Understanding Underrepresented Groups in Open Source Software
by: Santos, Reydne, et al.
Published: (2025)
by: Santos, Reydne, et al.
Published: (2025)
Extension Decisions in Open Source Software Ecosystem
by: Onagh, Elmira, et al.
Published: (2025)
by: Onagh, Elmira, et al.
Published: (2025)
Artificial Intelligence in Open Source Software Engineering: A Foundation for Sustainability
by: Karim, S M Rakib UI, et al.
Published: (2026)
by: Karim, S M Rakib UI, et al.
Published: (2026)
Crossover Designs in Software Engineering Experiments: Review of the State of Analysis
by: Frattini, Julian, et al.
Published: (2024)
by: Frattini, Julian, et al.
Published: (2024)
An Analysis of Malicious Packages in Open-Source Software in the Wild
by: Zhou, Xiaoyan, et al.
Published: (2024)
by: Zhou, Xiaoyan, et al.
Published: (2024)
Accountability in Open Source Software Ecosystems: Workshop Report
by: Sharma, Nandini, et al.
Published: (2026)
by: Sharma, Nandini, et al.
Published: (2026)
Guiding Effort Allocation in Open-Source Software Projects Using Bus Factor Analysis
by: Lisan, Aliza, et al.
Published: (2024)
by: Lisan, Aliza, et al.
Published: (2024)
Community Engagement and the Lifespan of Open-Source Software Projects
by: Kaushik, Mohit, et al.
Published: (2025)
by: Kaushik, Mohit, et al.
Published: (2025)
Dataset: Copy-based Reuse in Open Source Software
by: Jahanshahi, Mahmoud, et al.
Published: (2023)
by: Jahanshahi, Mahmoud, et al.
Published: (2023)
Similar Items
-
The Expert Validation Framework (EVF): Enabling Domain Expert Control in AI Engineering
by: Gren, Lucas, et al.
Published: (2026) -
From Group Psychology to Software Engineering Research to Automotive R&D: Measuring Team Development at Volvo Cars
by: Gren, Lucas, et al.
Published: (2024) -
The Social Psychology of Software Security (Psycurity)
by: Gren, Lucas, et al.
Published: (2024) -
Prototypical Leadership in Agile Software Development
by: Dawood, Jina, et al.
Published: (2024) -
Cross-Functional AI Task Forces (X-FAITs) for AI Transformation of Software Organizations
by: Gren, Lucas, et al.
Published: (2025)