Quality Assurance for LLM-RAG Systems: Empirical Insights from Tourism Application Testing
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | Ahmed, Bestoun S., Baader, Ludwig Otto, Bayram, Firas, Jagstedt, Siri, Magnusson, Peter |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
Documents similaires
Adaptive Data Quality Scoring Operations Framework using Drift-Aware Mechanism for Industrial Applications
par: Bayram, Firas, et autres
Publié: (2024)
par: Bayram, Firas, et autres
Publié: (2024)
What Makes a Great Software Quality Assurance Engineer?
par: Farias, Roselane Silva, et autres
Publié: (2024)
par: Farias, Roselane Silva, et autres
Publié: (2024)
The Rise of Agentic Testing: Multi-Agent Systems for Robust Software Quality Assurance
par: Naqvi, Saba, et autres
Publié: (2026)
par: Naqvi, Saba, et autres
Publié: (2026)
Rethinking Code Review Workflows with LLM Assistance: An Empirical Study
par: Aðalsteinsson, Fannar Steinn, et autres
Publié: (2025)
par: Aðalsteinsson, Fannar Steinn, et autres
Publié: (2025)
Quality Assurance Practices in Agile Methodology
par: Wakili, Almustapha A., et autres
Publié: (2024)
par: Wakili, Almustapha A., et autres
Publié: (2024)
Testing the Untestable? An Empirical Study on the Testing Process of LLM-Powered Software Systems
par: Magalhaes, Cleyton, et autres
Publié: (2025)
par: Magalhaes, Cleyton, et autres
Publié: (2025)
Architecting Data-Intensive Applications : From Data Architecture Design to Its Quality Assurance
par: Abughazala, Moamin
Publié: (2024)
par: Abughazala, Moamin
Publié: (2024)
Quality Assurance of LLM-generated Code: Addressing Non-Functional Quality Characteristics
par: Sun, Xin, et autres
Publié: (2025)
par: Sun, Xin, et autres
Publié: (2025)
SmartDelta Methodology: Automated Quality Assurance and Optimization for Incremental System Engineering
par: Dornauer, Benedikt, et autres
Publié: (2025)
par: Dornauer, Benedikt, et autres
Publié: (2025)
Embedding Quality Assurance in project-based learning
par: Spichkova, Maria
Publié: (2025)
par: Spichkova, Maria
Publié: (2025)
Leveraging LLMs for the Quality Assurance of Software Requirements
par: Lubos, Sebastian, et autres
Publié: (2024)
par: Lubos, Sebastian, et autres
Publié: (2024)
A Multi-Layer Testing Framework for Automated Data Quality Assurance in Cloud-Native ELT Pipelines
par: Gargouri, Ismail, et autres
Publié: (2026)
par: Gargouri, Ismail, et autres
Publié: (2026)
Model Based System Assurance Using the Structured Assurance Case Metamodel
par: Wei, Ran, et autres
Publié: (2019)
par: Wei, Ran, et autres
Publié: (2019)
Proceedings of the First International Workshop on Autonomous Systems Quality Assurance and Prediction with Digital Twins
par: Chechik, Marsha, et autres
Publié: (2025)
par: Chechik, Marsha, et autres
Publié: (2025)
Continuous Observability Assurance in Cloud-Native Applications
par: Borges, Maria C., et autres
Publié: (2025)
par: Borges, Maria C., et autres
Publié: (2025)
LLM-Based Robustness Testing of Microservice Applications: An Empirical Study
par: Tigulla, Hrushitha Goud, et autres
Publié: (2026)
par: Tigulla, Hrushitha Goud, et autres
Publié: (2026)
Testing with AI Agents: An Empirical Study of Test Generation Frequency, Quality, and Coverage
par: Yoshimoto, Suzuka, et autres
Publié: (2026)
par: Yoshimoto, Suzuka, et autres
Publié: (2026)
VibeContract: The Missing Quality Assurance Piece in Vibe Coding
par: Wang, Song
Publié: (2026)
par: Wang, Song
Publié: (2026)
Understanding API Usage and Testing: An Empirical Study of C Libraries
par: Zaki, Ahmed, et autres
Publié: (2025)
par: Zaki, Ahmed, et autres
Publié: (2025)
Towards Agentic Test-Driven Quality Assurance for 6G Networks
par: Tranoris, Christos, et autres
Publié: (2026)
par: Tranoris, Christos, et autres
Publié: (2026)
An Empirical Study on Challenges for LLM Application Developers
par: Chen, Xiang, et autres
Publié: (2024)
par: Chen, Xiang, et autres
Publié: (2024)
Empirical Insights of Test Selection Metrics under Multiple Testing Objectives and Distribution Shifts
par: Zhang, Jingyu, et autres
Publié: (2026)
par: Zhang, Jingyu, et autres
Publié: (2026)
ToolFuzz -- Automated Agent Tool Testing
par: Milev, Ivan, et autres
Publié: (2025)
par: Milev, Ivan, et autres
Publié: (2025)
Towards a Robust Quality Assurance Framework for Cloud Computing Environments
par: Alharbi, Mohammed, et autres
Publié: (2025)
par: Alharbi, Mohammed, et autres
Publié: (2025)
AI Assurance: A Comprehensive Testing Strategy for Enterprise AI Systems
par: Badagi, Chitra, et autres
Publié: (2026)
par: Badagi, Chitra, et autres
Publié: (2026)
WALL: A Web Application for Automated Quality Assurance using Large Language Models
par: Abtahi, Seyed Moein, et autres
Publié: (2025)
par: Abtahi, Seyed Moein, et autres
Publié: (2025)
"Good" and "Bad" Failures in Industrial CI/CD -- Balancing Cost and Quality Assurance
par: Sun, Simin, et autres
Publié: (2025)
par: Sun, Simin, et autres
Publié: (2025)
An Empirical Evaluation of LLM-Based Approaches for Code Vulnerability Detection: RAG, SFT, and Dual-Agent Systems
par: Saju, Md Hasan, et autres
Publié: (2026)
par: Saju, Md Hasan, et autres
Publié: (2026)
State-Of-The-Practice in Quality Assurance in Java-Based Open Source Software Development
par: Khatami, Ali, et autres
Publié: (2023)
par: Khatami, Ali, et autres
Publié: (2023)
Can We Classify Flaky Tests Using Only Test Code? An LLM-Based Empirical Study
par: Berndt, Alexander, et autres
Publié: (2026)
par: Berndt, Alexander, et autres
Publié: (2026)
ACCESS: Assurance Case Centric Engineering of Safety-critical Systems
par: Wei, Ran, et autres
Publié: (2024)
par: Wei, Ran, et autres
Publié: (2024)
Beyond ChatGPT: Enhancing Software Quality Assurance Tasks with Diverse LLMs and Validation Techniques
par: Widyasari, Ratnadira, et autres
Publié: (2024)
par: Widyasari, Ratnadira, et autres
Publié: (2024)
An Empirical Study on the Impact of Gender Diversity on Code Quality in AI Systems
par: Cynthia, Shamse Tasnim, et autres
Publié: (2025)
par: Cynthia, Shamse Tasnim, et autres
Publié: (2025)
LLM-Based Test-Driven Interactive Code Generation: User Study and Empirical Evaluation
par: Fakhoury, Sarah, et autres
Publié: (2024)
par: Fakhoury, Sarah, et autres
Publié: (2024)
Towards Trustworthy Machine Learning in Production: An Overview of the Robustness in MLOps Approach
par: Bayram, Firas, et autres
Publié: (2024)
par: Bayram, Firas, et autres
Publié: (2024)
Systemic Flakiness: An Empirical Analysis of Co-Occurring Flaky Test Failures
par: Parry, Owain, et autres
Publié: (2025)
par: Parry, Owain, et autres
Publié: (2025)
An Empirical Study of Testing Practices in Open Source AI Agent Frameworks and Agentic Applications
par: Hasan, Mohammed Mehedi, et autres
Publié: (2025)
par: Hasan, Mohammed Mehedi, et autres
Publié: (2025)
Causal Reasoning in Software Quality Assurance: A Systematic Review
par: Giamattei, Luca, et autres
Publié: (2024)
par: Giamattei, Luca, et autres
Publié: (2024)
A Scalable Framework for Safety Assurance of Self-Driving Vehicles based on Assurance 2.0
par: Chen, Shufeng, et autres
Publié: (2025)
par: Chen, Shufeng, et autres
Publié: (2025)
Empirical Derivations from an Evolving Test Suite
par: Ruohonen, Jukka, et autres
Publié: (2025)
par: Ruohonen, Jukka, et autres
Publié: (2025)
Documents similaires
-
Adaptive Data Quality Scoring Operations Framework using Drift-Aware Mechanism for Industrial Applications
par: Bayram, Firas, et autres
Publié: (2024) -
What Makes a Great Software Quality Assurance Engineer?
par: Farias, Roselane Silva, et autres
Publié: (2024) -
The Rise of Agentic Testing: Multi-Agent Systems for Robust Software Quality Assurance
par: Naqvi, Saba, et autres
Publié: (2026) -
Rethinking Code Review Workflows with LLM Assistance: An Empirical Study
par: Aðalsteinsson, Fannar Steinn, et autres
Publié: (2025) -
Quality Assurance Practices in Agile Methodology
par: Wakili, Almustapha A., et autres
Publié: (2024)