A State-of-the-practice Release-readiness Checklist for Generative AI-based Software Products
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916182112600064 |
|---|---|
| author | Patel, Harsh Boucher, Dominique Fallahzadeh, Emad Hassan, Ahmed E. Adams, Bram |
| author_facet | Patel, Harsh Boucher, Dominique Fallahzadeh, Emad Hassan, Ahmed E. Adams, Bram |
| contents | This paper investigates the complexities of integrating Large Language Models (LLMs) into software products, with a focus on the challenges encountered for determining their readiness for release. Our systematic review of grey literature identifies common challenges in deploying LLMs, ranging from pre-training and fine-tuning to user experience considerations. The study introduces a comprehensive checklist designed to guide practitioners in evaluating key release readiness aspects such as performance, monitoring, and deployment strategies, aiming to enhance the reliability and effectiveness of LLM-based applications in real-world settings. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_18958 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A State-of-the-practice Release-readiness Checklist for Generative AI-based Software Products Patel, Harsh Boucher, Dominique Fallahzadeh, Emad Hassan, Ahmed E. Adams, Bram Software Engineering Artificial Intelligence This paper investigates the complexities of integrating Large Language Models (LLMs) into software products, with a focus on the challenges encountered for determining their readiness for release. Our systematic review of grey literature identifies common challenges in deploying LLMs, ranging from pre-training and fine-tuning to user experience considerations. The study introduces a comprehensive checklist designed to guide practitioners in evaluating key release readiness aspects such as performance, monitoring, and deployment strategies, aiming to enhance the reliability and effectiveness of LLM-based applications in real-world settings. |
| title | A State-of-the-practice Release-readiness Checklist for Generative AI-based Software Products |
| topic | Software Engineering Artificial Intelligence |
| url | https://arxiv.org/abs/2403.18958 |