Evaluation and Continual Improvement for an Enterprise AI Assistant
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917862197690368 |
|---|---|
| author | Maharaj, Akash V. Qian, Kun Bhattacharya, Uttaran Fang, Sally Galatanu, Horia Garg, Manas Hanessian, Rachel Kapoor, Nishant Russell, Ken Vaithyanathan, Shivakumar Li, Yunyao |
| author_facet | Maharaj, Akash V. Qian, Kun Bhattacharya, Uttaran Fang, Sally Galatanu, Horia Garg, Manas Hanessian, Rachel Kapoor, Nishant Russell, Ken Vaithyanathan, Shivakumar Li, Yunyao |
| contents | The development of conversational AI assistants is an iterative process with multiple components. As such, the evaluation and continual improvement of these assistants is a complex and multifaceted problem. This paper introduces the challenges in evaluating and improving a generative AI assistant for enterprises, which is under active development, and how we address these challenges. We also share preliminary results and discuss lessons learned. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_12003 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Evaluation and Continual Improvement for an Enterprise AI Assistant Maharaj, Akash V. Qian, Kun Bhattacharya, Uttaran Fang, Sally Galatanu, Horia Garg, Manas Hanessian, Rachel Kapoor, Nishant Russell, Ken Vaithyanathan, Shivakumar Li, Yunyao Human-Computer Interaction The development of conversational AI assistants is an iterative process with multiple components. As such, the evaluation and continual improvement of these assistants is a complex and multifaceted problem. This paper introduces the challenges in evaluating and improving a generative AI assistant for enterprises, which is under active development, and how we address these challenges. We also share preliminary results and discuss lessons learned. |
| title | Evaluation and Continual Improvement for an Enterprise AI Assistant |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2407.12003 |