Assessing Task-based Chatbots: Snapshot and Curated Datasets for Dialogflow
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866910002497716224 |
|---|---|
| author | Masserini, Elena Clerissi, Diego Micucci, Daniela Mariani, Leonardo |
| author_facet | Masserini, Elena Clerissi, Diego Micucci, Daniela Mariani, Leonardo |
| contents | In recent years, chatbots have gained widespread adoption thanks to their ability to assist users at any time and across diverse domains. However, the lack of large-scale curated datasets limits research on their quality and reliability. This paper presents TOFU-D, a snapshot of 1,788 Dialogflow chatbots from GitHub, and COD, a curated subset of TOFU-D including 185 validated chatbots. The two datasets capture a wide range of domains, languages, and implementation patterns, offering a sound basis for empirical studies on chatbot quality and security. A preliminary assessment using the Botium testing framework and the Bandit static analyzer revealed gaps in test coverage and frequent security vulnerabilities in several chatbots, highlighting the need for systematic, multi-Platform research on chatbot quality and security. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_19787 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Assessing Task-based Chatbots: Snapshot and Curated Datasets for Dialogflow Masserini, Elena Clerissi, Diego Micucci, Daniela Mariani, Leonardo Software Engineering In recent years, chatbots have gained widespread adoption thanks to their ability to assist users at any time and across diverse domains. However, the lack of large-scale curated datasets limits research on their quality and reliability. This paper presents TOFU-D, a snapshot of 1,788 Dialogflow chatbots from GitHub, and COD, a curated subset of TOFU-D including 185 validated chatbots. The two datasets capture a wide range of domains, languages, and implementation patterns, offering a sound basis for empirical studies on chatbot quality and security. A preliminary assessment using the Botium testing framework and the Bandit static analyzer revealed gaps in test coverage and frequent security vulnerabilities in several chatbots, highlighting the need for systematic, multi-Platform research on chatbot quality and security. |
| title | Assessing Task-based Chatbots: Snapshot and Curated Datasets for Dialogflow |
| topic | Software Engineering |
| url | https://arxiv.org/abs/2601.19787 |