From Release to Adoption: Challenges in Reusing Pre-trained AI Models for Downstream Developers
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915945138618368 |
|---|---|
| author | Banyongrakkul, Peerachai Zahedi, Mansooreh Thongtanunam, Patanamon Treude, Christoph Gao, Haoyu |
| author_facet | Banyongrakkul, Peerachai Zahedi, Mansooreh Thongtanunam, Patanamon Treude, Christoph Gao, Haoyu |
| contents | Pre-trained models (PTMs) have gained widespread popularity and achieved remarkable success across various fields, driven by their groundbreaking performance and easy accessibility through hosting providers. However, the challenges faced by downstream developers in reusing PTMs in software systems are less explored. To bridge this knowledge gap, we qualitatively created and analyzed a dataset of 840 PTM-related issue reports from 31 OSS GitHub projects. We systematically developed a comprehensive taxonomy of PTM-related challenges that developers face in downstream projects. Our study identifies seven key categories of challenges that downstream developers face in reusing PTMs, such as model usage, model performance, and output quality. We also compared our findings with existing taxonomies. Additionally, we conducted a resolution time analysis and, based on statistical tests, found that PTM-related issues take significantly longer to be resolved than issues unrelated to PTMs, with significant variation across challenge categories. We discuss the implications of our findings for practitioners and possibilities for future research. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_23234 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | From Release to Adoption: Challenges in Reusing Pre-trained AI Models for Downstream Developers Banyongrakkul, Peerachai Zahedi, Mansooreh Thongtanunam, Patanamon Treude, Christoph Gao, Haoyu Software Engineering Pre-trained models (PTMs) have gained widespread popularity and achieved remarkable success across various fields, driven by their groundbreaking performance and easy accessibility through hosting providers. However, the challenges faced by downstream developers in reusing PTMs in software systems are less explored. To bridge this knowledge gap, we qualitatively created and analyzed a dataset of 840 PTM-related issue reports from 31 OSS GitHub projects. We systematically developed a comprehensive taxonomy of PTM-related challenges that developers face in downstream projects. Our study identifies seven key categories of challenges that downstream developers face in reusing PTMs, such as model usage, model performance, and output quality. We also compared our findings with existing taxonomies. Additionally, we conducted a resolution time analysis and, based on statistical tests, found that PTM-related issues take significantly longer to be resolved than issues unrelated to PTMs, with significant variation across challenge categories. We discuss the implications of our findings for practitioners and possibilities for future research. |
| title | From Release to Adoption: Challenges in Reusing Pre-trained AI Models for Downstream Developers |
| topic | Software Engineering |
| url | https://arxiv.org/abs/2506.23234 |