The State of Documentation Practices of Third-party Machine Learning Models and Datasets
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2023
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866916292528701440 |
|---|---|
| author | Oreamuno, Ernesto Lang Khan, Rohan Faiyaz Bangash, Abdul Ali Stinson, Catherine Adams, Bram |
| author_facet | Oreamuno, Ernesto Lang Khan, Rohan Faiyaz Bangash, Abdul Ali Stinson, Catherine Adams, Bram |
| contents | Model stores offer third-party ML models and datasets for easy project integration, minimizing coding efforts. One might hope to find detailed specifications of these models and datasets in the documentation, leveraging documentation standards such as model and dataset cards. In this study, we use statistical analysis and hybrid card sorting to assess the state of the practice of documenting model cards and dataset cards in one of the largest model stores in use today--Hugging Face (HF). Our findings show that only 21,902 models (39.62\%) and 1,925 datasets (28.48\%) have documentation. Furthermore, we observe inconsistency in ethics and transparency-related documentation for ML models and datasets. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2312_15058 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | The State of Documentation Practices of Third-party Machine Learning Models and Datasets Oreamuno, Ernesto Lang Khan, Rohan Faiyaz Bangash, Abdul Ali Stinson, Catherine Adams, Bram Software Engineering Machine Learning Model stores offer third-party ML models and datasets for easy project integration, minimizing coding efforts. One might hope to find detailed specifications of these models and datasets in the documentation, leveraging documentation standards such as model and dataset cards. In this study, we use statistical analysis and hybrid card sorting to assess the state of the practice of documenting model cards and dataset cards in one of the largest model stores in use today--Hugging Face (HF). Our findings show that only 21,902 models (39.62\%) and 1,925 datasets (28.48\%) have documentation. Furthermore, we observe inconsistency in ethics and transparency-related documentation for ML models and datasets. |
| title | The State of Documentation Practices of Third-party Machine Learning Models and Datasets |
| topic | Software Engineering Machine Learning |
| url | https://arxiv.org/abs/2312.15058 |