What is Reproducibility in Artificial Intelligence and Machine Learning Research?
Fuente:
arXiv
Salvato in:
| Autori principali: | , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909556510031872 |
|---|---|
| author | Desai, Abhyuday Abdelhamid, Mohamed Padalkar, Nakul R. |
| author_facet | Desai, Abhyuday Abdelhamid, Mohamed Padalkar, Nakul R. |
| contents | In the rapidly evolving fields of Artificial Intelligence (AI) and Machine Learning (ML), the reproducibility crisis underscores the urgent need for clear validation methodologies to maintain scientific integrity and encourage advancement. The crisis is compounded by the prevalent confusion over validation terminology. In response to this challenge, we introduce a framework that clarifies the roles and definitions of key validation efforts: repeatability, dependent and independent reproducibility, and direct and conceptual replicability. This structured framework aims to provide AI/ML researchers with the necessary clarity on these essential concepts, facilitating the appropriate design, conduct, and interpretation of validation studies. By articulating the nuances and specific roles of each type of validation study, we aim to enhance the reliability and trustworthiness of research findings and support the community's efforts to address reproducibility challenges effectively. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_10239 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | What is Reproducibility in Artificial Intelligence and Machine Learning Research? Desai, Abhyuday Abdelhamid, Mohamed Padalkar, Nakul R. Computers and Society Artificial Intelligence Machine Learning I.2.m In the rapidly evolving fields of Artificial Intelligence (AI) and Machine Learning (ML), the reproducibility crisis underscores the urgent need for clear validation methodologies to maintain scientific integrity and encourage advancement. The crisis is compounded by the prevalent confusion over validation terminology. In response to this challenge, we introduce a framework that clarifies the roles and definitions of key validation efforts: repeatability, dependent and independent reproducibility, and direct and conceptual replicability. This structured framework aims to provide AI/ML researchers with the necessary clarity on these essential concepts, facilitating the appropriate design, conduct, and interpretation of validation studies. By articulating the nuances and specific roles of each type of validation study, we aim to enhance the reliability and trustworthiness of research findings and support the community's efforts to address reproducibility challenges effectively. |
| title | What is Reproducibility in Artificial Intelligence and Machine Learning Research? |
| topic | Computers and Society Artificial Intelligence Machine Learning I.2.m |
| url | https://arxiv.org/abs/2407.10239 |