Evaluating the method reproducibility of deep learning models in the biodiversity domain

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Ahmed, Waqas, Kommineni, Vamsi Krishna, König-Ries, Birgitta, Gaikwad, Jitendra, Gadelha, Luiz, Samuel, Sheeba
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929416242724864
author Ahmed, Waqas
Kommineni, Vamsi Krishna
König-Ries, Birgitta
Gaikwad, Jitendra
Gadelha, Luiz
Samuel, Sheeba
author_facet Ahmed, Waqas
Kommineni, Vamsi Krishna
König-Ries, Birgitta
Gaikwad, Jitendra
Gadelha, Luiz
Samuel, Sheeba
contents Artificial Intelligence (AI) is revolutionizing biodiversity research by enabling advanced data analysis, species identification, and habitats monitoring, thereby enhancing conservation efforts. Ensuring reproducibility in AI-driven biodiversity research is crucial for fostering transparency, verifying results, and promoting the credibility of ecological findings.This study investigates the reproducibility of deep learning (DL) methods within the biodiversity domain. We design a methodology for evaluating the reproducibility of biodiversity-related publications that employ DL techniques across three stages. We define ten variables essential for method reproducibility, divided into four categories: resource requirements, methodological information, uncontrolled randomness, and statistical considerations. These categories subsequently serve as the basis for defining different levels of reproducibility. We manually extract the availability of these variables from a curated dataset comprising 61 publications identified using the keywords provided by biodiversity experts. Our study shows that the dataset is shared in 47% of the publications; however, a significant number of the publications lack comprehensive information on deep learning methods, including details regarding randomness.
format Preprint
id arxiv_https___arxiv_org_abs_2407_07550
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Evaluating the method reproducibility of deep learning models in the biodiversity domain
Ahmed, Waqas
Kommineni, Vamsi Krishna
König-Ries, Birgitta
Gaikwad, Jitendra
Gadelha, Luiz
Samuel, Sheeba
Information Retrieval
Artificial Intelligence (AI) is revolutionizing biodiversity research by enabling advanced data analysis, species identification, and habitats monitoring, thereby enhancing conservation efforts. Ensuring reproducibility in AI-driven biodiversity research is crucial for fostering transparency, verifying results, and promoting the credibility of ecological findings.This study investigates the reproducibility of deep learning (DL) methods within the biodiversity domain. We design a methodology for evaluating the reproducibility of biodiversity-related publications that employ DL techniques across three stages. We define ten variables essential for method reproducibility, divided into four categories: resource requirements, methodological information, uncontrolled randomness, and statistical considerations. These categories subsequently serve as the basis for defining different levels of reproducibility. We manually extract the availability of these variables from a curated dataset comprising 61 publications identified using the keywords provided by biodiversity experts. Our study shows that the dataset is shared in 47% of the publications; however, a significant number of the publications lack comprehensive information on deep learning methods, including details regarding randomness.
title Evaluating the method reproducibility of deep learning models in the biodiversity domain
topic Information Retrieval
url https://arxiv.org/abs/2407.07550