_version_ 1868266111365021696
author Morrison, Kyle
Pottier, Patrice
Pollo, Pietro
Ricolfi, Lorenzo
Williams, Coralie
Yang, Yefeng
Beillouin, Damien
Cardoso, Simone Jaqueline
Ferreira, Verónica
Gallagher, Brian
Gan, Jelaine L
Hao, Guang
Keikha, Mojtaba
Kozlowsky-Suzuki, Betina
Kiran Kumara, T M
Latterini, Francesco
Leverkus, Alexandro B
Macartney, Erin L
Manrique, Silvina Magdalena
Martinig, April Robin
Mizuno, Ayumi
Nanayakkara, Shanika
Ntzani, Evangelia
Ouédraogo, Dakis-Yaoba
Pursell, Edward
Simpson, Zachary
Sleight, Harriet
Woon, Kok Sin
Xia, Ziqian
Ghannad, Mona
Grames, Eliza
Hennessy, Emily Alden
IntHout, Joanna
Moher, David
O'Dea, Rose E
Page, Matthew J
Whaley, Paul
Lagisz, Malgorzata
Nakagawa, Shinichi
author_facet Morrison, Kyle
Pottier, Patrice
Pollo, Pietro
Ricolfi, Lorenzo
Williams, Coralie
Yang, Yefeng
Beillouin, Damien
Cardoso, Simone Jaqueline
Ferreira, Verónica
Gallagher, Brian
Gan, Jelaine L
Hao, Guang
Keikha, Mojtaba
Kozlowsky-Suzuki, Betina
Kiran Kumara, T M
Latterini, Francesco
Leverkus, Alexandro B
Macartney, Erin L
Manrique, Silvina Magdalena
Martinig, April Robin
Mizuno, Ayumi
Nanayakkara, Shanika
Ntzani, Evangelia
Ouédraogo, Dakis-Yaoba
Pursell, Edward
Simpson, Zachary
Sleight, Harriet
Woon, Kok Sin
Xia, Ziqian
Ghannad, Mona
Grames, Eliza
Hennessy, Emily Alden
IntHout, Joanna
Moher, David
O'Dea, Rose E
Page, Matthew J
Whaley, Paul
Lagisz, Malgorzata
Nakagawa, Shinichi
Morrison, Kyle
Pottier, Patrice
Pollo, Pietro
Ricolfi, Lorenzo
Williams, Coralie
Yang, Yefeng
Beillouin, Damien
Cardoso, Simone Jaqueline
Ferreira, Verónica
Gallagher, Brian
Gan, Jelaine L
Hao, Guang
Keikha, Mojtaba
Kozlowsky-Suzuki, Betina
Kiran Kumara, T M
Latterini, Francesco
Leverkus, Alexandro B
Macartney, Erin L
Manrique, Silvina Magdalena
Martinig, April Robin
Mizuno, Ayumi
Nanayakkara, Shanika
Ntzani, Evangelia
Ouédraogo, Dakis-Yaoba
Pursell, Edward
Simpson, Zachary
Sleight, Harriet
Woon, Kok Sin
Xia, Ziqian
Ghannad, Mona
Grames, Eliza
Hennessy, Emily Alden
IntHout, Joanna
Moher, David
O'Dea, Rose E
Page, Matthew J
Whaley, Paul
Lagisz, Malgorzata
Nakagawa, Shinichi
collection PubMed - marine biology
contents MATES: A tool for appraising the completeness with which a meta-analysis has been reported. Morrison, Kyle Pottier, Patrice Pollo, Pietro Ricolfi, Lorenzo Williams, Coralie Yang, Yefeng Beillouin, Damien Cardoso, Simone Jaqueline Ferreira, Verónica Gallagher, Brian Gan, Jelaine L Hao, Guang Keikha, Mojtaba Kozlowsky-Suzuki, Betina Kiran Kumara, T M Latterini, Francesco Leverkus, Alexandro B Macartney, Erin L Manrique, Silvina Magdalena Martinig, April Robin Mizuno, Ayumi Nanayakkara, Shanika Ntzani, Evangelia Ouédraogo, Dakis-Yaoba Pursell, Edward Simpson, Zachary Sleight, Harriet Woon, Kok Sin Xia, Ziqian Ghannad, Mona Grames, Eliza Hennessy, Emily Alden IntHout, Joanna Moher, David O'Dea, Rose E Page, Matthew J Whaley, Paul Lagisz, Malgorzata Nakagawa, Shinichi Delphi Technique Ecology Meta-Analysis as Topic Environmental Science Meta-analysis is commonly a core component of systematic reviews and has become an important method to reconcile conflicting findings, increase statistical power, and chart new research directions. However, poor reporting practices make it challenging to evaluate the validity of meta-analyses. Despite the existence of reporting checklists, a specifically designed tool has yet to be developed to appraise the completeness with which a meta-analysis has been reported. To bridge this gap, we introduce the Meta-analysis Appraisal Tool for Environmental Sciences (MATES). To develop MATES, we adapted a Delphi process involving experts in meta-analysis methodologies, researchers with experience in guideline/appraisal tool development, and editors of relevant journals. The Delphi process had five steps, including three workshops (11-16 participants), a survey (193 participants), and a validation task (30 participants). This iterative development process resulted in a 14-item appraisal tool that reflects the environmental science and research syntheses community's consensus on essential elements to appraise the completeness with which a meta-analysis has been reported. Validation across 50 meta-analyses demonstrated that the tool is repeatable (average agreement rate: 88.97 %) and time-efficient to implement (17.00 ± 12.23 min). We also outline guidance for interpreting MATES results, describe its potential applications, and reflect on the development process. The authors provide practical implementation guidance for each MATES item, illustrated with real examples in the supplementary material. We also report an extended development methodology to support reproducibility. Finally, we built created a ShinyApp that includes both a training module and an application tool to enhance the usability of MATES (https://kylemorrisonisshiny99.shinyapps.io/MATES_shiny/). Overall, MATES provides authors, readers, stakeholders, and editors with a reliable and accessible tool for appraising the completeness with which a meta-analysis in environmental sciences has been reported.
format Artículo científico
id pubmed_41411971
institution PubMed
language en
publishDate 2026
publisher Environment international
record_format pubmed
spellingShingle MATES: A tool for appraising the completeness with which a meta-analysis has been reported.
Morrison, Kyle
Pottier, Patrice
Pollo, Pietro
Ricolfi, Lorenzo
Williams, Coralie
Yang, Yefeng
Beillouin, Damien
Cardoso, Simone Jaqueline
Ferreira, Verónica
Gallagher, Brian
Gan, Jelaine L
Hao, Guang
Keikha, Mojtaba
Kozlowsky-Suzuki, Betina
Kiran Kumara, T M
Latterini, Francesco
Leverkus, Alexandro B
Macartney, Erin L
Manrique, Silvina Magdalena
Martinig, April Robin
Mizuno, Ayumi
Nanayakkara, Shanika
Ntzani, Evangelia
Ouédraogo, Dakis-Yaoba
Pursell, Edward
Simpson, Zachary
Sleight, Harriet
Woon, Kok Sin
Xia, Ziqian
Ghannad, Mona
Grames, Eliza
Hennessy, Emily Alden
IntHout, Joanna
Moher, David
O'Dea, Rose E
Page, Matthew J
Whaley, Paul
Lagisz, Malgorzata
Nakagawa, Shinichi
Delphi Technique
Ecology
Meta-Analysis as Topic
Environmental Science
MATES: A tool for appraising the completeness with which a meta-analysis has been reported. Morrison, Kyle Pottier, Patrice Pollo, Pietro Ricolfi, Lorenzo Williams, Coralie Yang, Yefeng Beillouin, Damien Cardoso, Simone Jaqueline Ferreira, Verónica Gallagher, Brian Gan, Jelaine L Hao, Guang Keikha, Mojtaba Kozlowsky-Suzuki, Betina Kiran Kumara, T M Latterini, Francesco Leverkus, Alexandro B Macartney, Erin L Manrique, Silvina Magdalena Martinig, April Robin Mizuno, Ayumi Nanayakkara, Shanika Ntzani, Evangelia Ouédraogo, Dakis-Yaoba Pursell, Edward Simpson, Zachary Sleight, Harriet Woon, Kok Sin Xia, Ziqian Ghannad, Mona Grames, Eliza Hennessy, Emily Alden IntHout, Joanna Moher, David O'Dea, Rose E Page, Matthew J Whaley, Paul Lagisz, Malgorzata Nakagawa, Shinichi Delphi Technique Ecology Meta-Analysis as Topic Environmental Science Meta-analysis is commonly a core component of systematic reviews and has become an important method to reconcile conflicting findings, increase statistical power, and chart new research directions. However, poor reporting practices make it challenging to evaluate the validity of meta-analyses. Despite the existence of reporting checklists, a specifically designed tool has yet to be developed to appraise the completeness with which a meta-analysis has been reported. To bridge this gap, we introduce the Meta-analysis Appraisal Tool for Environmental Sciences (MATES). To develop MATES, we adapted a Delphi process involving experts in meta-analysis methodologies, researchers with experience in guideline/appraisal tool development, and editors of relevant journals. The Delphi process had five steps, including three workshops (11-16 participants), a survey (193 participants), and a validation task (30 participants). This iterative development process resulted in a 14-item appraisal tool that reflects the environmental science and research syntheses community's consensus on essential elements to appraise the completeness with which a meta-analysis has been reported. Validation across 50 meta-analyses demonstrated that the tool is repeatable (average agreement rate: 88.97 %) and time-efficient to implement (17.00 ± 12.23 min). We also outline guidance for interpreting MATES results, describe its potential applications, and reflect on the development process. The authors provide practical implementation guidance for each MATES item, illustrated with real examples in the supplementary material. We also report an extended development methodology to support reproducibility. Finally, we built created a ShinyApp that includes both a training module and an application tool to enhance the usability of MATES (https://kylemorrisonisshiny99.shinyapps.io/MATES_shiny/). Overall, MATES provides authors, readers, stakeholders, and editors with a reliable and accessible tool for appraising the completeness with which a meta-analysis in environmental sciences has been reported.
title MATES: A tool for appraising the completeness with which a meta-analysis has been reported.
topic Delphi Technique
Ecology
Meta-Analysis as Topic
Environmental Science
url https://pubmed.ncbi.nlm.nih.gov/41411971/