Objective assessment tools in laparoscopic or robotic‐assisted gynecological surgery: A systematic review

Fuente: Wiley Open Access
Saved in:
Bibliographic Details
Main Authors: Freweini Martha Tesfai, Jasleen Nagi, Iona Morrison, Matt Boal, Adeola Olaitan, Dhivya Chandrasekaran, Danail Stoyanov, Anne Lanceley, Nader Francis
Format: Artículo Open Access
Published: Wiley 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1867002262314811392
author Freweini Martha Tesfai
Jasleen Nagi
Iona Morrison
Matt Boal
Adeola Olaitan
Dhivya Chandrasekaran
Danail Stoyanov
Anne Lanceley
Nader Francis
author_facet Freweini Martha Tesfai
Jasleen Nagi
Iona Morrison
Matt Boal
Adeola Olaitan
Dhivya Chandrasekaran
Danail Stoyanov
Anne Lanceley
Nader Francis
Freweini Martha Tesfai
Jasleen Nagi
Iona Morrison
Matt Boal
Adeola Olaitan
Dhivya Chandrasekaran
Danail Stoyanov
Anne Lanceley
Nader Francis
collection Wiley Open Access
contents Objective assessment tools in laparoscopic or robotic‐assisted gynecological surgery: A systematic review Freweini Martha Tesfai Jasleen Nagi Iona Morrison Matt Boal Adeola Olaitan Dhivya Chandrasekaran Danail Stoyanov Anne Lanceley Nader Francis Acta Obstetricia et Gynecologica Scandinavica AbstractIntroductionThere is a growing emphasis on proficiency‐based progression within surgical training. To enable this, clearly defined metrics for those newly acquired surgical skills are needed. These can be formulated in objective assessment tools. The aim of the present study was to systematically review the literature reporting on available tools for objective assessment of minimally invasive gynecological surgery (simulated) performance and evaluate their reliability and validity.Material and methodsA systematic search (1989–2022) was conducted in MEDLINE, Embase, PubMed, Web of Science in accordance with PRISMA. The trial was registered with the Prospective Register of Systematic Reviews (PROSPERO) ID: CRD42022376552. Randomized controlled trials, prospective comparative studies, prospective single‐group (with pre‐ and post‐training assessment) or consensus studies that reported on the development, validation or usage of assessment tools of surgical performance in minimally invasive gynecological surgery, were included. Three independent assessors assessed study setting and validity evidence according to a contemporary framework of validity, which was adapted from Messick's validity framework. Methodological quality of included studies was assessed using the modified medical education research study quality instrument (MERSQI) checklist. Heterogeneity in data reporting on types of tools, data collection, study design, definition of expertise (novice vs. experts) and statistical values prevented a meaningful meta‐analysis.ResultsA total of 19 746 titles and abstracts were screened of which 72 articles met the inclusion criteria. A total of 37 different assessment tools were identified of which 13 represented manual global assessment tools, 13 manual procedure‐specific assessment tools and 11 automated performance metrices. Only two tools showed substantive evidence of validity. Reliability and validity per tool were provided. No assessment tools showed direct correlation between tool scores and patient related outcomes.ConclusionsExisting objective assessment tools lack evidence on predicting patient outcomes and suffer from limitations in transferability outside of the research environment, particularly for automated performance metrics. Future research should prioritize filling these gaps while integrating advanced technologies like kinematic data and AI for robust, objective surgical skill assessment within gynecological advanced surgical training programs. 10.1111/aogs.14840 http://creativecommons.org/licenses/by-nc-nd/4.0/
doi_str_mv 10.1111/aogs.14840
format Artículo Open Access
id wiley_oa_10_1111_aogs_14840
institution Wiley Open Access
license_str_mv http://creativecommons.org/licenses/by-nc-nd/4.0/
publishDate 2024
publisher Wiley
record_format wiley_oa
spellingShingle Objective assessment tools in laparoscopic or robotic‐assisted gynecological surgery: A systematic review
Freweini Martha Tesfai
Jasleen Nagi
Iona Morrison
Matt Boal
Adeola Olaitan
Dhivya Chandrasekaran
Danail Stoyanov
Anne Lanceley
Nader Francis
Acta Obstetricia et Gynecologica Scandinavica
Objective assessment tools in laparoscopic or robotic‐assisted gynecological surgery: A systematic review Freweini Martha Tesfai Jasleen Nagi Iona Morrison Matt Boal Adeola Olaitan Dhivya Chandrasekaran Danail Stoyanov Anne Lanceley Nader Francis Acta Obstetricia et Gynecologica Scandinavica AbstractIntroductionThere is a growing emphasis on proficiency‐based progression within surgical training. To enable this, clearly defined metrics for those newly acquired surgical skills are needed. These can be formulated in objective assessment tools. The aim of the present study was to systematically review the literature reporting on available tools for objective assessment of minimally invasive gynecological surgery (simulated) performance and evaluate their reliability and validity.Material and methodsA systematic search (1989–2022) was conducted in MEDLINE, Embase, PubMed, Web of Science in accordance with PRISMA. The trial was registered with the Prospective Register of Systematic Reviews (PROSPERO) ID: CRD42022376552. Randomized controlled trials, prospective comparative studies, prospective single‐group (with pre‐ and post‐training assessment) or consensus studies that reported on the development, validation or usage of assessment tools of surgical performance in minimally invasive gynecological surgery, were included. Three independent assessors assessed study setting and validity evidence according to a contemporary framework of validity, which was adapted from Messick's validity framework. Methodological quality of included studies was assessed using the modified medical education research study quality instrument (MERSQI) checklist. Heterogeneity in data reporting on types of tools, data collection, study design, definition of expertise (novice vs. experts) and statistical values prevented a meaningful meta‐analysis.ResultsA total of 19 746 titles and abstracts were screened of which 72 articles met the inclusion criteria. A total of 37 different assessment tools were identified of which 13 represented manual global assessment tools, 13 manual procedure‐specific assessment tools and 11 automated performance metrices. Only two tools showed substantive evidence of validity. Reliability and validity per tool were provided. No assessment tools showed direct correlation between tool scores and patient related outcomes.ConclusionsExisting objective assessment tools lack evidence on predicting patient outcomes and suffer from limitations in transferability outside of the research environment, particularly for automated performance metrics. Future research should prioritize filling these gaps while integrating advanced technologies like kinematic data and AI for robust, objective surgical skill assessment within gynecological advanced surgical training programs. 10.1111/aogs.14840 http://creativecommons.org/licenses/by-nc-nd/4.0/
title Objective assessment tools in laparoscopic or robotic‐assisted gynecological surgery: A systematic review
topic Acta Obstetricia et Gynecologica Scandinavica
url https://obgyn.onlinelibrary.wiley.com/doi/10.1111/aogs.14840