Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2601.12012 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912829981851648 |
|---|---|
| author | Hu, Zhaoyang Jacopo Ranne, Alex Abdelaal, Alaa Eldin Bhattacharyya, Kiran Burdet, Etienne Okamura, Allison M. Baena, Ferdinando Rodriguez y |
| author_facet | Hu, Zhaoyang Jacopo Ranne, Alex Abdelaal, Alaa Eldin Bhattacharyya, Kiran Burdet, Etienne Okamura, Allison M. Baena, Ferdinando Rodriguez y |
| contents | Automated feedback systems have the potential to provide objective skill assessment for training and evaluation in robot-assisted surgery. In this study, we examine methods to achieve real-time prediction of surgical skill level in real-time based on Objective Structured Assessment of Technical Skills (OSATS) scores. Using data acquired from the da Vinci Surgical System, we carry out three main analyses, focusing on model design, their real-time performance, and their skill-level-based cross-validation training. For the model design, we evaluate the effectiveness of multimodal deep learning models for predicting surgical skill levels using synchronized kinematic and vision data. Our models include separate unimodal baselines and fusion architectures that integrate features from both modalities and are evaluated using mean Spearman's correlation coefficients, demonstrating that the fusion model consistently outperforms unimodal models for real-time predictions. For the real-time performance, we observe the prediction's trend over time and highlight correlation with the surgeon's gestures. For the skill-level-based cross-validation, we separately trained models on surgeons with different skill levels, which showed that high-skill demonstrations allow for better performance than those trained on low-skilled ones and generalize well to similarly skilled participants. Our findings show that multimodal learning allows more stable fine-grained evaluation of surgical performance and highlights the value of expert-level training data for model generalization. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_12012 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Model selection and real-time skill assessment for suturing in robotic surgery Hu, Zhaoyang Jacopo Ranne, Alex Abdelaal, Alaa Eldin Bhattacharyya, Kiran Burdet, Etienne Okamura, Allison M. Baena, Ferdinando Rodriguez y Robotics Automated feedback systems have the potential to provide objective skill assessment for training and evaluation in robot-assisted surgery. In this study, we examine methods to achieve real-time prediction of surgical skill level in real-time based on Objective Structured Assessment of Technical Skills (OSATS) scores. Using data acquired from the da Vinci Surgical System, we carry out three main analyses, focusing on model design, their real-time performance, and their skill-level-based cross-validation training. For the model design, we evaluate the effectiveness of multimodal deep learning models for predicting surgical skill levels using synchronized kinematic and vision data. Our models include separate unimodal baselines and fusion architectures that integrate features from both modalities and are evaluated using mean Spearman's correlation coefficients, demonstrating that the fusion model consistently outperforms unimodal models for real-time predictions. For the real-time performance, we observe the prediction's trend over time and highlight correlation with the surgeon's gestures. For the skill-level-based cross-validation, we separately trained models on surgeons with different skill levels, which showed that high-skill demonstrations allow for better performance than those trained on low-skilled ones and generalize well to similarly skilled participants. Our findings show that multimodal learning allows more stable fine-grained evaluation of surgical performance and highlights the value of expert-level training data for model generalization. |
| title | Model selection and real-time skill assessment for suturing in robotic surgery |
| topic | Robotics |
| url | https://arxiv.org/abs/2601.12012 |