SurGo-R1: Benchmarking and Modeling Contextual Reasoning for Operative Zone in Surgical Video
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866908852146929664 |
|---|---|
| author | Qin, Guanyi Wang, Xiaozhen Zhuo, Zhu Low, Chang Han Xiao, Yuancan Fu, Yibing Liu, Haofeng Wang, Kai Li, Chunjiang Jin, Yueming |
| author_facet | Qin, Guanyi Wang, Xiaozhen Zhuo, Zhu Low, Chang Han Xiao, Yuancan Fu, Yibing Liu, Haofeng Wang, Kai Li, Chunjiang Jin, Yueming |
| contents | Minimally invasive surgery has dramatically improved patient operative outcomes, yet identifying safe operative zones remains challenging in critical phases, requiring surgeons to integrate visual cues, procedural phase, and anatomical context under high cognitive load. Existing AI systems offer binary safety verification or static detection, ignoring the phase-dependent nature of intraoperative reasoning. We introduce ResGo, a benchmark of laparoscopic frames annotated with Go Zone bounding boxes and clinician-authored rationales covering phase, exposure quality reasoning, next action and risk reminder. We introduce evaluation metrics that treat correct grounding under incorrect phase as failures, revealing that most vision-language models cannot handle such tasks and perform poorly. We then present SurGo-R1, a model optimized via RLHF with a multi-turn phase-then-go architecture where the model first identifies the surgical phase, then generates reasoning and Go Zone coordinates conditioned on that context. On unseen procedures, SurGo-R1 achieves 76.6% phase accuracy, 32.7 mIoU, and 54.8% hardcore accuracy, a 6.6$\times$ improvement over the mainstream generalist VLMs. Code, model and benchmark will be available at https://github.com/jinlab-imvr/SurGo-R1 |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_21706 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | SurGo-R1: Benchmarking and Modeling Contextual Reasoning for Operative Zone in Surgical Video Qin, Guanyi Wang, Xiaozhen Zhuo, Zhu Low, Chang Han Xiao, Yuancan Fu, Yibing Liu, Haofeng Wang, Kai Li, Chunjiang Jin, Yueming Computer Vision and Pattern Recognition Artificial Intelligence Minimally invasive surgery has dramatically improved patient operative outcomes, yet identifying safe operative zones remains challenging in critical phases, requiring surgeons to integrate visual cues, procedural phase, and anatomical context under high cognitive load. Existing AI systems offer binary safety verification or static detection, ignoring the phase-dependent nature of intraoperative reasoning. We introduce ResGo, a benchmark of laparoscopic frames annotated with Go Zone bounding boxes and clinician-authored rationales covering phase, exposure quality reasoning, next action and risk reminder. We introduce evaluation metrics that treat correct grounding under incorrect phase as failures, revealing that most vision-language models cannot handle such tasks and perform poorly. We then present SurGo-R1, a model optimized via RLHF with a multi-turn phase-then-go architecture where the model first identifies the surgical phase, then generates reasoning and Go Zone coordinates conditioned on that context. On unseen procedures, SurGo-R1 achieves 76.6% phase accuracy, 32.7 mIoU, and 54.8% hardcore accuracy, a 6.6$\times$ improvement over the mainstream generalist VLMs. Code, model and benchmark will be available at https://github.com/jinlab-imvr/SurGo-R1 |
| title | SurGo-R1: Benchmarking and Modeling Contextual Reasoning for Operative Zone in Surgical Video |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence |
| url | https://arxiv.org/abs/2602.21706 |