Saved in:
Bibliographic Details
Main Authors: Chen, Yiliang, Li, Zhixi, Xu, Cheng, Liu, Alex Qinyang, Cui, Ruize, Xu, Xuemiao, Teoh, Jeremy Yuen-Chun, He, Shengfeng, Qin, Jing
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2506.01130
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911180645203968
author Chen, Yiliang
Li, Zhixi
Xu, Cheng
Liu, Alex Qinyang
Cui, Ruize
Xu, Xuemiao
Teoh, Jeremy Yuen-Chun
He, Shengfeng
Qin, Jing
author_facet Chen, Yiliang
Li, Zhixi
Xu, Cheng
Liu, Alex Qinyang
Cui, Ruize
Xu, Xuemiao
Teoh, Jeremy Yuen-Chun
He, Shengfeng
Qin, Jing
contents Surgical triplet detection is a critical task in surgical video analysis. However, existing datasets like CholecT50 lack precise spatial bounding box annotations, rendering triplet classification at the image level insufficient for practical applications. The inclusion of bounding box annotations is essential to make this task meaningful, as they provide the spatial context necessary for accurate analysis and improved model generalizability. To address these shortcomings, we introduce ProstaTD, a large-scale, multi-institutional dataset for surgical triplet detection, developed from the technically demanding domain of robot-assisted prostatectomy. ProstaTD offers clinically defined temporal boundaries and high-precision bounding box annotations for each structured triplet activity. The dataset comprises 71,775 video frames and 196,490 annotated triplet instances, collected from 21 surgeries performed across multiple institutions, reflecting a broad range of surgical practices and intraoperative conditions. The annotation process was conducted under rigorous medical supervision and involved more than 60 contributors, including practicing surgeons and medically trained annotators, through multiple iterative phases of labeling and verification. To further facilitate future general-purpose surgical annotation, we developed two tailored labeling tools to improve efficiency and scalability in our annotation workflows. In addition, we created a surgical triplet detection evaluation toolkit that enables standardized and reproducible performance assessment across studies. ProstaTD is the largest and most diverse surgical triplet dataset to date, moving the field from simple classification to full detection with precise spatial and temporal boundaries and thereby providing a robust foundation for fair benchmarking.
format Preprint
id arxiv_https___arxiv_org_abs_2506_01130
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle ProstaTD: Bridging Surgical Triplet from Classification to Fully Supervised Detection
Chen, Yiliang
Li, Zhixi
Xu, Cheng
Liu, Alex Qinyang
Cui, Ruize
Xu, Xuemiao
Teoh, Jeremy Yuen-Chun
He, Shengfeng
Qin, Jing
Computer Vision and Pattern Recognition
Surgical triplet detection is a critical task in surgical video analysis. However, existing datasets like CholecT50 lack precise spatial bounding box annotations, rendering triplet classification at the image level insufficient for practical applications. The inclusion of bounding box annotations is essential to make this task meaningful, as they provide the spatial context necessary for accurate analysis and improved model generalizability. To address these shortcomings, we introduce ProstaTD, a large-scale, multi-institutional dataset for surgical triplet detection, developed from the technically demanding domain of robot-assisted prostatectomy. ProstaTD offers clinically defined temporal boundaries and high-precision bounding box annotations for each structured triplet activity. The dataset comprises 71,775 video frames and 196,490 annotated triplet instances, collected from 21 surgeries performed across multiple institutions, reflecting a broad range of surgical practices and intraoperative conditions. The annotation process was conducted under rigorous medical supervision and involved more than 60 contributors, including practicing surgeons and medically trained annotators, through multiple iterative phases of labeling and verification. To further facilitate future general-purpose surgical annotation, we developed two tailored labeling tools to improve efficiency and scalability in our annotation workflows. In addition, we created a surgical triplet detection evaluation toolkit that enables standardized and reproducible performance assessment across studies. ProstaTD is the largest and most diverse surgical triplet dataset to date, moving the field from simple classification to full detection with precise spatial and temporal boundaries and thereby providing a robust foundation for fair benchmarking.
title ProstaTD: Bridging Surgical Triplet from Classification to Fully Supervised Detection
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.01130