Imagen de Portada

Towards Robust Surgical Automation via Digital Twin Representations from Foundation Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Ding, Hao, Seenivasan, Lalithkumar, Shu, Hongchao, Byrd, Grayson, Zhang, Han, Xiao, Pu, Barragan, Juan Antonio, Taylor, Russell H., Kazanzides, Peter, Unberath, Mathias
Formato:	Preprint
Publicado:	2024
Materias:	Robotics
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Position: Foundation Models Need Digital Twin Representations
por: Shen, Yiqing, et al.
Publicado: (2025)

Online Reasoning Video Segmentation with Just-in-Time Digital Twins
por: Shen, Yiqing, et al.
Publicado: (2025)

Towards Robust Algorithms for Surgical Phase Recognition via Digital Twin Representation
por: Ding, Hao, et al.
Publicado: (2024)

Beyond Rigid AI: Towards Natural Human-Machine Symbiosis for Interoperative Surgical Assistance
por: Seenivasan, Lalithkumar, et al.
Publicado: (2025)

Seamless Augmented Reality Integration in Arthroscopy: A Pipeline for Articular Reconstruction and Guidance
por: Shu, Hongchao, et al.
Publicado: (2024)

Constrained Natural Language Action Planning for Resilient Embodied Systems
por: Byrd, Grayson, et al.
Publicado: (2025)

Privacy-Preserving Operating Room Workflow Analysis using Digital Twins
por: Perez, Alejandra, et al.
Publicado: (2025)

TwinOR: Photorealistic Digital Twins of Dynamic Operating Rooms for Embodied AI Research
por: Zhang, Han, et al.
Publicado: (2025)

Constructing and Interpreting Digital Twin Representations for Visual Reasoning via Reinforcement Learning
por: Shen, Yiqing, et al.
Publicado: (2025)

SAW: Toward a Surgical Action World Model via Controllable and Scalable Video Generation
por: Rapuri, Sampath, et al.
Publicado: (2026)

AffordTissue: Dense Affordance Prediction for Tool-Action Specific Tissue Interaction
por: Maksutova, Aiza, et al.
Publicado: (2026)

DualVision ArthroNav: Investigating Opportunities to Enhance Localization and Reconstruction in Image-based Arthroscopy Navigation via External Cameras
por: Shu, Hongchao, et al.
Publicado: (2025)

Text-Driven Reasoning Video Editing via Reinforcement Learning on Digital Twin Representations
por: Shen, Yiqing, et al.
Publicado: (2025)

Performance and Non-adversarial Robustness of the Segment Anything Model 2 in Surgical Video Segmentation
por: Shen, Yiqing, et al.
Publicado: (2024)

Explainable AI for Automated User-specific Feedback in Surgical Skill Acquisition
por: Gomez, Catalina, et al.
Publicado: (2025)

MoSFormer: Augmenting Temporal Context with Memory of Surgery for Surgical Phase Recognition
por: Ding, Hao, et al.
Publicado: (2025)

Investigating Robot Control Policy Learning for Autonomous X-ray-guided Spine Procedures
por: Klitzner, Florence, et al.
Publicado: (2025)

Surgical-VQLA++: Adversarial Contrastive Learning for Calibrated Robust Visual Question-Localized Answering in Robotic Surgery
por: Bai, Long, et al.
Publicado: (2024)

Reasoning Text-to-Video Retrieval via Digital Twin Video Representations and Large Language Models
por: Shen, Yiqing, et al.
Publicado: (2025)

Did you just see that? Arbitrary view synthesis for egocentric replay of operating room workflows from ambient sensors
por: Zhang, Han, et al.
Publicado: (2025)

Towards Controllable Video Synthesis of Routine and Rare OR Events
por: Schneider, Dominik, et al.
Publicado: (2026)

ConceptAgent: LLM-Driven Precondition Grounding and Tree Search for Robust Task Planning and Execution
por: Rivera, Corban, et al.
Publicado: (2024)

StraightTrack: Towards Mixed Reality Navigation System for Percutaneous K-wire Insertion
por: Zhang, Han, et al.
Publicado: (2024)

Counterfactual World Models via Digital Twin-conditioned Video Diffusion
por: Shen, Yiqing, et al.
Publicado: (2025)

Investigating a Policy-Based Formulation for Endoscopic Camera Pose Recovery
por: Mangulabnan, Jan Emily, et al.
Publicado: (2026)

A Digital Twin for Telesurgery under Intermittent Communication
por: Wang, Junxiang, et al.
Publicado: (2024)

A Causal Framework for Aligning Image Quality Metrics and Deep Neural Network Robustness
por: Drenkow, Nathan, et al.
Publicado: (2025)

Improving Surgical Situational Awareness with Signed Distance Field: A Pilot Study in Virtual Reality
por: Ishida, Hisashi, et al.
Publicado: (2023)

BronchOpt : Vision-Based Pose Optimization with Fine-Tuned Foundation Models for Accurate Bronchoscopy Navigation
por: Shu, Hongchao, et al.
Publicado: (2025)

Human-AI Collaboration and Explainability for 2D/3D Registration Quality Assurance
por: Cho, Sue Min, et al.
Publicado: (2025)

Operating Room Workflow Analysis via Reasoning Segmentation over Digital Twins
por: Shen, Yiqing, et al.
Publicado: (2025)

Realistic Data Generation for 6D Pose Estimation of Surgical Instruments
por: Barragan, Juan Antonio, et al.
Publicado: (2024)

Intelligent Control of Robotic X-ray Devices using a Language-promptable Digital Twin
por: Killeen, Benjamin D., et al.
Publicado: (2024)

Automated Prediction of Bone Volume Removed in Mastoidectomy
por: Nimesh V. Nagururu, et al.
Publicado: (2025)

FluoroSAM: A Language-promptable Foundation Model for Flexible X-ray Image Segmentation
por: Killeen, Benjamin D., et al.
Publicado: (2024)

Temporally-Constrained Video Reasoning Segmentation and Automated Benchmark Construction
por: Shen, Yiqing, et al.
Publicado: (2025)

Fast Reasoning Segmentation for Images and Videos
por: Shen, Yiqing, et al.
Publicado: (2025)

Causality-Driven Audits of Model Robustness
por: Drenkow, Nathan, et al.
Publicado: (2024)

dARt Vinci: Egocentric Data Collection for Surgical Robot Learning at Scale
por: Liu, Yihao, et al.
Publicado: (2025)

From Generalization to Precision: Exploring SAM for Tool Segmentation in Surgical Environments
por: Oguine, Kanyifeechukwu J., et al.
Publicado: (2024)