Cover Image

Multimodal Transformers for Real-Time Surgical Activity Prediction

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Weerasinghe, Keshara, Roodabeh, Seyed Hamid Reza, Hutchinson, Kay, Alemzadeh, Homa
Format:	Preprint
Published:	2024
Subjects:	Robotics
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

MiDAS: A Multimodal Data Acquisition System and Dataset for Robot-Assisted Minimally Invasive Surgery
by: Weerasinghe, Keshara, et al.
Published: (2026)

A Comprehensive Analysis of the Effects of Network Quality of Service on Robotic Telesurgery
by: Zhang, Zhaomeng, et al.
Published: (2026)

Real-Time Multimodal Cognitive Assistant for Emergency Medical Services
by: Weerasinghe, Keshara, et al.
Published: (2024)

EgoEMS: A High-Fidelity Multimodal Egocentric Dataset for Cognitive Assistance in Emergency Medical Services
by: Weerasinghe, Keshara, et al.
Published: (2025)

Leveraging Surgical Activity Grammar for Primary Intention Prediction in Laparoscopy Procedures
by: Zhang, Jie, et al.
Published: (2024)

Surgical Robot Transformer (SRT): Imitation Learning for Surgical Tasks
by: Kim, Ji Woong, et al.
Published: (2024)

Multimodal Large Language Models for Real-Time Situated Reasoning
by: Abbo, Giulio Antonio, et al.
Published: (2026)

MultiPark: Multimodal Parking Transformer with Next-Segment Prediction
by: Zheng, Han, et al.
Published: (2025)

Design and Evaluation of a Bioinspired Tendon-Driven 3D-Printed Robotic Eye with Active Vision Capabilities
by: Osooli, Hamid, et al.
Published: (2023)

Performance Evaluation of Trajectory Tracking Controllers for a Quadruped Robot Leg
by: Shojaei, Hossein, et al.
Published: (2025)

RL-augmented Adaptive Model Predictive Control for Bipedal Locomotion over Challenging Terrain
by: Kamohara, Junnosuke, et al.
Published: (2025)

Real-Time Adaptive Industrial Robots: Improving Safety And Comfort In Human-Robot Collaboration
by: Hostettler, Damian, et al.
Published: (2024)

RCM Constraint-Consistent Dynamic Control in Surgical Robots
by: Li, Yu, et al.
Published: (2025)

Motion Tracking with Muscles: Predictive Control of a Parametric Musculoskeletal Canine Model
by: La Barbera, Vittorio, et al.
Published: (2025)

A Deep Reinforcement Learning Framework and Methodology for Reducing the Sim-to-Real Gap in ASV Navigation
by: Batista, Luis F W, et al.
Published: (2024)

VISTA: A Benchmark for Real-Time Video Streaming under Network Impairments in Surgical Teleoperation
by: Deng, Zexin, et al.
Published: (2026)

Design of Fuzzy Logic Parameter Tuners for Upper-Limb Assistive Robots
by: Coco Jr., Christopher, et al.
Published: (2024)

Friends Across Time: Multi-Scale Action Segmentation Transformer for Surgical Phase Recognition
by: Zhang, Bokai, et al.
Published: (2024)

Standing Tall: Sim to Real Fall Classification and Lead Time Prediction for Bipedal Robots
by: Prabhakaran, Gokul, et al.
Published: (2025)

Investigating the Generalizability of Assistive Robots Models over Various Tasks
by: Osooli, Hamid, et al.
Published: (2024)

Safety Evaluation of Human Arm Operations Using IMU Sensors with a Spring-Damper-Mass Predictive Model
by: Inamdar, Musab Zubair, et al.
Published: (2025)

Deep Reinforcement Learning with Enhanced PPO for Safe Mobile Robot Navigation
by: Taheri, Hamid, et al.
Published: (2024)

Real-Time Whole-Body Control of Legged Robots with Model-Predictive Path Integral Control
by: Alvarez-Padilla, Juan, et al.
Published: (2024)

Multimodal Diffusion Transformer: Learning Versatile Behavior from Multimodal Goals
by: Reuss, Moritz, et al.
Published: (2024)

PrediFlow: A Flow-Based Prediction-Refinement Framework for Real-Time Human Motion Prediction in Human-Robot Collaboration
by: Tian, Sibo, et al.
Published: (2025)

A Modern System Recipe for Situated Embodied Human-Robot Conversation with Real-Time Multimodal LLMs and Tool-Calling
by: Lee, Dong Won, et al.
Published: (2026)

Multi-Model Predictive Attitude Control of Quadrotors
by: Izadi, Mohammadreza, et al.
Published: (2024)

Effect of Performance Feedback Timing on Motor Learning for a Surgical Training Task
by: Gale, Mary Kate, et al.
Published: (2025)

Real-Time Model Predictive Control of Vehicles with Convex-Polygon-Aware Collision Avoidance in Tight Spaces
by: Kojima, Haruki, et al.
Published: (2025)

Data‐driven iterative learning cooperative trajectory tracking control for multiple autonomous underwater vehicles with input saturation constraints
by: Chengxi Wu, et al.
Published: (2024)

Minimizing Turns in Watchman Robot Navigation: Strategies and Solutions
by: Hoorfar, Hamid, et al.
Published: (2023)

Modeling and Optimizing the Provisioning of Exhaustible Capabilities for Simultaneous Task Allocation and Scheduling
by: Park, Jinwoo, et al.
Published: (2026)

Predicted-Flow Control Barrier Functions for Real-Time Safe Optimal Control
by: Safari, Amirsaeid, et al.
Published: (2026)

Directing the Robot: Scaffolding Creative Human-AI-Robot Interaction
by: Deja, Jordan Aiko, et al.
Published: (2026)

Enhancing Robotic Arm Activity Recognition with Vision Transformers and Wavelet-Transformed Channel State Information
by: Zandi, Rojin, et al.
Published: (2024)

AURA: Multimodal Shared Autonomy for Real-World Urban Navigation
by: Ma, Yukai, et al.
Published: (2026)

Architectural-Scale Artistic Brush Painting with a Hybrid Cable Robot
by: Chen, Gerry, et al.
Published: (2024)

Mesoscale Traffic Forecasting for Real-Time Bottleneck and Shockwave Prediction
by: Chekroun, Raphael, et al.
Published: (2024)

ORBIT-Surgical: An Open-Simulation Framework for Learning Surgical Augmented Dexterity
by: Yu, Qinxi, et al.
Published: (2024)

SurgFusion-Net: Diversified Adaptive Multimodal Fusion Network for Surgical Skill Assessment
by: He, Runlong, et al.
Published: (2026)