Cover Image

Prompting with the Future: Open-World Model Predictive Control with Interactive Digital Twins

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ning, Chuanruo, Fang, Kuan, Ma, Wei-Chiu
Format:	Preprint
Published:	2025
Subjects:	Robotics
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

MOKA: Open-World Robotic Manipulation through Mark-Based Visual Prompting
by: Liu, Fangchen, et al.
Published: (2024)

OpenTwinMap: An Open-Source Digital Twin Generator for Urban Autonomous Driving
by: Richardson, Alex, et al.
Published: (2025)

Digital Twin-based Control Co-Design of Full Vehicle Active Suspensions via Deep Reinforcement Learning
by: Tsai, Ying-Kuan, et al.
Published: (2025)

X-Diffusion: Training Diffusion Policies on Cross-Embodiment Human Demonstrations
by: Pace, Maximus A., et al.
Published: (2025)

TwinRL: Digital Twin-Driven Reinforcement Learning for Real-World Robotic Manipulation
by: Xu, Qinwen, et al.
Published: (2026)

Telecom World Models: Unifying Digital Twins, Foundation Models, and Predictive Planning for 6G
by: Zou, Hang, et al.
Published: (2026)

Broadcasting Support Relations Recursively from Local Dynamics for Object Retrieval in Clutters
by: Li, Yitong, et al.
Published: (2024)

When Digital Twins Meet Large Language Models: Realistic, Interactive, and Editable Simulation for Autonomous Driving
by: Samak, Tanmay Vilas, et al.
Published: (2025)

KALIE: Fine-Tuning Vision-Language Models for Open-World Manipulation without Robot Data
by: Tang, Grace, et al.
Published: (2024)

SAGA: Open-World Mobile Manipulation via Structured Affordance Grounding
by: Fang, Kuan, et al.
Published: (2025)

Learning Environment-Aware Affordance for 3D Articulated Object Manipulation under Occlusions
by: Wu, Ruihai, et al.
Published: (2023)

Privileged Foresight Distillation: Zero-Cost Future Correction for World Action Models
by: Fang, Pengcheng, et al.
Published: (2026)

DKPROMPT: Domain Knowledge Prompting Vision-Language Models for Open-World Planning
by: Zhang, Xiaohan, et al.
Published: (2024)

HAIC: Humanoid Agile Object Interaction Control via Dynamics-Aware World Model
by: Li, Dongting, et al.
Published: (2026)

Instrument-Splatting++: Towards Controllable Surgical Instrument Digital Twin Using Gaussian Splatting
by: Yang, Shuojue, et al.
Published: (2026)

SyncTwin: Fast Digital Twin Construction and Synchronization for Safe Robotic Manipulation
by: Huang, Ruopeng, et al.
Published: (2026)

GaussTwin: Unified Simulation and Correction with Gaussian Splatting for Robotic Digital Twins
by: Cai, Yichen, et al.
Published: (2026)

Integrating Open-World Shared Control in Immersive Avatars
by: Naughton, Patrick, et al.
Published: (2024)

Digital-Twin Evaluation for Proactive Human-Robot Collision Avoidance via Prediction-Guided A-RRT*
by: Murugesan, Vadivelan, et al.
Published: (2025)

Simple Models, Real Swimming: Digital Twins for Tendon-Driven Underwater Robots
by: Michelis, Mike Y., et al.
Published: (2026)

A Digital Twin Framework for Virtual Visuo-Haptic Teleoperation of Complex-Shaped Optical Microrobots
by: Tan, Zongcai, et al.
Published: (2026)

Digital Twin of Autonomous Surface Vessels for Safe Maritime Navigation Enabled through Predictive Modeling and Reinforcement Learning
by: Menges, Daniel, et al.
Published: (2024)

Development of a Multi-Fingered Soft Gripper Digital Twin for Machine Learning-based Underactuated Control
by: Yang, Wu-Te, et al.
Published: (2025)

From Optimizable to Interactable: Mixed Digital Twin-Empowered Testing of Vehicle-Infrastructure Cooperation Systems
by: Dong, Jianghong, et al.
Published: (2026)

MobRT: A Digital Twin-Based Framework for Scalable Learning in Mobile Manipulation
by: Mei, Yilin, et al.
Published: (2025)

Grounding Language Models with Semantic Digital Twins for Robotic Planning
by: Naeem, Mehreen, et al.
Published: (2025)

RoboTwin: A Robotic Teleoperation Framework Using Digital Twins
by: Yelchuri, Harsha, et al.
Published: (2025)

A Digital Twin for Telesurgery under Intermittent Communication
by: Wang, Junxiang, et al.
Published: (2024)

Drift-free Visual SLAM using Digital Twins
by: Merat, Roxane, et al.
Published: (2024)

Digital Twins Below the Surface: Enhancing Underwater Teleoperation
by: Adetunji, Favour O., et al.
Published: (2024)

Model Predictive Impedance Control with Gaussian Processes for Human and Environment Interaction
by: Haninger, Kevin, et al.
Published: (2022)

Digital-Twin Losses for Lane-Compliant Trajectory Prediction at Urban Intersections
by: Chao, Kuo-Yi, et al.
Published: (2026)

Towards Robust Surgical Automation via Digital Twin Representations from Foundation Models
by: Ding, Hao, et al.
Published: (2024)

FIMP: Future Interaction Modeling for Multi-Agent Motion Prediction
by: Woo, Sungmin, et al.
Published: (2024)

Personalised 3D Human Digital Twin with Soft-Body Feet for Walking Simulation
by: Loke, Kum Yew, et al.
Published: (2024)

Guided Multi-Fidelity Bayesian Optimization for Data-driven Controller Tuning with Digital Twins
by: Nobar, Mahdi, et al.
Published: (2025)

A Novel Approach to Grasping Control of Soft Robotic Grippers based on Digital Twin
by: Xiang, Tianyi, et al.
Published: (2024)

Material-informed Gaussian Splatting for 3D World Reconstruction in a Digital Twin
by: Huynh, Andy, et al.
Published: (2025)

Risk-Aware World Model Predictive Control for Generalizable End-to-End Autonomous Driving
by: Sun, Jiangxin, et al.
Published: (2026)

Automatic Configuration of Multi-Agent Model Predictive Controllers based on Semantic Graph World Models
by: de Vos, K., et al.
Published: (2023)