Cover Image

Sim2Real Diffusion: Leveraging Foundation Vision Language Models for Adaptive Automated Driving

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Samak, Chinmay Vilas, Samak, Tanmay Vilas, Li, Bing, Krovi, Venkat
Format:	Preprint
Published:	2025
Subjects:	Robotics
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Towards Sim2Real Transfer of Autonomy Algorithms using AutoDRIVE Ecosystem
by: Samak, Chinmay Vilas, et al.
Published: (2023)

Mixed-Reality Digital Twins: Leveraging the Physical and Virtual Worlds for Hybrid Sim2Real Transition of Multi-Agent Reinforcement Learning Policies
by: Samak, Chinmay Vilas, et al.
Published: (2024)

When Digital Twins Meet Large Language Models: Realistic, Interactive, and Editable Simulation for Autonomous Driving
by: Samak, Tanmay Vilas, et al.
Published: (2025)

Towards Mechatronics Approach of System Design, Verification and Validation for Autonomous Vehicles
by: Samak, Chinmay Vilas, et al.
Published: (2023)

Autonomy Oriented Digital Twins for Real2Sim2Real Autoware Deployment
by: Samak, Chinmay Vilas, et al.
Published: (2024)

Towards Validation of Autonomous Vehicles Across Scales using an Integrated Digital Twin Framework
by: Samak, Tanmay Vilas, et al.
Published: (2024)

Metaverse for Safer Roadways: An Immersive Digital Twin Framework for Exploring Human-Autonomy Coexistence in Urban Transportation Systems
by: Samak, Tanmay Vilas, et al.
Published: (2024)

Nigel -- Mechatronic Design and Robust Sim2Real Control of an Over-Actuated Autonomous Vehicle
by: Samak, Chinmay Vilas, et al.
Published: (2024)

Digital Twins in the Cloud: A Modular, Scalable and Interoperable Framework for Accelerating Verification and Validation of Autonomous Driving Solutions
by: Samak, Tanmay Vilas, et al.
Published: (2025)

Digital Twins Meet the Koopman Operator: Data-Driven Learning for Robust Autonomy
by: Samak, Chinmay Vilas, et al.
Published: (2024)

Off-Road Autonomy Validation Using Scalable Digital Twin Simulations Within High-Performance Computing Clusters
by: Samak, Tanmay Vilas, et al.
Published: (2024)

A Systematic Digital Engineering Approach to Verification & Validation of Autonomous Ground Vehicles in Off-Road Environments
by: Samak, Tanmay Vilas, et al.
Published: (2025)

Experimental investigation of pose informed reinforcement learning for skid-steered visual navigation
by: Salvi, Ameya, et al.
Published: (2025)

Vision-based DRL Autonomous Driving Agent with Sim2Real Transfer
by: Li, Dianzhao, et al.
Published: (2023)

DexSim2Real: Foundation Model-Guided Sim-to-Real Transfer for Generalizable Dexterous Manipulation
by: Zeng, Zijian, et al.
Published: (2026)

Stabilization of vertical motion of a vehicle on bumpy terrain using deep reinforcement learning
by: Salvi, Ameya, et al.
Published: (2024)

S2R-Bench: A Sim-to-Real Evaluation Benchmark for Autonomous Driving
by: Wang, Li, et al.
Published: (2025)

ADEPT: Adaptive Diffusion Environment for Policy Transfer Sim-to-Real
by: Yu, Youwei, et al.
Published: (2025)

Characterizing gaussian mixture of motion modes for skid-steer vehicle state estimation
by: Salvi, Ameya, et al.
Published: (2025)

Sim2Real Grasp Pose Estimation for Adaptive Robotic Applications
by: Horváth, Dániel, et al.
Published: (2022)

VLM-MPC: Vision Language Foundation Model (VLM)-Guided Model Predictive Controller (MPC) for Autonomous Driving
by: Long, Keke, et al.
Published: (2024)

Grounding Sim-to-Real Generalization in Dexterous Manipulation: An Empirical Study with Vision-Language-Action Models
by: Jin, Ruixing, et al.
Published: (2026)

DiffuDepGrasp: Diffusion-based Depth Noise Modeling Empowers Sim2Real Robotic Grasping
by: Zhou, Yingting, et al.
Published: (2025)

RealDrive: Retrieval-Augmented Driving with Diffusion Models
by: Ding, Wenhao, et al.
Published: (2025)

Bench2Drive-VL: Benchmarks for Closed-Loop Autonomous Driving with Vision-Language Models
by: Jia, Xiaosong, et al.
Published: (2026)

Overcoming the Sim-to-Real Gap: Leveraging Simulation to Learn to Explore for Real-World RL
by: Wagenmaker, Andrew, et al.
Published: (2024)

Words to Wheels: Vision-Based Autonomous Driving Understanding Human Language Instructions Using Foundation Models
by: Ryu, Chanhoe, et al.
Published: (2024)

SimScale: Learning to Drive via Real-World Simulation at Scale
by: Tian, Haochen, et al.
Published: (2025)

Sim-to-Real Transfer via 3D Feature Fields for Vision-and-Language Navigation
by: Wang, Zihan, et al.
Published: (2024)

SimLingo: Vision-Only Closed-Loop Autonomous Driving with Language-Action Alignment
by: Renz, Katrin, et al.
Published: (2025)

Sim2Real Transfer for Vision-Based Grasp Verification
by: Amargant, Pau, et al.
Published: (2025)

Discrete Diffusion for Reflective Vision-Language-Action Models in Autonomous Driving
by: Li, Pengxiang, et al.
Published: (2025)

An expert system for diagnosing and treating heart disease
by: Fernandino, Blake, et al.
Published: (2024)

DexCtrl: Towards Sim-to-Real Dexterity with Adaptive Controller Learning
by: Zhao, Shuqi, et al.
Published: (2025)

StyleVLA: Driving Style-Aware Vision Language Action Model for Autonomous Driving
by: Gao, Yuan, et al.
Published: (2026)

Robotic Sim-to-Real Transfer for Long-Horizon Pick-and-Place Tasks in the Robotic Sim2Real Competition
by: Yang, Ming, et al.
Published: (2025)

Sim2Real-AD: A Modular Sim-to-Real Framework for Deploying VLM-Guided Reinforcement Learning in Real-World Autonomous Driving
by: Huang, Zilin, et al.
Published: (2026)

Abstract Sim2Real through Approximate Information States
by: Deng, Yunfu, et al.
Published: (2026)

ALDM-Grasping: Diffusion-aided Zero-Shot Sim-to-Real Transfer for Robot Grasping
by: Li, Yiwei, et al.
Published: (2024)

Contrastive Representation Learning for Robust Sim-to-Real Transfer of Adaptive Humanoid Locomotion
by: Lu, Yidan, et al.
Published: (2025)