Cover Image

When Digital Twins Meet Large Language Models: Realistic, Interactive, and Editable Simulation for Autonomous Driving

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Samak, Tanmay Vilas, Samak, Chinmay Vilas, Li, Bing, Krovi, Venkat
Format:	Preprint
Published:	2025
Subjects:	Robotics
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Towards Validation of Autonomous Vehicles Across Scales using an Integrated Digital Twin Framework
by: Samak, Tanmay Vilas, et al.
Published: (2024)

Sim2Real Diffusion: Leveraging Foundation Vision Language Models for Adaptive Automated Driving
by: Samak, Chinmay Vilas, et al.
Published: (2025)

Towards Mechatronics Approach of System Design, Verification and Validation for Autonomous Vehicles
by: Samak, Chinmay Vilas, et al.
Published: (2023)

Metaverse for Safer Roadways: An Immersive Digital Twin Framework for Exploring Human-Autonomy Coexistence in Urban Transportation Systems
by: Samak, Tanmay Vilas, et al.
Published: (2024)

Mixed-Reality Digital Twins: Leveraging the Physical and Virtual Worlds for Hybrid Sim2Real Transition of Multi-Agent Reinforcement Learning Policies
by: Samak, Chinmay Vilas, et al.
Published: (2024)

Digital Twins Meet the Koopman Operator: Data-Driven Learning for Robust Autonomy
by: Samak, Chinmay Vilas, et al.
Published: (2024)

Digital Twins in the Cloud: A Modular, Scalable and Interoperable Framework for Accelerating Verification and Validation of Autonomous Driving Solutions
by: Samak, Tanmay Vilas, et al.
Published: (2025)

Towards Sim2Real Transfer of Autonomy Algorithms using AutoDRIVE Ecosystem
by: Samak, Chinmay Vilas, et al.
Published: (2023)

Autonomy Oriented Digital Twins for Real2Sim2Real Autoware Deployment
by: Samak, Chinmay Vilas, et al.
Published: (2024)

Nigel -- Mechatronic Design and Robust Sim2Real Control of an Over-Actuated Autonomous Vehicle
by: Samak, Chinmay Vilas, et al.
Published: (2024)

Off-Road Autonomy Validation Using Scalable Digital Twin Simulations Within High-Performance Computing Clusters
by: Samak, Tanmay Vilas, et al.
Published: (2024)

A Systematic Digital Engineering Approach to Verification & Validation of Autonomous Ground Vehicles in Off-Road Environments
by: Samak, Tanmay Vilas, et al.
Published: (2025)

An Advanced Framework for Ultra-Realistic Simulation and Digital Twinning for Autonomous Vehicles
by: He, Yuankai, et al.
Published: (2024)

Experimental investigation of pose informed reinforcement learning for skid-steered visual navigation
by: Salvi, Ameya, et al.
Published: (2025)

RealEngine: Simulating Autonomous Driving in Realistic Context
by: Jiang, Junzhe, et al.
Published: (2025)

Large Language Model based Interactive Decision-Making for Autonomous Driving
by: Dong, Xinwei, et al.
Published: (2026)

OpenTwinMap: An Open-Source Digital Twin Generator for Urban Autonomous Driving
by: Richardson, Alex, et al.
Published: (2025)

Stabilization of vertical motion of a vehicle on bumpy terrain using deep reinforcement learning
by: Salvi, Ameya, et al.
Published: (2024)

A Digital Twin Framework for Metamorphic Testing of Autonomous Driving Systems Using Generative Model
by: Zhang, Tony, et al.
Published: (2025)

Learning Based NMPC Adaptation for Autonomous Driving using Parallelized Digital Twin
by: Allamaa, Jean Pierre, et al.
Published: (2024)

ADDT -- A Digital Twin Framework for Proactive Safety Validation in Autonomous Driving Systems
by: Yu, Bo, et al.
Published: (2025)

Think2Drive: Efficient Reinforcement Learning by Thinking in Latent World Model for Quasi-Realistic Autonomous Driving (in CARLA-v2)
by: Li, Qifeng, et al.
Published: (2024)

Realistic Corner Case Generation for Autonomous Vehicles with Multimodal Large Language Model
by: Lu, Qiujing, et al.
Published: (2024)

HUGSIM: A Real-Time, Photo-Realistic and Closed-Loop Simulator for Autonomous Driving
by: Zhou, Hongyu, et al.
Published: (2024)

Characterizing gaussian mixture of motion modes for skid-steer vehicle state estimation
by: Salvi, Ameya, et al.
Published: (2025)

Large Language Model guided Deep Reinforcement Learning for Decision Making in Autonomous Driving
by: Pang, Hao, et al.
Published: (2024)

Large Language Models for Human-like Autonomous Driving: A Survey
by: Li, Yun, et al.
Published: (2024)

MCTR: Midpoint Corrected Triangulation for Autonomous Racing via Digital Twin Simulation in CARLA
by: Ye, Junhao, et al.
Published: (2025)

Occ-LLM: Enhancing Autonomous Driving with Occupancy-Based Large Language Models
by: Xu, Tianshuo, et al.
Published: (2025)

Risk-Aware Reinforcement Learning for Autonomous Driving: Improving Safety When Driving through Intersection
by: Leng, Bo, et al.
Published: (2025)

Investigating Driving Interactions: A Robust Multi-Agent Simulation Framework for Autonomous Vehicles
by: Kaufeld, Marc, et al.
Published: (2024)

A Vehicle-in-the-Loop Simulator with AI-Powered Digital Twins for Testing Automated Driving Controllers
by: Zhang, Zengjie, et al.
Published: (2025)

CALMM-Drive: Confidence-Aware Autonomous Driving with Large Multimodal Model
by: Yao, Ruoyu, et al.
Published: (2024)

GaussTwin: Unified Simulation and Correction with Gaussian Splatting for Robotic Digital Twins
by: Cai, Yichen, et al.
Published: (2026)

A Unified Generative Framework for Realistic Lidar Simulation in Autonomous Driving Systems
by: Haghighi, Hamed, et al.
Published: (2023)

MRIC: Model-Based Reinforcement-Imitation Learning with Mixture-of-Codebooks for Autonomous Driving Simulation
by: He, Baotian, et al.
Published: (2024)

Adversarial and Reactive Traffic Entities for Behavior-Realistic Driving Simulation: A Review
by: Ransiek, Joshua, et al.
Published: (2024)

Reasoning Multi-Agent Behavioral Topology for Interactive Autonomous Driving
by: Liu, Haochen, et al.
Published: (2024)

Enhancing Autonomous Driving Systems with On-Board Deployed Large Language Models
by: Baumann, Nicolas, et al.
Published: (2025)

Motion Planning for Autonomous Vehicles: When Model Predictive Control Meets Ensemble Kalman Smoothing
by: Askari, Iman, et al.
Published: (2025)