Cover Image

Vid2Sim: Realistic and Interactive Simulation from Video for Urban Navigation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Xie, Ziyang, Liu, Zhizheng, Peng, Zhenghao, Wu, Wayne, Zhou, Bolei
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition Robotics
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

UrbanVerse: Scaling Urban Simulation by Watching City-Tour Videos
by: Liu, Mingxuan, et al.
Published: (2025)

MetaUrban: An Embodied AI Simulation Platform for Urban Micromobility
by: Wu, Wayne, et al.
Published: (2024)

NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigation
by: Zhang, Jiazhao, et al.
Published: (2024)

SceneStreamer: Continuous Scenario Generation as Next Token Group Prediction
by: Peng, Zhenghao, et al.
Published: (2025)

From Seeing to Experiencing: Scaling Navigation Foundation Models with Reinforcement Learning
by: He, Honglin, et al.
Published: (2025)

Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Tasks
by: Zhang, Jiazhao, et al.
Published: (2024)

Learning to Generate Diverse Pedestrian Movements from Web Videos with Noisy Labels
by: Liu, Zhizheng, et al.
Published: (2024)

Embodied Scene Understanding for Vision Language Models via MetaVQA
by: Wang, Weizhen, et al.
Published: (2025)

Towards Autonomous Micromobility through Scalable Urban Simulation
by: Wu, Wayne, et al.
Published: (2025)

Learning Sidewalk Autopilot from Multi-Scale Imitation with Corrective Behavior Expansion
by: He, Honglin, et al.
Published: (2026)

Joint Optimization for 4D Human-Scene Reconstruction in the Wild
by: Liu, Zhizheng, et al.
Published: (2025)

VLNVerse: A Benchmark for Vision-Language Navigation with Versatile, Embodied, Realistic Simulation and Evaluation
by: Lin, Sihao, et al.
Published: (2025)

SimGen: Simulator-conditioned Driving Scene Generation
by: Zhou, Yunsong, et al.
Published: (2024)

CityWalker: Learning Embodied Urban Navigation from Web-Scale Videos
by: Liu, Xinhao, et al.
Published: (2024)

Recursive Visual Imagination and Adaptive Linguistic Grounding for Vision Language Navigation
by: Chen, Bolei, et al.
Published: (2025)

Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodology
by: Wang, Xiangyu, et al.
Published: (2024)

UrbanNav: Learning Language-Guided Urban Navigation from Web-Scale Human Trajectories
by: Mei, Yanghong, et al.
Published: (2025)

FetchBot: Learning Generalizable Object Fetching in Cluttered Scenes via Zero-Shot Sim2Real
by: Liu, Weiheng, et al.
Published: (2025)

VidMan: Exploiting Implicit Dynamics from Video Diffusion Model for Effective Robot Manipulation
by: Wen, Youpeng, et al.
Published: (2024)

Agent-to-Sim: Learning Interactive Behavior Models from Casual Longitudinal Videos
by: Yang, Gengshan, et al.
Published: (2024)

KiGRAS: Kinematic-Driven Generative Model for Realistic Agent Simulation
by: Zhao, Jianbo, et al.
Published: (2024)

VidBot: Learning Generalizable 3D Actions from In-the-Wild 2D Human Videos for Zero-Shot Robotic Manipulation
by: Chen, Hanzhi, et al.
Published: (2025)

Sim-to-Real Transfer via 3D Feature Fields for Vision-and-Language Navigation
by: Wang, Zihan, et al.
Published: (2024)

HybridWorldSim: A Scalable and Controllable High-fidelity Simulator for Autonomous Driving
by: Li, Qiang, et al.
Published: (2025)

HUGSIM: A Real-Time, Photo-Realistic and Closed-Loop Simulator for Autonomous Driving
by: Zhou, Hongyu, et al.
Published: (2024)

ReSim: Reliable World Simulation for Autonomous Driving
by: Yang, Jiazhi, et al.
Published: (2025)

SeaDroneSim: Simulation of Aerial Images for Detection of Objects Above Water
by: Lin, Xiaomin, et al.
Published: (2022)

RealEngine: Simulating Autonomous Driving in Realistic Context
by: Jiang, Junzhe, et al.
Published: (2025)

Personalized Instance-based Navigation Toward User-Specific Objects in Realistic Environments
by: Barsellotti, Luca, et al.
Published: (2024)

SimScale: Learning to Drive via Real-World Simulation at Scale
by: Tian, Haochen, et al.
Published: (2025)

RoboGSim: A Real2Sim2Real Robotic Gaussian Splatting Simulator
by: Li, Xinhai, et al.
Published: (2024)

Analyzing Infrastructure LiDAR Placement with Realistic LiDAR Simulation Library
by: Cai, Xinyu, et al.
Published: (2022)

ComSim: Building Scalable Real-World Robot Data Generation via Compositional Simulation
by: Qin, Yiran, et al.
Published: (2026)

VR-Robo: A Real-to-Sim-to-Real Framework for Visual Robot Navigation and Locomotion
by: Zhu, Shaoting, et al.
Published: (2025)

EmbodiedSplat: Personalized Real-to-Sim-to-Real Navigation with Gaussian Splats from a Mobile Device
by: Chhablani, Gunjan, et al.
Published: (2025)

DOT-Sim: Differentiable Optical Tactile Simulation with Precise Real-to-Sim Physical Calibration
by: You, Yang, et al.
Published: (2026)

SymDrive: Realistic and Controllable Driving Simulator via Symmetric Auto-regressive Online Restoration
by: Liu, Zhiyuan, et al.
Published: (2025)

MM-Nav: Multi-View VLA Model for Robust Visual Navigation via Multi-Expert Learning
by: Xu, Tianyu, et al.
Published: (2025)

Habitat-GS: A High-Fidelity Navigation Simulator with Dynamic Gaussian Splatting
by: Xia, Ziyuan, et al.
Published: (2026)

QuasiSim: Parameterized Quasi-Physical Simulators for Dexterous Manipulations Transfer
by: Liu, Xueyi, et al.
Published: (2024)