Cover Image

SimBench: A Framework for Evaluating and Diagnosing LLM-Based Digital-Twin Generation for Multi-Physics Simulation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wang, Jingquan, Negrut, Andrew, Wang, Hongyu, Zhang, Harry, Negrut, Dan
Format:	Preprint
Published:	2024
Subjects:	Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

ChronoLLM: Customizing Language Models for Physics-Based Simulation Code Generation
by: Wang, Jingquan, et al.
Published: (2025)

ChronoLLM: A Framework for Customizing Large Language Model for Digital Twins generalization based on PyChrono
by: Wang, Jingquan, et al.
Published: (2025)

Coding Agent Is Good As World Simulator
by: Wang, Hongyu, et al.
Published: (2026)

ChronoDreamer: Action-Conditioned World Model as an Online Simulator for Robotic Planning
by: Zhou, Zhenhao, et al.
Published: (2025)

FNODE: Flow-Matching for data-driven simulation of constrained multibody systems
by: Wang, Hongyu, et al.
Published: (2025)

Active Learning for Communication Structure Optimization in LLM-Based Multi-Agent Systems
by: Yang, Huchen, et al.
Published: (2026)

SimBench: Benchmarking the Ability of Large Language Models to Simulate Human Behaviors
by: Hu, Tiancheng, et al.
Published: (2025)

POLAR-Sim: Augmenting NASA's POLAR Dataset for Data-Driven Lunar Perception and Rover Simulation
by: Chen, Bo-Hsun, et al.
Published: (2023)

Instance Performance Difference: A Metric to Measure the Sim-To-Real Gap in Camera Simulation
by: Chen, Bo-Hsun, et al.
Published: (2024)

Chrono::Ray: A Distributed Framework for High-Throughput Simulation-Based Analysis of Multibody Systems
by: Slaton, Khailanii, et al.
Published: (2026)

EnvSimBench: A Benchmark for Evaluating and Improving LLM-Based Environment Simulation
by: Liu, Yi, et al.
Published: (2026)

MBD-NODE: Physics-informed data-driven modeling and simulation of constrained multibody systems
by: Wang, Jingquan, et al.
Published: (2024)

Chrono-Gymnasium: An Open-Source, Gymnasium-Compatible Distributed Simulation Framework
by: Zou, Bocheng, et al.
Published: (2026)

DiffPhysCam: Differentiable Physics-Based Camera Simulation for Inverse Rendering and Embodied AI
by: Chen, Bo-Hsun, et al.
Published: (2025)

A Total Lagrangian Finite Element Framework for Multibody Dynamics: Part I -- Formulation
by: Zhou, Zhenhao, et al.
Published: (2026)

Real-is-Sim: Bridging the Sim-to-Real Gap with a Dynamic Digital Twin
by: Abou-Chakra, Jad, et al.
Published: (2025)

A Physics-Based Continuum Model for Versatile, Scalable, and Fast Terramechanics Simulation
by: Unjhawala, Huzaifa, et al.
Published: (2025)

MicroSims: A Framework for AI-Generated, Scalable Educational Simulations with Universal Embedding and Adaptive Learning Support
by: Lockhart, Valerie, et al.
Published: (2025)

LLM-Augmented Digital Twin for Policy Evaluation in Short-Video Platforms
by: Zhang, Haoting, et al.
Published: (2026)

Elder-Sim: A Psychometrically Validated Platform for Personality-Stable Elderly Digital Twins
by: Wang, Jiaqing, et al.
Published: (2026)

VGA-Bench: A Unified Benchmark and Multi-Model Framework for Video Aesthetics and Generation Quality Evaluation
by: Jiang, Longteng, et al.
Published: (2026)

MAGIS: LLM-Based Multi-Agent Framework for GitHub Issue Resolution
by: Tao, Wei, et al.
Published: (2024)

A Total Lagrangian Finite Element Framework for Multibody Dynamics: Part II -- GPU Implementation and Numerical Experiments
by: Zhou, Zhenhao, et al.
Published: (2026)

The Digital Twin Counterfactual Framework: A Validation Architecture for Simulated Potential Outcomes
by: Laudy, Olav
Published: (2026)

MemSim: A Bayesian Simulator for Evaluating Memory of LLM-based Personal Assistants
by: Zhang, Zeyu, et al.
Published: (2024)

Poster: SpiderSim: Multi-Agent Driven Theoretical Cybersecurity Simulation for Industrial Digitalization
by: Li, Jiaqi, et al.
Published: (2025)

ClawsBench: Evaluating Capability and Safety of LLM Productivity Agents in Simulated Workspaces
by: Li, Xiangyi, et al.
Published: (2026)

TwinLoop: Simulation-in-the-Loop Digital Twins for Online Multi-Agent Reinforcement Learning
by: Zhang, Nan, et al.
Published: (2026)

Psychometric Comparability of LLM-Based Digital Twins
by: Zhang, Yufei, et al.
Published: (2025)

LLMRouterBench: A Massive Benchmark and Unified Framework for LLM Routing
by: Li, Hao, et al.
Published: (2026)

Artificial Intelligence for Modeling & Simulation in Digital Twins
by: Zech, Philipp, et al.
Published: (2026)

SYN-DIGITS: A Synthetic Control Framework for Calibrated Digital Twin Simulation
by: Fan, Grace Jiarui, et al.
Published: (2026)

An Intelligent Fault Diagnosis Method for General Aviation Aircraft Based on Multi-Fidelity Digital Twin and FMEA Knowledge Enhancement
by: Wei, Zhihuan, et al.
Published: (2026)

TERMS-Bench: Diagnosing LLM Negotiation Agents Beyond Deal Rate
by: Zhang, Erica, et al.
Published: (2026)

Marrying Generative Model of Healthcare Events with Digital Twin of Social Determinants of Health for Disease Reasoning
by: Wei, Ziquan, et al.
Published: (2026)

Hybrid Modeling, Sim-to-Real Reinforcement Learning, and Large Language Model Driven Control for Digital Twins
by: Rasheed, Adil, et al.
Published: (2025)

WebGen-V Bench: Structured Representation for Enhancing Visual Design in LLM-based Web Generation and Evaluation
by: Wang, Kuang-Da, et al.
Published: (2025)

SemBench: A Universal Semantic Framework for LLM Evaluation
by: Zubillaga, Mikel, et al.
Published: (2026)

A Digital Twin Framework for Metamorphic Testing of Autonomous Driving Systems Using Generative Model
by: Zhang, Tony, et al.
Published: (2025)

PolySim: Bridging the Sim-to-Real Gap for Humanoid Control via Multi-Simulator Dynamics Randomization
by: Lei, Zixing, et al.
Published: (2025)