Simulation Priors for Data-Efficient Deep Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Treven, Lenart, Sukhija, Bhavya, Rothfuss, Jonas, Coros, Stelian, Dörfler, Florian, Krause, Andreas
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912574581243904
author Treven, Lenart
Sukhija, Bhavya
Rothfuss, Jonas
Coros, Stelian
Dörfler, Florian
Krause, Andreas
author_facet Treven, Lenart
Sukhija, Bhavya
Rothfuss, Jonas
Coros, Stelian
Dörfler, Florian
Krause, Andreas
contents How do we enable AI systems to efficiently learn in the real-world? First-principles models are widely used to simulate natural systems, but often fail to capture real-world complexity due to simplifying assumptions. In contrast, deep learning approaches can estimate complex dynamics with minimal assumptions but require large, representative datasets. We propose SimPEL, a method that efficiently combines first-principles models with data-driven learning by using low-fidelity simulators as priors in Bayesian deep learning. This enables SimPEL to benefit from simulator knowledge in low-data regimes and leverage deep learning's flexibility when more data is available, all the while carefully quantifying epistemic uncertainty. We evaluate SimPEL on diverse systems, including biological, agricultural, and robotic domains, showing superior performance in learning complex dynamics. For decision-making, we demonstrate that SimPEL bridges the sim-to-real gap in model-based reinforcement learning. On a high-speed RC car task, SimPEL learns a highly dynamic parking maneuver involving drifting with substantially less data than state-of-the-art baselines. These results highlight the potential of SimPEL for data-efficient learning and control in complex real-world environments.
format Preprint
id arxiv_https___arxiv_org_abs_2509_05732
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Simulation Priors for Data-Efficient Deep Learning
Treven, Lenart
Sukhija, Bhavya
Rothfuss, Jonas
Coros, Stelian
Dörfler, Florian
Krause, Andreas
Machine Learning
Artificial Intelligence
How do we enable AI systems to efficiently learn in the real-world? First-principles models are widely used to simulate natural systems, but often fail to capture real-world complexity due to simplifying assumptions. In contrast, deep learning approaches can estimate complex dynamics with minimal assumptions but require large, representative datasets. We propose SimPEL, a method that efficiently combines first-principles models with data-driven learning by using low-fidelity simulators as priors in Bayesian deep learning. This enables SimPEL to benefit from simulator knowledge in low-data regimes and leverage deep learning's flexibility when more data is available, all the while carefully quantifying epistemic uncertainty. We evaluate SimPEL on diverse systems, including biological, agricultural, and robotic domains, showing superior performance in learning complex dynamics. For decision-making, we demonstrate that SimPEL bridges the sim-to-real gap in model-based reinforcement learning. On a high-speed RC car task, SimPEL learns a highly dynamic parking maneuver involving drifting with substantially less data than state-of-the-art baselines. These results highlight the potential of SimPEL for data-efficient learning and control in complex real-world environments.
title Simulation Priors for Data-Efficient Deep Learning
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2509.05732