Saved in:
Bibliographic Details
Main Authors: Kovalev, Vyacheslav, Chaikovskaia, Ekaterina, Davydenko, Egor, Gorbachev, Roman
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2508.04696
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918116187963392
author Kovalev, Vyacheslav
Chaikovskaia, Ekaterina
Davydenko, Egor
Gorbachev, Roman
author_facet Kovalev, Vyacheslav
Chaikovskaia, Ekaterina
Davydenko, Egor
Gorbachev, Roman
contents Accurate system identification is crucial for reducing trajectory drift in bipedal locomotion, particularly in reinforcement learning and model-based control. In this paper, we present a novel control framework that integrates system identification into the reinforcement learning training loop using differentiable simulation. Unlike traditional approaches that rely on direct torque measurements, our method estimates system parameters using only trajectory data (positions, velocities) and control inputs. We leverage the differentiable simulator MuJoCo-XLA to optimize system parameters, ensuring that simulated robot behavior closely aligns with real-world motion. This framework enables scalable and flexible parameter optimization. Accurate system identification is crucial for reducing trajectory drift in bipedal locomotion, particularly in reinforcement learning and model-based control. In this paper, we present a novel control framework that integrates system identification into the reinforcement learning training loop using differentiable simulation. Unlike traditional approaches that rely on direct torque measurements, our method estimates system parameters using only trajectory data (positions, velocities) and control inputs. We leverage the differentiable simulator MuJoCo-XLA to optimize system parameters, ensuring that simulated robot behavior closely aligns with real-world motion. This framework enables scalable and flexible parameter optimization. It supports fundamental physical properties such as mass and inertia. Additionally, it handles complex system nonlinear behaviors, including advanced friction models, through neural network approximations. Experimental results show that our framework significantly improves trajectory following.
format Preprint
id arxiv_https___arxiv_org_abs_2508_04696
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Achieving Precise and Reliable Locomotion with Differentiable Simulation-Based System Identification
Kovalev, Vyacheslav
Chaikovskaia, Ekaterina
Davydenko, Egor
Gorbachev, Roman
Robotics
Accurate system identification is crucial for reducing trajectory drift in bipedal locomotion, particularly in reinforcement learning and model-based control. In this paper, we present a novel control framework that integrates system identification into the reinforcement learning training loop using differentiable simulation. Unlike traditional approaches that rely on direct torque measurements, our method estimates system parameters using only trajectory data (positions, velocities) and control inputs. We leverage the differentiable simulator MuJoCo-XLA to optimize system parameters, ensuring that simulated robot behavior closely aligns with real-world motion. This framework enables scalable and flexible parameter optimization. Accurate system identification is crucial for reducing trajectory drift in bipedal locomotion, particularly in reinforcement learning and model-based control. In this paper, we present a novel control framework that integrates system identification into the reinforcement learning training loop using differentiable simulation. Unlike traditional approaches that rely on direct torque measurements, our method estimates system parameters using only trajectory data (positions, velocities) and control inputs. We leverage the differentiable simulator MuJoCo-XLA to optimize system parameters, ensuring that simulated robot behavior closely aligns with real-world motion. This framework enables scalable and flexible parameter optimization. It supports fundamental physical properties such as mass and inertia. Additionally, it handles complex system nonlinear behaviors, including advanced friction models, through neural network approximations. Experimental results show that our framework significantly improves trajectory following.
title Achieving Precise and Reliable Locomotion with Differentiable Simulation-Based System Identification
topic Robotics
url https://arxiv.org/abs/2508.04696