Denoising Diffusion-Based Control of Nonlinear Systems

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Elamvazhuthi, Karthik, Gadginmath, Darshan, Pasqualetti, Fabio
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910318510211072
author Elamvazhuthi, Karthik
Gadginmath, Darshan
Pasqualetti, Fabio
author_facet Elamvazhuthi, Karthik
Gadginmath, Darshan
Pasqualetti, Fabio
contents We propose a novel approach based on Denoising Diffusion Probabilistic Models (DDPMs) to control nonlinear dynamical systems. DDPMs are the state-of-art of generative models that have achieved success in a wide variety of sampling tasks. In our framework, we pose the feedback control problem as a generative task of drawing samples from a target set under control system constraints. The forward process of DDPMs constructs trajectories originating from a target set by adding noise. We learn to control a dynamical system in reverse such that the terminal state belongs to the target set. For control-affine systems without drift, we prove that the control system can exactly track the trajectory of the forward process in reverse, whenever the the Lie bracket based condition for controllability holds. We numerically study our approach on various nonlinear systems and verify our theoretical results. We also conduct numerical experiments for cases beyond our theoretical results on a physics-engine.
format Preprint
id arxiv_https___arxiv_org_abs_2402_02297
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Denoising Diffusion-Based Control of Nonlinear Systems
Elamvazhuthi, Karthik
Gadginmath, Darshan
Pasqualetti, Fabio
Optimization and Control
Machine Learning
Robotics
Systems and Control
We propose a novel approach based on Denoising Diffusion Probabilistic Models (DDPMs) to control nonlinear dynamical systems. DDPMs are the state-of-art of generative models that have achieved success in a wide variety of sampling tasks. In our framework, we pose the feedback control problem as a generative task of drawing samples from a target set under control system constraints. The forward process of DDPMs constructs trajectories originating from a target set by adding noise. We learn to control a dynamical system in reverse such that the terminal state belongs to the target set. For control-affine systems without drift, we prove that the control system can exactly track the trajectory of the forward process in reverse, whenever the the Lie bracket based condition for controllability holds. We numerically study our approach on various nonlinear systems and verify our theoretical results. We also conduct numerical experiments for cases beyond our theoretical results on a physics-engine.
title Denoising Diffusion-Based Control of Nonlinear Systems
topic Optimization and Control
Machine Learning
Robotics
Systems and Control
url https://arxiv.org/abs/2402.02297