Learning optimal controllers: a dynamical motion primitive approach

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kussaba, Hugo T. M., Swikir, Abdalla, Wu, Fan, Demerdjieva, Anastasija, Kutyniok, Gitta, Haddadin, Sami
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911957514190848
author Kussaba, Hugo T. M.
Swikir, Abdalla
Wu, Fan
Demerdjieva, Anastasija
Kutyniok, Gitta
Haddadin, Sami
author_facet Kussaba, Hugo T. M.
Swikir, Abdalla
Wu, Fan
Demerdjieva, Anastasija
Kutyniok, Gitta
Haddadin, Sami
contents Real-time computation of optimal control is a challenging problem and, to solve this difficulty, many frameworks proposed to use learning techniques to learn (possibly sub-optimal) controllers and enable their usage in an online fashion. Among these techniques, the optimal motion framework is a simple, yet powerful technique, that obtained success in many complex real-world applications. The main idea of this approach is to take advantage of dynamic motion primitives, a widely used tool in robotics to learn trajectories from demonstrations. While usually these demonstrations come from humans, the optimal motion framework is based on demonstrations coming from optimal solutions, such as the ones obtained by numeric solvers. As usual in many learning techniques, a drawback of this approach is that it is hard to estimate the suboptimality of learned solutions, since finding easily computable and non-trivial upper bounds to the error between an optimal solution and a learned solution is, in general, unfeasible. However, we show in this paper that it is possible to estimate this error for a broad class of problems. Furthermore, we apply this estimation technique to achieve a novel and more efficient sampling scheme to be used within the optimal motion framework, enabling the usage of this framework in some scenarios where the computational resources are limited.
format Preprint
id arxiv_https___arxiv_org_abs_2306_06520
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Learning optimal controllers: a dynamical motion primitive approach
Kussaba, Hugo T. M.
Swikir, Abdalla
Wu, Fan
Demerdjieva, Anastasija
Kutyniok, Gitta
Haddadin, Sami
Robotics
Optimization and Control
Real-time computation of optimal control is a challenging problem and, to solve this difficulty, many frameworks proposed to use learning techniques to learn (possibly sub-optimal) controllers and enable their usage in an online fashion. Among these techniques, the optimal motion framework is a simple, yet powerful technique, that obtained success in many complex real-world applications. The main idea of this approach is to take advantage of dynamic motion primitives, a widely used tool in robotics to learn trajectories from demonstrations. While usually these demonstrations come from humans, the optimal motion framework is based on demonstrations coming from optimal solutions, such as the ones obtained by numeric solvers. As usual in many learning techniques, a drawback of this approach is that it is hard to estimate the suboptimality of learned solutions, since finding easily computable and non-trivial upper bounds to the error between an optimal solution and a learned solution is, in general, unfeasible. However, we show in this paper that it is possible to estimate this error for a broad class of problems. Furthermore, we apply this estimation technique to achieve a novel and more efficient sampling scheme to be used within the optimal motion framework, enabling the usage of this framework in some scenarios where the computational resources are limited.
title Learning optimal controllers: a dynamical motion primitive approach
topic Robotics
Optimization and Control
url https://arxiv.org/abs/2306.06520