Transformers As Generalizable Optimal Controllers

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Mohaya, Turki Bin, AL-Sunni, Maitham F., Dolan, John M., Seiler, Peter
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912967783612416
author Mohaya, Turki Bin
AL-Sunni, Maitham F.
Dolan, John M.
Seiler, Peter
author_facet Mohaya, Turki Bin
AL-Sunni, Maitham F.
Dolan, John M.
Seiler, Peter
contents We study whether optimal state-feedback laws for a family of heterogeneous Multiple-Input, Multiple-Output (MIMO) Linear Time-Invariant (LTI) systems can be captured by a single learned controller. We train one transformer policy on LQR-generated trajectories from systems with different state and input dimensions, using a shared representation with standardization, padding, dimension encoding, and masked loss. The policy maps recent state history to control actions without requiring plant matrices at inference time. Across a broad set of systems, it achieves empirically small sub-optimality relative to Linear Quadratic Regulator (LQR), remains stabilizing under moderate parameter perturbations, and benefits from lightweight fine-tuning on unseen systems. These results support transformer policies as practical approximators of near-optimal feedback laws over structured linear-system families.
format Preprint
id arxiv_https___arxiv_org_abs_2603_14910
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Transformers As Generalizable Optimal Controllers
Mohaya, Turki Bin
AL-Sunni, Maitham F.
Dolan, John M.
Seiler, Peter
Systems and Control
Robotics
We study whether optimal state-feedback laws for a family of heterogeneous Multiple-Input, Multiple-Output (MIMO) Linear Time-Invariant (LTI) systems can be captured by a single learned controller. We train one transformer policy on LQR-generated trajectories from systems with different state and input dimensions, using a shared representation with standardization, padding, dimension encoding, and masked loss. The policy maps recent state history to control actions without requiring plant matrices at inference time. Across a broad set of systems, it achieves empirically small sub-optimality relative to Linear Quadratic Regulator (LQR), remains stabilizing under moderate parameter perturbations, and benefits from lightweight fine-tuning on unseen systems. These results support transformer policies as practical approximators of near-optimal feedback laws over structured linear-system families.
title Transformers As Generalizable Optimal Controllers
topic Systems and Control
Robotics
url https://arxiv.org/abs/2603.14910