Imagen de Portada

Understanding the differences in Foundation Models: Attention, State Space Models, and Recurrent Neural Networks

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Sieber, Jerome, Alonso, Carmen Amo, Didier, Alexandre, Zeilinger, Melanie N., Orvieto, Antonio
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Artificial Intelligence Systems and Control
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

State Space Models as Foundation Models: A Control Theoretic Overview
por: Alonso, Carmen Amo, et al.
Publicado: (2024)

Design Principles for Sequence Models via Coefficient Dynamics
por: Sieber, Jerome, et al.
Publicado: (2025)

Computationally Efficient System Level Tube-MPC for Uncertain Systems
por: Sieber, Jerome, et al.
Publicado: (2024)

Task-Level Insights from Eigenvalues across Sequence Models
por: Rickenbach, Rahel, et al.
Publicado: (2025)

Stochastic MPC with Online-optimized Policies and Closed-loop Guarantees
por: Bartos, Marcell, et al.
Publicado: (2025)

Approximate predictive control barrier function for discrete-time systems
por: Didier, Alexandre, et al.
Publicado: (2024)

A multiobjective approach to robust predictive control barrier functions for discrete-time systems
por: Didier, Alexandre, et al.
Publicado: (2025)

DEMONSTRATE: Zero-shot Language to Robotic Control via Multi-task Demonstration Learning
por: Rickenbach, Rahel, et al.
Publicado: (2025)

Predictive stability filters for nonlinear dynamical systems affected by disturbances
por: Didier, Alexandre, et al.
Publicado: (2024)

Moving Horizon Estimation for Simultaneous Localization and Mapping with Robust Estimation Error Bounds
por: Trisovic, Jelena, et al.
Publicado: (2024)

Distributed Predictive Control Barrier Functions: Towards Scalable Safety Certification in Modular Multi-Agent Systems
por: Ohnemus, Jonas, et al.
Publicado: (2026)

Predictive control for nonlinear stochastic systems: Closed-loop guarantees with unbounded noise
por: Köhler, Johannes, et al.
Publicado: (2024)

A model predictive control framework with robust stability guarantees under unbounded disturbances
por: Köhler, Johannes, et al.
Publicado: (2022)

Naga: Vedic Encoding for Deep State Space Models
por: Schaller, Melanie, et al.
Publicado: (2025)

On the role of the signature transform in nonlinear systems and data-driven control
por: Scampicchio, Anna, et al.
Publicado: (2024)

GenCtrl -- A Formal Controllability Toolkit for Generative Models
por: Cheng, Emily, et al.
Publicado: (2026)

Identification For Control Based on Neural Networks: Approximately Linearizable Models
por: Thieffry, Maxime, et al.
Publicado: (2024)

Unifying Sequential Quadratic Programming and Linear-Parameter-Varying Algorithms for Real-Time Model Predictive Control
por: Floch, Kristóf, et al.
Publicado: (2025)

Physics-Informed Recurrent Network for State-Space Modeling of Gas Pipeline Networks
por: Wang, Siyuan, et al.
Publicado: (2025)

Stable-by-Design Neural Network-Based LPV State-Space Models for System Identification
por: Sertbaş, Ahmet Eren, et al.
Publicado: (2025)

Adaptive Economic Model Predictive Control for linear systems with performance guarantees
por: Degner, Maximilian, et al.
Publicado: (2024)

Adaptive Economic Model Predictive Control: Performance Guarantees for Nonlinear Systems
por: Degner, Maximilian, et al.
Publicado: (2024)

Recurrent neural networks: vanishing and exploding gradients are not the end of the story
por: Zucchet, Nicolas, et al.
Publicado: (2024)

Active Learning-based Model Predictive Coverage Control
por: Rickenbach, Rahel, et al.
Publicado: (2023)

Bilevel MPC for Linear Systems: A Tractable Reduction and Continuous Connection to Hierarchical MPC
por: Moriyasu, Ryuta, et al.
Publicado: (2026)

MHE under parametric uncertainty -- Robust state estimation without informative data
por: Muntwiler, Simon, et al.
Publicado: (2023)

Nonlinear Functional Estimation: Functional Detectability and Full Information Estimation
por: Muntwiler, Simon, et al.
Publicado: (2023)

Inverse Optimal Control with Constraint Relaxation
por: Rickenbach, Rahel, et al.
Publicado: (2025)

Learning-based Approximate Model Predictive Control for an Impact Wrench Tool
por: Benazet, Mark, et al.
Publicado: (2025)

System Level Synthesis for Affine Control Policies: Model Based and Data-Driven Settings
por: Schüepp, Lukas, et al.
Publicado: (2025)

Linearly Controlled Language Generation with Performative Guarantees
por: Cheng, Emily, et al.
Publicado: (2024)

Statistically Consistent Approximate Model Predictive Control
por: Milios, Elias, et al.
Publicado: (2025)

A Stiffness-Oriented Model Order Reduction Method for Low-Inertia Power Systems
por: Muntwiler, Simon, et al.
Publicado: (2023)

Robust reduced-order model predictive control using peak-to-peak analysis of filtered signals
por: Köhler, Johannes, et al.
Publicado: (2025)

Real-Time Online Learning for Model Predictive Control using a Spatio-Temporal Gaussian Process Approximation
por: Bartels, Lars, et al.
Publicado: (2026)

Guaranteed Robust Nonlinear MPC via Disturbance Feedback
por: Leeman, Antoine P., et al.
Publicado: (2025)

Uncertainty-Aware Perception-Based Control for Autonomous Racing
por: Trisovic, Jelena, et al.
Publicado: (2025)

Stability of Certainty-Equivalent Adaptive LQR for Linear Systems with Unknown Time-Varying Parameters
por: Bartos, Marcell, et al.
Publicado: (2025)

Stochastic Data-Driven Predictive Control: Chance-Constraint Satisfaction with Identified Multi-step Predictors
por: Balim, Haldun, et al.
Publicado: (2024)

From Data to Predictive Control: A Framework for Stochastic Linear Systems with Output Measurements
por: Balim, Haldun, et al.
Publicado: (2024)