Cover Image

HiPPO-Prophecy: State-Space Models can Provably Learn Dynamical Systems in Context

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Joseph, Federico Arangath, Haefeli, Kilian Konstantin, Liniger, Noah, Gulcehre, Caglar
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

HiPPO Zoo: Explicit Memory Mechanisms for Interpretable State Space Models
by: Goffinet, Jack, et al.
Published: (2026)

Numerical Analysis of HiPPO-LegS ODE for Deep State Space Models
by: Park, Jaesung R., et al.
Published: (2024)

HiBBO: HiPPO-based Space Consistency for High-dimensional Bayesian Optimisation
by: Xuan, Junyu, et al.
Published: (2025)

HiPPO-KAN: Efficient KAN Model for Time Series Analysis
by: Lee, SangJong, et al.
Published: (2024)

Geometric Active Exploration in Markov Decision Processes: the Benefit of Abstraction
by: De Santi, Riccardo, et al.
Published: (2024)

No Representation, No Trust: Connecting Representation, Collapse, and Trust Issues in PPO
by: Moalla, Skander, et al.
Published: (2024)

BlockGen: Flexible Blockwise Sequence Modeling with Hybrid Samplers
by: Deschenaux, Justin, et al.
Published: (2026)

UnHiPPO: Uncertainty-aware Initialization for State Space Models
by: Lienen, Marten, et al.
Published: (2025)

In Search for Architectures and Loss Functions in Multi-Objective Reinforcement Learning
by: Terekhov, Mikhail, et al.
Published: (2024)

Augmenting Attention with Exponentially Decaying Memory Improves Query-Aware KV Sparsity
by: Wei, Xiuying, et al.
Published: (2026)

RAT+: Train Dense, Infer Sparse -- Recurrence Augmented Attention for Dilated Inference
by: Wei, Xiuying, et al.
Published: (2026)

Partition Generative Modeling: Masked Modeling Without Masks
by: Deschenaux, Justin, et al.
Published: (2025)

Beyond Autoregression: Fast LLMs via Self-Distillation Through Time
by: Deschenaux, Justin, et al.
Published: (2024)

The Role of Deep Learning Regularizations on Actors in Offline RL
by: Tarasov, Denis, et al.
Published: (2024)

Quantile Reward Policy Optimization: Alignment with Pointwise Regression and Exact Partition Functions
by: Matrenok, Simon, et al.
Published: (2025)

The Diffusion Duality, Chapter II: $Ψ$-Samplers
by: Deschenaux, Justin, et al.
Published: (2026)

Lambda-Skip Connections: the architectural component that prevents Rank Collapse
by: Joseph, Federico Arangath, et al.
Published: (2024)

State Space Models are Provably Comparable to Transformers in Dynamic Token Selection
by: Nishikawa, Naoki, et al.
Published: (2024)

HiPPO: Exploring A Novel Hierarchical Pronunciation Assessment Approach for Spoken Languages
by: Yan, Bi-Cheng, et al.
Published: (2025)

Loopholing Discrete Diffusion: Deterministic Bypass of the Sampling Wall
by: Jo, Mingyu, et al.
Published: (2025)

From Markov to Laplace: How Mamba In-Context Learns Markov Chains
by: Bondaschi, Marco, et al.
Published: (2025)

Simple Hierarchical Planning with Diffusion
by: Chen, Chang, et al.
Published: (2024)

Control Tax: The Price of Keeping AI in Check
by: Terekhov, Mikhail, et al.
Published: (2025)

Learning to Dissipate Energy in Oscillatory State-Space Models
by: Boyer, Jared, et al.
Published: (2025)

Regret-Optimized Portfolio Enhancement through Deep Reinforcement Learning and Future Looking Rewards
by: Karzanov, Daniil, et al.
Published: (2025)

Self-Recognition in Language Models
by: Davidson, Tim R., et al.
Published: (2024)

Universality of Linear Recurrences Followed by Non-linear Projections: Finite-Width Guarantees and Benefits of Complex Eigenvalues
by: Orvieto, Antonio, et al.
Published: (2023)

Oscillatory State-Space Models
by: Rusch, T. Konstantin, et al.
Published: (2024)

PlanDQ: Hierarchical Plan Orchestration via D-Conductor and Q-Performer
by: Chen, Chang, et al.
Published: (2024)

t-SNE Exaggerates Clusters, Provably
by: Bergam, Noah, et al.
Published: (2025)

Provable In-Context Learning of Nonlinear Regression with Transformers
by: Li, Hongbo, et al.
Published: (2025)

Towards Provable Emergence of In-Context Reinforcement Learning
by: Wang, Jiuqi, et al.
Published: (2025)

Fleet of Agents: Coordinated Problem Solving with Large Language Models
by: Klein, Lars, et al.
Published: (2024)

Provable Low-Frequency Bias of In-Context Learning of Representations
by: Yang, Yongyi, et al.
Published: (2025)

Prophecy: Inferring Formal Properties from Neuron Activations
by: Gopinath, Divya, et al.
Published: (2025)

Provably Learning from Modern Language Models via Low Logit Rank
by: Golowich, Noah, et al.
Published: (2025)

Unlabeled Data Can Provably Enhance In-Context Learning of Transformers
by: Liu, Renpu, et al.
Published: (2026)

Provable Benefits of Complex Parameterizations for Structured State Space Models
by: Ran-Milo, Yuval, et al.
Published: (2024)

Hi-DARTS: Hierarchical Dynamically Adapting Reinforcement Trading System
by: Sagong, Hoon, et al.
Published: (2025)

Directional-Clamp PPO
by: Karpel, Gilad, et al.
Published: (2025)