SaFARi: State-Space Models for Frame-Agnostic Representation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Babaei, Hossein, White, Mel, Alemohammad, Sina, Baraniuk, Richard G.
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910942083678208
author Babaei, Hossein
White, Mel
Alemohammad, Sina
Baraniuk, Richard G.
author_facet Babaei, Hossein
White, Mel
Alemohammad, Sina
Baraniuk, Richard G.
contents State-Space Models (SSMs) have re-emerged as a powerful tool for online function approximation, and as the backbone of machine learning models for long-range dependent data. However, to date, only a few polynomial bases have been explored for this purpose, and the state-of-the-art implementations were built upon the best of a few limited options. In this paper, we present a generalized method for building an SSM with any frame or basis, rather than being restricted to polynomials. This framework encompasses the approach known as HiPPO, but also permits an infinite diversity of other possible "species" within the SSM architecture. We dub this approach SaFARi: SSMs for Frame-Agnostic Representation.
format Preprint
id arxiv_https___arxiv_org_abs_2505_08977
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle SaFARi: State-Space Models for Frame-Agnostic Representation
Babaei, Hossein
White, Mel
Alemohammad, Sina
Baraniuk, Richard G.
Machine Learning
Audio and Speech Processing
Image and Video Processing
Signal Processing
State-Space Models (SSMs) have re-emerged as a powerful tool for online function approximation, and as the backbone of machine learning models for long-range dependent data. However, to date, only a few polynomial bases have been explored for this purpose, and the state-of-the-art implementations were built upon the best of a few limited options. In this paper, we present a generalized method for building an SSM with any frame or basis, rather than being restricted to polynomials. This framework encompasses the approach known as HiPPO, but also permits an infinite diversity of other possible "species" within the SSM architecture. We dub this approach SaFARi: SSMs for Frame-Agnostic Representation.
title SaFARi: State-Space Models for Frame-Agnostic Representation
topic Machine Learning
Audio and Speech Processing
Image and Video Processing
Signal Processing
url https://arxiv.org/abs/2505.08977