Cover Image

Rough Transformers for Continuous and Efficient Time-Series Modelling

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Moreno-Pino, Fernando, Arroyo, Álvaro, Waldon, Harrison, Dong, Xiaowen, Cartea, Álvaro
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Rough Transformers: Lightweight and Continuous Time Series Modelling through Signature Patching
by: Moreno-Pino, Fernando, et al.
Published: (2024)

gLSTM: Mitigating Over-Squashing by Increasing Storage Capacity
by: Blayney, Hugh, et al.
Published: (2025)

ContiFormer: Continuous-Time Transformer for Irregular Time Series Modeling
by: Chen, Yuqi, et al.
Published: (2024)

A Mechanistic Analysis of Looped Reasoning Language Models
by: Blayney, Hugh, et al.
Published: (2026)

On Vanishing Gradients, Over-Smoothing, and Over-Squashing in GNNs: Bridging Recurrent and Graph Learning
by: Arroyo, Álvaro, et al.
Published: (2025)

AutoHFormer: Efficient Hierarchical Autoregressive Transformer for Time Series Prediction
by: Zhang, Qianru, et al.
Published: (2025)

HTMformer: Hybrid Time and Multivariate Transformer for Time Series Forecasting
by: Wang, Tan, et al.
Published: (2025)

Attention Sinks and Compression Valleys in LLMs are Two Sides of the Same Coin
by: Queipo-de-Llano, Enrique, et al.
Published: (2025)

Ister: Linear Transformer for Efficient Multivariate Time Series Forecasting
by: Cao, Fanpu, et al.
Published: (2024)

Transformers and Their Roles as Time Series Foundation Models
by: Wu, Dennis, et al.
Published: (2025)

TimeXer: Empowering Transformers for Time Series Forecasting with Exogenous Variables
by: Wang, Yuxuan, et al.
Published: (2024)

Continuity and Ordinality Matter: Constraining Time Series Tokens for Effective Time Series Analysis with Large Language Models
by: Li, Musheng, et al.
Published: (2026)

TimeDiT: General-purpose Diffusion Transformers for Time Series Foundation Model
by: Cao, Defu, et al.
Published: (2024)

Generative Modeling of Networked Time-Series via Transformer Architectures
by: Elnady, Yusuf
Published: (2025)

Distilling Time Series Foundation Models for Efficient Forecasting
by: Li, Yuqi, et al.
Published: (2026)

ReCycle: Fast and Efficient Long Time Series Forecasting with Residual Cyclic Transformers
by: Weyrauch, Arvid, et al.
Published: (2024)

Energy-Efficient Transformer Inference: Optimization Strategies for Time Series Classification
by: Kermani, Arshia, et al.
Published: (2025)

Time Series Continuous Modeling for Imputation and Forecasting with Implicit Neural Representations
by: Naour, Etienne Le, et al.
Published: (2023)

NeuTSFlow: Modeling Continuous Functions Behind Time Series Forecasting
by: Xu, Huibo, et al.
Published: (2025)

DSAT-HD: Dual-Stream Adaptive Transformer with Hybrid Decomposition for Multivariate Time Series Forecasting
by: Wang, Zixu, et al.
Published: (2025)

STDiff: A State Transition Diffusion Framework for Time Series Imputation in Industrial Systems
by: Simethy, Gary, et al.
Published: (2025)

Continuous Mixtures of Tractable Probabilistic Models
by: Correia, Alvaro H. C., et al.
Published: (2022)

Time Series Modeling for Heart Rate Prediction: From ARIMA to Transformers
by: Ni, Haowei, et al.
Published: (2024)

Toto: Time Series Optimized Transformer for Observability
by: Cohen, Ben, et al.
Published: (2024)

VARMA-Enhanced Transformer for Time Series Forecasting
by: Song, Jiajun, et al.
Published: (2025)

An Efficient Continual Learning Framework for Multivariate Time Series Prediction Tasks with Application to Vehicle State Estimation
by: Hosseinzadeh, Arvin, et al.
Published: (2025)

Continuous-Time Linear Positional Embedding for Irregular Time Series Forecasting
by: Kim, Byunghyun, et al.
Published: (2024)

Reverso: Efficient Time Series Foundation Models for Zero-shot Forecasting
by: Fu, Xinghong, et al.
Published: (2026)

k-Maximum Inner Product Attention for Graph Transformers and the Expressive Power of GraphGPS
by: De Schouwer, Jonas, et al.
Published: (2026)

A Survey of Transformer Enabled Time Series Synthesis
by: Sommers, Alexander, et al.
Published: (2024)

Fredformer: Frequency Debiased Transformer for Time Series Forecasting
by: Piao, Xihao, et al.
Published: (2024)

LATST: Are Transformers Necessarily Complex for Time-Series Forecasting
by: Liang, Dizhen
Published: (2024)

Unified Training of Universal Time Series Forecasting Transformers
by: Woo, Gerald, et al.
Published: (2024)

Recent Trends in Modelling the Continuous Time Series using Deep Learning: A Survey
by: Habiba, Mansura, et al.
Published: (2024)

CITRAS: Covariate-Informed Transformer for Time Series Forecasting
by: Yamaguchi, Yosuke, et al.
Published: (2025)

Diffusion Transformers for Tabular Data Time Series Generation
by: Garuti, Fabrizio, et al.
Published: (2025)

Mechanistic Interpretability for Transformer-based Time Series Classification
by: Kalnāre, Matīss, et al.
Published: (2025)

Neural Predictive Control to Coordinate Discrete- and Continuous-Time Models for Time-Series Analysis with Control-Theoretical Improvements
by: Li, Haoran, et al.
Published: (2025)

A Unified Hyperparameter Optimization Pipeline for Transformer-Based Time Series Forecasting Models
by: Xu, Jingjing, et al.
Published: (2025)

A Self-Supervised Transformer for Unusable Shared Bike Detection
by: Huang, Yin, et al.
Published: (2025)