Cover Image

Temporal Task Diversity: Inductive Biases Under Non-Stationarity in Synthetic Sequence Modelling

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Aswadi, Afiq Abdillah Effiezal, Britton, Oliver, Baker, Ross, Farrugia-Roberts, Matthew
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Structure and Scale in Simplicial Sequence Modelling
by: Farrugia-Roberts, Matthew
Published: (2026)

Proximity to Losslessly Compressible Parameters
by: Farrugia-Roberts, Matthew
Published: (2023)

Architectural and Inferential Inductive Biases For Exchangeable Sequence Modeling
by: Mittal, Daksh, et al.
Published: (2025)

Language Models Need Inductive Biases to Count Inductively
by: Chang, Yingshan, et al.
Published: (2024)

Adaptive World Models: Learning Behaviors by Latent Imagination Under Non-Stationarity
by: Gospodinov, Emiliyan, et al.
Published: (2024)

The Good, The Efficient and the Inductive Biases: Exploring Efficiency in Deep Learning Through the Use of Inductive Biases
by: Romero, David W.
Published: (2024)

Incorporating Inductive Biases to Energy-based Generative Models
by: Li, Yukun, et al.
Published: (2025)

Instilling Inductive Biases with Subnetworks
by: Zhang, Enyan, et al.
Published: (2023)

Dynamics of Transient Structure in In-Context Linear Regression Transformers
by: Carroll, Liam, et al.
Published: (2025)

Priors in Time: Missing Inductive Biases for Language Model Interpretability
by: Lubana, Ekdeep Singh, et al.
Published: (2025)

Object-Centric Temporal Consistency via Conditional Autoregressive Inductive Biases
by: Meo, Cristian, et al.
Published: (2024)

Transformers Are Born Biased: Structural Inductive Biases at Random Initialization and Their Practical Consequences
by: Li, Siquan, et al.
Published: (2026)

How Well Can a Long Sequence Model Model Long Sequences? Comparing Architechtural Inductive Biases on Long-Context Abilities
by: Huang, Jerry
Published: (2024)

Characterising the Inductive Biases of Neural Networks on Boolean Data
by: Mingard, Chris, et al.
Published: (2025)

Theoretical Analysis of Inductive Biases in Deep Convolutional Networks
by: Wang, Zihao, et al.
Published: (2023)

Character-level Tokenizations as Powerful Inductive Biases for RNA Foundational Models
by: Morales-Pastor, Adrián, et al.
Published: (2024)

Non-Stationarity in the Embedding Space of Time Series Foundation Models
by: Choi, Jinmyeong, et al.
Published: (2026)

Stagewise Reinforcement Learning and the Geometry of the Regret Landscape
by: Elliott, Chris, et al.
Published: (2026)

Clustering Inductive Biases with Unrolled Networks
by: Huml, Jonathan, et al.
Published: (2023)

Customizing the Inductive Biases of Softmax Attention using Structured Matrices
by: Kuang, Yilun, et al.
Published: (2025)

Geometric Inductive Biases of Deep Networks: The Role of Data and Architecture
by: Movahedi, Sajad, et al.
Published: (2024)

Enhancing the Inductive Biases of Graph Neural ODE for Modeling Dynamical Systems
by: Bishnoi, Suresh, et al.
Published: (2022)

Inductive Spatial Temporal Prediction Under Data Drift with Informative Graph Neural Network
by: Zheng, Jialun, et al.
Published: (2024)

NILMFormer: Non-Intrusive Load Monitoring that Accounts for Non-Stationarity
by: Petralia, Adrien, et al.
Published: (2025)

Context-Specific Causal Graph Discovery with Unobserved Contexts: Non-Stationarity, Regimes and Spatio-Temporal Patterns
by: Rabel, Martin, et al.
Published: (2025)

Demystifying the Hypercomplex: Inductive Biases in Hypercomplex Deep Learning
by: Comminiello, Danilo, et al.
Published: (2024)

Lyapunov Stability Learning with Nonlinear Control via Inductive Biases
by: Lu, Yupu, et al.
Published: (2025)

Tackling Non-Stationarity in Reinforcement Learning via Causal-Origin Representation
by: Zhang, Wanpeng, et al.
Published: (2023)

Physics-Informed Inductive Biases for Voltage Prediction in Distribution Grids
by: Okoyomon, Ehimare, et al.
Published: (2025)

Integrating Inductive Biases in Transformers via Distillation for Financial Time Series Forecasting
by: Den, Yu-Chen, et al.
Published: (2026)

The No Free Lunch Theorem, Kolmogorov Complexity, and the Role of Inductive Biases in Machine Learning
by: Goldblum, Micah, et al.
Published: (2023)

When Diffusion Models Memorize: Inductive Biases in Probability Flow of Minimum-Norm Shallow Neural Nets
by: Zeno, Chen, et al.
Published: (2025)

Offline Reinforcement Learning from Datasets with Structured Non-Stationarity
by: Ackermann, Johannes, et al.
Published: (2024)

Off-Policy Evaluation and Learning for the Future under Non-Stationarity
by: Shimizu, Tatsuhiro, et al.
Published: (2025)

TwinS: Revisiting Non-Stationarity in Multivariate Time Series Forecasting
by: Hu, Jiaxi, et al.
Published: (2024)

TimeBridge: Non-Stationarity Matters for Long-term Time Series Forecasting
by: Liu, Peiyuan, et al.
Published: (2024)

Improving Model Performance by Adapting the KGE Metric to Account for System Non-Stationarity
by: Jawad, M, et al.
Published: (2026)

From Kepler to Newton: Inductive Biases Guide Learned World Models in Transformers
by: Liu, Ziming, et al.
Published: (2026)

Confronting Reward Overoptimization for Diffusion Models: A Perspective of Inductive and Primacy Biases
by: Zhang, Ziyi, et al.
Published: (2024)

SEGNO: Generalizing Equivariant Graph Neural Networks with Physical Inductive Biases
by: Liu, Yang, et al.
Published: (2023)