Cover Image

Spectraformer: A Unified Random Feature Framework for Transformer

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Nguyen, Duke, Yin, Du, Joshi, Aditya, Salim, Flora
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Harnessing Test-time Adaptation for NLU tasks Involving Dialects of English
by: Nguyen, Duke, et al.
Published: (2025)

DeepLévy: Learning Heavy-Tailed Uncertainty in Highly Volatile Time Series
by: Yang, Yang, et al.
Published: (2026)

STOAT: Spatial-Temporal Probabilistic Causal Inference Network
by: Yang, Yang, et al.
Published: (2025)

STC-ViT: Spatio Temporal Continuous Vision Transformer for Medium-range Global Weather Forecasting
by: Saleem, Hira, et al.
Published: (2024)

GHGbench: A Unified Multi-Entity, Multi-Task Benchmark for Carbon Emission Prediction
by: Duan, Yifan, et al.
Published: (2026)

AuditNet: A Conversational AI-based Security Assistant [DEMO]
by: Deldari, Shohreh, et al.
Published: (2024)

XXLTraffic: Expanding and Extremely Long Traffic forecasting beyond test adaptation
by: Yin, Du, et al.
Published: (2024)

There is No "apple" in Timeseries: Rethinking TSFM through the Lens of Invariance
by: Prabowo, Arian, et al.
Published: (2025)

DRIFT-Net: A Spectral--Coupled Neural Operator for PDEs Learning
by: Li, Jiayi, et al.
Published: (2025)

PINN-Cast: Exploring the Role of Continuous-Depth NODE in Transformers and Physics Informed Loss as Soft Physical Constraints in Short-term Weather Forecasting
by: Saleem, Hira, et al.
Published: (2026)

ODEStream: A Buffer-Free Online Learning Framework with ODE-based Adaptor for Streaming Time Series Forecasting
by: Abushaqra, Futoon M., et al.
Published: (2024)

A Unified Framework for Variable Selection in Model-Based Clustering with Missing Not at Random
by: Ho, Binh H., et al.
Published: (2025)

Massive-STEPS: Massive Semantic Trajectories for Understanding POI Check-ins -- Dataset and Benchmarks
by: Wongso, Wilson, et al.
Published: (2025)

SDE-Attention: Latent Attention in SDE-RNNs for Irregularly Sampled Time Series with Missing Data
by: Fang, Yuting, et al.
Published: (2025)

CP-MoE: Consistency-Preserving Mixture-of-Experts for Continual Learning
by: Liu, Yang, et al.
Published: (2026)

Illusions of reflection: open-ended task reveals systematic failures in Large Language Models' reflective reasoning
by: Weatherhead, Sion, et al.
Published: (2025)

Macformer: Transformer with Random Maclaurin Feature Attention
by: Guo, Yuhan, et al.
Published: (2024)

Embedding spatial context in urban traffic forecasting with contrastive pre-training
by: Low, Matthew, et al.
Published: (2025)

A-UTE: Advection Informed, Uncertainty Aware Temperature Emulator
by: Saleem, Hira, et al.
Published: (2024)

HyperTokens: Controlling Token Dynamics for Continual Video-Language Understanding
by: Nguyen, Toan, et al.
Published: (2026)

T-JEPA: A Joint-Embedding Predictive Architecture for Trajectory Similarity Computation
by: Li, Lihuan, et al.
Published: (2024)

Linear Transformer Topological Masking with Graph Random Features
by: Reid, Isaac, et al.
Published: (2024)

A Probabilistic Framework for Imputing Genetic Distances in Spatiotemporal Pathogen Models
by: Stone, Haley, et al.
Published: (2025)

SeqLink: A Robust Neural-ODE Architecture for Modelling Partially Observed Time Series
by: Abushaqra, Futoon M., et al.
Published: (2022)

Linear Transformers Implicitly Discover Unified Numerical Algorithms
by: Lutz, Patrick, et al.
Published: (2025)

HiT-JEPA: A Hierarchical Self-supervised Trajectory Embedding Framework for Similarity Computation
by: Li, Lihuan, et al.
Published: (2025)

Data-Aware Random Feature Kernel for Transformers
by: Farzam, Amirhossein, et al.
Published: (2026)

Cross-model Fairness: Empirical Study of Fairness and Ethics Under Model Multiplicity
by: Sokol, Kacper, et al.
Published: (2022)

Feature Optimization for Time Series Forecasting via Novel Randomized Uphill Climbing
by: Van Thanh, Nguyen
Published: (2025)

WorkR: Occupation Inference for Intelligent Task Assistance
by: Khaokaew, Yonchanok, et al.
Published: (2024)

FairDRL-ST: Disentangled Representation Learning for Fair Spatio-Temporal Mobility Prediction
by: Zhao, Sichen, et al.
Published: (2025)

Causality-Inspired Safe Residual Correction for Multivariate Time Series
by: Xie, Jianxiang, et al.
Published: (2025)

Towards Generalizable Human Activity Recognition: A Survey
by: Cai, Yize, et al.
Published: (2025)

Enhancing Spatio-temporal Quantile Forecasting with Curriculum Learning: Lessons Learned
by: Yin, Du, et al.
Published: (2024)

Alternatives To Next Token Prediction In Text Generation -- A Survey
by: Wyatt, Charlie, et al.
Published: (2025)

ASTER: Adaptive Spatio-Temporal Early Decision Model for Dynamic Resource Allocation
by: Chen, Shulun, et al.
Published: (2025)

A Unified Kantorovich Duality for Multimarginal Optimal Transport
by: Cheryala, Yehya, et al.
Published: (2026)

Random Features for Operator-Valued Kernels: Bridging Kernel Methods and Neural Operators
by: Nguyen, Mike, et al.
Published: (2026)

Tract-RLFormer: A Tract-Specific RL policy based Decoder-only Transformer Network
by: Joshi, Ankita, et al.
Published: (2024)

PDFInspect: A Unified Feature Extraction Framework for Malicious Document Detection
by: P, Sharmila S
Published: (2026)