Cover Image

The Routing and Filtering Structure of Attention

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Jamil, Shafayeth, Kapadia, Rehan
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Interpretable Physics Extraction from Data for Linear Dynamical Systems using Lie Generator Networks
by: Jamil, Shafayeth, et al.
Published: (2026)

Lie Generator Networks for Nonlinear Partial Differential Equations
by: Jamil, Shafayeth, et al.
Published: (2026)

Lie Generator Networks Extract EIS-Grade Battery Diagnostics from Pulse Relaxation Data
by: Jamil, Shafayeth, et al.
Published: (2026)

Robust Filter Attention: Self-Attention as Precision-Weighted State Estimation
by: Racioppo, Peter
Published: (2025)

FAME: Adaptive Functional Attention with Expert Routing for Function-on-Function Regression
by: Gao, Yifei, et al.
Published: (2025)

GASE: Graph Attention Sampling with Edges Fusion for Solving Vehicle Routing Problems
by: Wang, Zhenwei, et al.
Published: (2024)

AI-Driven Clinical Decision Support System for Enhanced Diabetes Diagnosis and Management
by: Rehman, Mujeeb Ur, et al.
Published: (2026)

AFD-STA: Adaptive Filtering Denoising with Spatiotemporal Attention for Chaotic System Prediction
by: Gong, Chunlin, et al.
Published: (2025)

Attention-Driven Hierarchical Reinforcement Learning with Particle Filtering for Source Localization in Dynamic Fields
by: Shi, Yiwei, et al.
Published: (2025)

MViewRouter: Internalizing Geometric Equivariance via Multi-view Alternating Attention for Combinatorial Routing
by: Liu, Shiyan, et al.
Published: (2026)

LoRA-Mixer: Coordinate Modular LoRA Experts Through Serial Attention Routing
by: Li, Wenbing, et al.
Published: (2025)

Attention-Aided MMSE for OFDM Channel Estimation: Learning Linear Filters with Attention
by: Ha, TaeJun, et al.
Published: (2025)

Distance-aware Attention Reshaping: Enhance Generalization of Neural Solver for Large-scale Vehicle Routing Problems
by: Wang, Yang, et al.
Published: (2024)

FROST: Filtering Reasoning Outliers with Attention for Efficient Reasoning
by: Luo, Haozheng, et al.
Published: (2026)

The Anxiety of Influence: Bloom Filters in Transformer Attention Heads
by: Balogh, Peter
Published: (2026)

Attention-Based Neural-Augmented Kalman Filter for Legged Robot State Estimation
by: Lee, Seokju, et al.
Published: (2026)

Higher-Order Transformers With Kronecker-Structured Attention
by: Omranpour, Soroush, et al.
Published: (2024)

Improving Underwater Acoustic Classification Through Learnable Gabor Filter Convolution and Attention Mechanisms
by: Domingos, Lucas Cesar Ferreira, et al.
Published: (2025)

Are Graph Attention Networks Able to Model Structural Information?
by: Noravesh, Farshad, et al.
Published: (2025)

GSTAM: Efficient Graph Distillation with Structural Attention-Matching
by: Rasti-Meymandi, Arash, et al.
Published: (2024)

RouteHijack: Routing-Aware Attack on Mixture-of-Experts LLMs
by: Xu, Zhiyuan, et al.
Published: (2026)

Learning to Route: Per-Sample Adaptive Routing for Multimodal Multitask Prediction
by: Ajirak, Marzieh, et al.
Published: (2025)

Weighted Graph Structure Learning with Attention Denoising for Node Classification
by: Wang, Tingting, et al.
Published: (2025)

Mitigating Degree Bias in Graph Representation Learning with Learnable Structural Augmentation and Structural Self-Attention
by: Hoang, Van Thuy, et al.
Published: (2025)

Directional Routing in Transformers
by: Taylor, Kevin
Published: (2026)

Routing without Forgetting
by: Masano, Alessio, et al.
Published: (2026)

One Filters All: A Generalist Filter for State Estimation
by: Liu, Shiqi, et al.
Published: (2025)

Representation over Routing: Diagnosing Temporal Routing Pathologies in Multi-Timescale PPO
by: Sun, Jing
Published: (2026)

Beyond Architectures: Evaluating the Role of Contextual Embeddings in Detecting Bipolar Disorder on Social Media
by: Hasan, Khalid, et al.
Published: (2025)

HGATSolver: A Heterogeneous Graph Attention Solver for Fluid-Structure Interaction
by: Zhang, Qin-Yi, et al.
Published: (2026)

More Than Routing: Joint GPS and Route Modeling for Refine Trajectory Representation Learning
by: Ma, Zhipeng, et al.
Published: (2024)

Neural Bayesian Filtering
by: Solinas, Christopher, et al.
Published: (2025)

Filter then Attend: Improving attention-based Time Series Forecasting with Spectral Filtering
by: Dayag, Elisha, et al.
Published: (2025)

SeqRoute: Global Budget-Aware Sequential LLM Routing via Offline Reinforcement Learning
by: Xu, Zhongling, et al.
Published: (2026)

Deep Reinforcement Learning for Multi-Truck Vehicle Routing Problems with Multi-Leg Demand Routes
by: Levin, Joshua, et al.
Published: (2024)

The Structural Origin of Attention Sink: Variance Discrepancy, Super Neurons, and Dimension Disparity
by: Li, Siquan, et al.
Published: (2026)

Prompt Learning for Generalized Vehicle Routing
by: Liu, Fei, et al.
Published: (2024)

Neural Cluster First, Route Second: One-Shot Capacitated Vehicle Routing via Differentiable Optimal Transport
by: Chin, Samuel J. K., et al.
Published: (2026)

SLA2: Sparse-Linear Attention with Learnable Routing and QAT
by: Zhang, Jintao, et al.
Published: (2026)

RouteFormer: A Transformer-Based Routing Framework for Autonomous Vehicles
by: Youssef, Yazan, et al.
Published: (2025)