Cover Image

Energy-Gated Attention: Spectral Salience as an Inductive Bias for Transformer Attention

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Zeris, Athanasios
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Computation and Language Signal Processing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Energy-Gated Attention and Wavelet Positional Encoding: Complementary Inductive Biases for Transformer Attention
by: Zeris, Athanasios
Published: (2026)

Beyond Sinusoids: A Morlet Wavelet Framework for Transformer Positional Encoding
by: Zeris, Athanasios
Published: (2026)

Training-Free Spectral Fingerprints of Voice Processing in Transformers
by: Noël, Valentin
Published: (2025)

LLMs as High-Dimensional Nonlinear Autoregressive Models with Attention: Training, Alignment and Inference
by: Krishnamurthy, Vikram
Published: (2026)

Is Attention always needed? A Case Study on Language Identification from Speech
by: Mandal, Atanu, et al.
Published: (2021)

Discrete Cosine Transform Based Decorrelated Attention for Vision Transformers
by: Pan, Hongyi, et al.
Published: (2024)

Large Language Model-informed ECG Dual Attention Network for Heart Failure Risk Prediction
by: Chen, Chen, et al.
Published: (2024)

Language Bias in Self-Supervised Learning For Automatic Speech Recognition
by: Storey, Edward, et al.
Published: (2025)

BitStopper: An Efficient Transformer Attention Accelerator via Stage-fusion and Early Termination
by: Wang, Huizheng, et al.
Published: (2025)

TTQ: Activation-Aware Test-Time Quantization to Accelerate LLM Inference On The Fly
by: Koike-Akino, Toshiaki, et al.
Published: (2026)

MEIT: Multimodal Electrocardiogram Instruction Tuning on Large Language Models for Report Generation
by: Wan, Zhongwei, et al.
Published: (2024)

Dynamic Fault Characteristics Evaluation in Power Grid
by: Pei, Hao, et al.
Published: (2023)

A Graph Signal Processing Framework for Hallucination Detection in Large Language Models
by: Noël, Valentin
Published: (2025)

Bridging Brain Signals and Language: A Deep Learning Approach to EEG-to-Text Decoding
by: Gedawy, Mostafa El, et al.
Published: (2025)

EEG-CLIP : Learning EEG representations from natural language descriptions
by: Ndir, Tidiane Camaret, et al.
Published: (2025)

When marine radar target detection meets pretrained large language models
by: Hu, Qiying, et al.
Published: (2025)

Can VLM Pseudo-Labels Train a Time-Series QA Model That Outperforms the VLM?
by: Fujimura, Takuya, et al.
Published: (2025)

Lightweight Conceptual Dictionary Learning for Text Classification Using Information Compression
by: Wan, Li, et al.
Published: (2024)

Text me the data: Generating Ground Pressure Sequence from Textual Descriptions for HAR
by: Ray, Lala Shakti Swarup, et al.
Published: (2024)

Attentive Fusion: A Transformer-based Approach to Multimodal Hate Speech Detection
by: Mandal, Atanu, et al.
Published: (2024)

Transformer-Based Indirect Structural Health Monitoring of Rail Infrastructure with Attention-Driven Detection and Localization of Transient Defects
by: Ma, Sizhe, et al.
Published: (2025)

A Deep Learning Model for Battery State Prediction towards Intelligent Energy Management
by: Koukosias, Athanasios, et al.
Published: (2026)

Explainable Dual-Attention Tabular Transformer for Soil Electrical Resistivity Prediction: A Decision Support Framework for High-Voltage Substation Construction
by: Kongkitkul, Warat, et al.
Published: (2025)

Robust Cross-Domain WiFi Fall Detection via Physics-Driven Attention-Enhanced Transformers
by: Wang, Yingzhe, et al.
Published: (2026)

TAnet: A New Temporal Attention Network for EEG-based Auditory Spatial Attention Decoding with a Short Decision Window
by: Ding, Yuting, et al.
Published: (2024)

Spectral Guardrails for Agents in the Wild: Detecting Tool Use Hallucinations via Attention Topology
by: Noël, Valentin
Published: (2026)

IndicVoices-R: Unlocking a Massive Multilingual Multi-speaker Speech Corpus for Scaling Indian TTS
by: Sankar, Ashwin, et al.
Published: (2024)

Density Adaptive Attention is All You Need: Robust Parameter-Efficient Fine-Tuning Across Multiple Modalities
by: Ioannides, Georgios, et al.
Published: (2024)

Attention-Refined Unrolling for Sparse Sequential micro-Doppler Reconstruction
by: Mazzieri, Riccardo, et al.
Published: (2023)

Demystifying the Hypercomplex: Inductive Biases in Hypercomplex Deep Learning
by: Comminiello, Danilo, et al.
Published: (2024)

Transformer-Based Bearing Fault Detection using Temporal Decomposition Attention Mechanism
by: Mirzaeibonehkhater, Marzieh, et al.
Published: (2024)

L-FAME: Longitudinal Focused Attention Meditation EEG Dataset and Benchmark
by: Li, Angqi, et al.
Published: (2026)

EEG-GMACN: Interpretable EEG Graph Mutual Attention Convolutional Network
by: Ye, Haili, et al.
Published: (2024)

BiLSTM and Attention-Based Modulation Classification of Realistic Wireless Signals
by: Udaiwal, Rohit, et al.
Published: (2024)

Attention-based Deep Neural Networks for Battery Discharge Capacity Forecasting
by: Zhang, Yadong, et al.
Published: (2022)

Adaptive Progressive Attention Graph Neural Network for EEG Emotion Recognition
by: Feng, Tianzhi, et al.
Published: (2025)

Enabling ASR for Low-Resource Languages: A Comprehensive Dataset Creation Approach
by: Yeroyan, Ara, et al.
Published: (2024)

Attention-Aided MMSE for OFDM Channel Estimation: Learning Linear Filters with Attention
by: Ha, TaeJun, et al.
Published: (2025)

Holographic Transformers for Complex-Valued Signal Processing: Integrating Phase Interference into Self-Attention
by: Huang, Enhao, et al.
Published: (2025)

Cross-Attention Message-Passing Transformers for Code-Agnostic Decoding in 6G Networks
by: Park, Seong-Joon, et al.
Published: (2025)