Cover Image

Beyond Sinusoids: A Morlet Wavelet Framework for Transformer Positional Encoding

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Zeris, Athanasios
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Computation and Language Signal Processing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Energy-Gated Attention and Wavelet Positional Encoding: Complementary Inductive Biases for Transformer Attention
by: Zeris, Athanasios
Published: (2026)

Energy-Gated Attention: Spectral Salience as an Inductive Bias for Transformer Attention
by: Zeris, Athanasios
Published: (2026)

Wavelet GPT: Wavelet Inspired Large Language Models
by: Verma, Prateek
Published: (2024)

Training-Free Spectral Fingerprints of Voice Processing in Transformers
by: Noël, Valentin
Published: (2025)

A Graph Signal Processing Framework for Hallucination Detection in Large Language Models
by: Noël, Valentin
Published: (2025)

UWB TDoA Error Correction using Transformers: Patching and Positional Encoding Strategies
by: Coppens, Dieter, et al.
Published: (2025)

sEEG-based Encoding for Sentence Retrieval: A Contrastive Learning Approach to Brain-Language Alignment
by: Liu, Yijun
Published: (2025)

Bridging Brain Signals and Language: A Deep Learning Approach to EEG-to-Text Decoding
by: Gedawy, Mostafa El, et al.
Published: (2025)

Attentive Fusion: A Transformer-based Approach to Multimodal Hate Speech Detection
by: Mandal, Atanu, et al.
Published: (2024)

Autoencoder-Based Parameter Estimation for Superposed Multi-Component Damped Sinusoidal Signals
by: Iida, Momoka, et al.
Published: (2026)

TTQ: Activation-Aware Test-Time Quantization to Accelerate LLM Inference On The Fly
by: Koike-Akino, Toshiaki, et al.
Published: (2026)

MEIT: Multimodal Electrocardiogram Instruction Tuning on Large Language Models for Report Generation
by: Wan, Zhongwei, et al.
Published: (2024)

Dynamic Fault Characteristics Evaluation in Power Grid
by: Pei, Hao, et al.
Published: (2023)

EEG-CLIP : Learning EEG representations from natural language descriptions
by: Ndir, Tidiane Camaret, et al.
Published: (2025)

When marine radar target detection meets pretrained large language models
by: Hu, Qiying, et al.
Published: (2025)

Can VLM Pseudo-Labels Train a Time-Series QA Model That Outperforms the VLM?
by: Fujimura, Takuya, et al.
Published: (2025)

Lightweight Conceptual Dictionary Learning for Text Classification Using Information Compression
by: Wan, Li, et al.
Published: (2024)

Text me the data: Generating Ground Pressure Sequence from Textual Descriptions for HAR
by: Ray, Lala Shakti Swarup, et al.
Published: (2024)

SuPreME: A Supervised Pre-training Framework for Multimodal ECG Representation Learning
by: Cai, Mingsheng, et al.
Published: (2025)

Bridging Auditory Perception and Language Comprehension through MEG-Driven Encoding Models
by: Ciferri, Matteo, et al.
Published: (2024)

Herglotz-NET: Implicit Neural Representation of Spherical Data with Harmonic Positional Encoding
by: Hanon, Théo, et al.
Published: (2025)

Range-aware Positional Encoding via High-order Pretraining: Theory and Practice
by: Nguyen, Viet Anh, et al.
Published: (2024)

Enabling ASR for Low-Resource Languages: A Comprehensive Dataset Creation Approach
by: Yeroyan, Ara, et al.
Published: (2024)

WST-X Series: Wavelet Scattering Transform for Interpretable Speech Deepfake Detection
by: Xuan, Xi, et al.
Published: (2026)

IndicVoices-R: Unlocking a Massive Multilingual Multi-speaker Speech Corpus for Scaling Indian TTS
by: Sankar, Ashwin, et al.
Published: (2024)

Electrocardiogram Classification with Transformers Using Koopman and Wavelet Features
by: Ghosh, Sucheta, et al.
Published: (2026)

Wavelet-Guided Water-Level Estimation for ISAC
by: Salari, Ayoob, et al.
Published: (2025)

ECG-Expert-QA: A Benchmark for Evaluating Medical Large Language Models in Heart Disease Diagnosis
by: Wang, Xu, et al.
Published: (2025)

NeuroNarrator: A Generalist EEG-to-Text Foundation Model for Clinical Interpretation via Spectro-Spatial Grounding and Temporal State-Space Reasoning
by: Wang, Guoan, et al.
Published: (2026)

Is Attention always needed? A Case Study on Language Identification from Speech
by: Mandal, Atanu, et al.
Published: (2021)

VoxKnesset: A Large-Scale Longitudinal Hebrew Speech Dataset for Aging Speaker Modeling
by: Marmor, Yanir, et al.
Published: (2026)

Real-Time Stress Detection via Photoplethysmogram Signals: Implementation of a Combined Continuous Wavelet Transform and Convolutional Neural Network on Resource-Constrained Microcontrollers
by: Hasanpoor, Yasin, et al.
Published: (2024)

Label-Efficient Sleep Staging Using Transformers Pre-trained with Position Prediction
by: Lala, Sayeri, et al.
Published: (2024)

Heart Murmur and Abnormal PCG Detection via Wavelet Scattering Transform & a 1D-CNN
by: Patwa, Ahmed, et al.
Published: (2023)

LLMs as High-Dimensional Nonlinear Autoregressive Models with Attention: Training, Alignment and Inference
by: Krishnamurthy, Vikram
Published: (2026)

Token Encoding for Semantic Recovery
by: Hu, Jingzhi, et al.
Published: (2026)

Leveraging Large Language Models for Wireless Symbol Detection via In-Context Learning
by: Abbas, Momin, et al.
Published: (2024)

Integrating Pre-Trained Language Model with Physical Layer Communications
by: Lee, Ju-Hyung, et al.
Published: (2024)

Fractional Reasoning via Latent Steering Vectors Improves Inference Time Compute
by: Liu, Sheng, et al.
Published: (2025)

A Deep Learning Model for Battery State Prediction towards Intelligent Energy Management
by: Koukosias, Athanasios, et al.
Published: (2026)