Cover Image

Discrete Cosine Transform Based Decorrelated Attention for Vision Transformers

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Pan, Hongyi, Hamdan, Emadeldeen, Zhu, Xin, Cetin, Ahmet Enis, Bagci, Ulas
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Machine Learning Signal Processing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Multichannel Orthogonal Transform-Based Perceptron Layers for Efficient ResNets
by: Pan, Hongyi, et al.
Published: (2023)

A Hybrid Quantum-Classical Approach based on the Hadamard Transform for the Convolutional Layer
by: Pan, Hongyi, et al.
Published: (2023)

Edge-Fog Computing-Enabled EEG Data Compression via Asymmetrical Variational Discrete Cosine Transform Network
by: Zhu, Xin, et al.
Published: (2025)

HTMA-Net: Towards Multiplication-Avoiding Neural Networks via Hadamard Transform and In-Memory Computing
by: Hamdan, Emadeldeen, et al.
Published: (2025)

A Probabilistic Hadamard U-Net for MRI Bias Field Correction
by: Zhu, Xin, et al.
Published: (2024)

Hybrid Multi-Dimensional MRI Prostate Cancer Detection via Hadamard Network-Based Bias Correction and Residual Networks
by: Hamdan, Emadeldeen, et al.
Published: (2026)

Sparse Mamba: Introducing Controllability, Observability, And Stability To Structural State Space Models
by: Hamdan, Emadeldeen, et al.
Published: (2024)

The Blind Normalized Stein Variational Gradient Descent-Based Detection for Intelligent Random Access in Cellular IoT
by: Zhu, Xin, et al.
Published: (2024)

Robust Cross-Domain WiFi Fall Detection via Physics-Driven Attention-Enhanced Transformers
by: Wang, Yingzhe, et al.
Published: (2026)

SRViT: Vision Transformers for Estimating Radar Reflectivity from Satellite Observations at Scale
by: Stock, Jason, et al.
Published: (2024)

Efficient Bearing Sensor Data Compression via an Asymmetrical Autoencoder with a Lifting Wavelet Transform Layer
by: Zhu, Xin, et al.
Published: (2025)

Progressive Deep Learning for Automated Spheno-Occipital Synchondrosis Maturation Assessment
by: Milani, Omid Halimi, et al.
Published: (2026)

A Novel Approach to Classify Power Quality Signals Using Vision Transformers
by: Saber, Ahmad Mohammad, et al.
Published: (2024)

Stress Classification from ECG Signals Using Vision Transformer
by: Ahmad, Zeeshan, et al.
Published: (2026)

Adaptive function approximation based on the Discrete Cosine Transform (DCT)
by: Pérez-Neira, Ana I., et al.
Published: (2023)

Decorrelation Speeds Up Vision Transformers
by: Carrigg, Kieran, et al.
Published: (2025)

Stein Variational Gradient Descent-based Detection For Random Access With Preambles In MTC
by: Zhu, Xin, et al.
Published: (2023)

Gradient Attention Map Based Verification of Deep Convolutional Neural Networks with Application to X-ray Image Datasets
by: Milani, Omid Halimi, et al.
Published: (2025)

Deciphering Heartbeat Signatures: A Vision Transformer Approach to Explainable Atrial Fibrillation Detection from ECG Signals
by: Mohan, Aruna, et al.
Published: (2024)

Transformer-Aided Semantic Communications
by: Mortaheb, Matin, et al.
Published: (2024)

Seeing Delta Parameters as JPEG Images: Data-Free Delta Compression with Discrete Cosine Transform
by: Huang, Chenyu, et al.
Published: (2025)

Interpretable Lightweight Transformer via Unrolling of Learned Graph Smoothness Priors
by: Do, Tam Thuc, et al.
Published: (2024)

Hierarchical Attention Network for Interpretable ECG-based Heart Disease Classification
by: Rodriguez, Mario Padilla, et al.
Published: (2025)

Efficient Semantic Communication Through Transformer-Aided Compression
by: Mortaheb, Matin, et al.
Published: (2024)

MammoClean: Toward Reproducible and Bias-Aware AI in Mammography through Dataset Harmonization
by: Zafari, Yalda, et al.
Published: (2025)

Functional MRI Time Series Generation via Wavelet-Based Image Transform and Spectral Flow Matching for Brain Disorder Identification
by: Tew, Hwa Hui, et al.
Published: (2026)

Compression Robust Synthetic Speech Detection Using Patched Spectrogram Transformer
by: Yadav, Amit Kumar Singh, et al.
Published: (2024)

Self-Updating Vehicle Monitoring Framework Employing Distributed Acoustic Sensing towards Real-World Settings
by: Wang, Xi, et al.
Published: (2024)

An Unsupervised Tensor-Based Domain Alignment
by: Lee, Chong Hyun, et al.
Published: (2026)

A multimodal Transformer for InSAR-based ground deformation forecasting with cross-site generalization across Europe
by: Yao, Wendong, et al.
Published: (2025)

Deep Adversarial Learning with Activity-Based User Discrimination Task for Human Activity Recognition
by: Calatrava-Nicolás, Francisco M., et al.
Published: (2024)

Robust Feature Engineering Techniques for Designing Efficient Motor Imagery-Based BCI-Systems
by: Gardezi, Syed Saim, et al.
Published: (2024)

CSI-Based Efficient Self-Quarantine Monitoring System Using Branchy Convolution Neural Network
by: Guo, Jingtao, et al.
Published: (2023)

Epilepsy Seizure Detection and Prediction using an Approximate Spiking Convolutional Transformer
by: Chen, Qinyu, et al.
Published: (2024)

Spectral-Temporal Fusion Representation for Person-in-Bed Detection
by: Yang, Xuefeng, et al.
Published: (2024)

A Framework for Real-Time Volcano-Seismic Event Recognition Based on Multi-Station Seismograms and Semantic Segmentation Models
by: Espinosa-Curilem, Camilo, et al.
Published: (2024)

VIRUS-NeRF -- Vision, InfraRed and UltraSonic based Neural Radiance Fields
by: Schmid, Nicolaj, et al.
Published: (2024)

Attention-aware Semantic Communications for Collaborative Inference
by: Im, Jiwoong, et al.
Published: (2024)

Vision Transformer Based Semantic Communications for Next Generation Wireless Networks
by: Mohsin, Muhammad Ahmed, et al.
Published: (2025)

Intelligent Incident Hypertension Prediction in Obstructive Sleep Apnea
by: Milani, Omid Halimi, et al.
Published: (2025)