Cover Image

Kolmogorov-Arnold Attention: Is Learnable Attention Better For Vision Transformers?

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Maity, Subhajit, Hitsman, Killian, Li, Xin, Dutta, Aritra
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Computer Vision and Pattern Recognition 68T07 I.2.6; I.5.1; I.5.5; I.5.4; I.4.10
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Sparse Concept Bottleneck Models: Gumbel Tricks in Contrastive Learning
by: Semenov, Andrei, et al.
Published: (2024)

CVCM Track Circuits Pre-emptive Failure Diagnostics for Predictive Maintenance Using Deep Neural Networks
by: Mukherjee, Debdeep, et al.
Published: (2025)

A Spatio-Temporal Deep Learning Approach For High-Resolution Gridded Monsoon Prediction
by: Borah, Parashjyoti, et al.
Published: (2026)

In-situ Autoguidance: Eliciting Self-Correction in Diffusion Models
by: Gu, Enhao, et al.
Published: (2025)

Scalable, Technology-Agnostic Diagnosis and Predictive Maintenance for Point Machine using Deep Learning
by: Di Santi, Eduardo, et al.
Published: (2025)

Neural Velocity for hyperparameter tuning
by: Dalmasso, Gianluca, et al.
Published: (2025)

SeMi: When Imbalanced Semi-Supervised Learning Meets Mining Hard Examples
by: Wang, Yin, et al.
Published: (2025)

RG-TTA: Regime-Guided Meta-Control for Test-Time Adaptation in Streaming Time Series
by: Kumar, Indar, et al.
Published: (2026)

Few-Class Arena: A Benchmark for Efficient Selection of Vision Models and Dataset Difficulty Measurement
by: Cao, Bryan Bo, et al.
Published: (2024)

Accurate typhoon intensity forecasts using a non-iterative spatiotemporal transformer model
by: Qu, Hongyu, et al.
Published: (2025)

Contract-Driven QoE Auditing for Speech and Singing Services: From MOS Regression to Service Graphs
by: Du, Wenzhang
Published: (2025)

SpectralCA: Bi-Directional Cross-Attention for Next-Generation UAV Hyperspectral Vision
by: Brovko, D. V.
Published: (2025)

HELIX: Scaling Raw Audio Understanding with Hybrid Mamba-Attention Beyond the Quadratic Limit
by: Khushiyant, et al.
Published: (2026)

Crossing the Species Divide: Transfer Learning from Speech to Animal Sounds
by: Cauzinille, Jules, et al.
Published: (2025)

Cytoarchitecture in Words: Weakly Supervised Vision-Language Modeling for Human Brain Microscopy
by: Sutton, Matthew, et al.
Published: (2026)

Neural Encoding for Image Recall: Human-Like Memory
by: Foussereau, Virgile, et al.
Published: (2024)

BenthiCat: An opti-acoustic dataset for advancing benthic classification and habitat mapping
by: Rajani, Hayat, et al.
Published: (2025)

FAME: Feature Activation Map Explanation on Image Classification and Face Recognition
by: Zhang, Xinyi, et al.
Published: (2026)

Uncovering Population PK Covariates from VAE-Generated Latent Spaces
by: Perazzolo, Diego, et al.
Published: (2025)

Quantum-Enhanced Analysis and Grading of Vocal Performance
by: Agarwal, Rohan
Published: (2025)

Salient Concept-Aware Generative Data Augmentation
by: Zhao, Tianchen, et al.
Published: (2025)

How Much Temporal Modeling is Enough? A Systematic Study of Hybrid CNN-RNN Architectures for Multi-Label ECG Classification
by: Jafari, Alireza, et al.
Published: (2026)

Detection and Simulation of Urban Heat Islands Using a Fine-Tuned Geospatial Foundation Model for Microclimate Impact Prediction
by: Fleckenstein, Jannis, et al.
Published: (2025)

Track Component Failure Detection Using Data Analytics over existing STDS Track Circuit data
by: López, Francisco, et al.
Published: (2025)

NV3D: Leveraging Spatial Shape Through Normal Vector-based 3D Object Detection
by: Chaowakarn, Krittin, et al.
Published: (2025)

A Novel Schur-Decomposition-Based Weight Projection Method for Stable State-Space Neural-Network Architectures
by: Vanegas, Sergio, et al.
Published: (2026)

Enhancing Classification with Semi-Supervised Deep Learning Using Distance-Based Sample Weights
by: Abedinia, Aydin, et al.
Published: (2025)

SAM Fewshot Finetuning for Anatomical Segmentation in Medical Images
by: Xie, Weiyi, et al.
Published: (2024)

KinetiDiff: Docking-Guided Diffusion for De Novo ACVR1 Inhibitor Design in Fibrodysplasia Ossificans Progressiva
by: Patel, Aaryan
Published: (2026)

Streaming Anchor Loss: Augmenting Supervision with Temporal Significance
by: Sarawgi, Utkarsh Oggy, et al.
Published: (2023)

Deep Spectral Meshes: Multi-Frequency Facial Mesh Processing with Graph Neural Networks
by: Kosk, Robert, et al.
Published: (2024)

StatsMerging: Statistics-Guided Model Merging via Task-Specific Teacher Distillation
by: Merugu, Ranjith, et al.
Published: (2025)

Benchmarking Catastrophic Forgetting Mitigation Methods in Federated Time Series Forecasting
by: Hallak, Khaled, et al.
Published: (2025)

Logits-Constrained Framework with RoBERTa for Ancient Chinese NER
by: Hua, Wenjie, et al.
Published: (2025)

CytoNet: A Foundation Model for the Human Cerebral Cortex at Cellular Resolution
by: Schiffer, Christian, et al.
Published: (2025)

Multimodal Ensemble with Conditional Feature Fusion for Dysgraphia Diagnosis in Children from Handwriting Samples
by: Kunhoth, Jayakanth, et al.
Published: (2024)

Evaluation Metric for Quality Control and Generative Models in Histopathology Images
by: Jeevan, Pranav, et al.
Published: (2024)

TexTile: A Differentiable Metric for Texture Tileability
by: Rodriguez-Pardo, Carlos, et al.
Published: (2024)

HAELT: A Hybrid Attentive Ensemble Learning Transformer Framework for High-Frequency Stock Price Forecasting
by: Bui, Thanh Dan
Published: (2025)

DRL: Discriminative Representation Learning with Parallel Adapters for Class Incremental Learning
by: Zhan, Jiawei, et al.
Published: (2025)