Image de couverture de livre

Tucker Attention: A generalization of approximate attention mechanisms

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Klein, Timon, Kusch, Jonas, Sager, Sebastian, Schnake, Stefan, Schotthöfer, Steffen
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

A geometric framework for momentum-based optimizers for low-rank training
par: Schotthöfer, Steffen, et autres
Publié: (2025)

Mitigating Subject Dependency in EEG Decoding with Subject-Specific Low-Rank Adapters
par: Klein, Timon, et autres
Publié: (2025)

GeoLoRA: Geometric integration for parameter efficient fine-tuning
par: Schotthöfer, Steffen, et autres
Publié: (2024)

Geometry-aware training of factorized layers in tensor Tucker format
par: Zangrando, Emanuele, et autres
Publié: (2023)

An Augmented Backward-Corrected Projector Splitting Integrator for Dynamical Low-Rank Training
par: Kusch, Jonas, et autres
Publié: (2025)

Dynamical Low-Rank Compression of Neural Networks with Robustness under Adversarial Attacks
par: Schotthöfer, Steffen, et autres
Publié: (2025)

Federated Dynamical Low-Rank Training with Global Loss Convergence Guarantees
par: Schotthöfer, Steffen, et autres
Publié: (2024)

Compressing Vision Transformers in Geospatial Transfer Learning with Manifold-Constrained Optimization
par: Snyder, Thomas, et autres
Publié: (2026)

HADL Framework for Noise Resilient Long-Term Time Series Forecasting
par: Dey, Aditya, et autres
Publié: (2025)

Poly-attention: a general scheme for higher-order self-attention
par: Chakrabarti, Sayak, et autres
Publié: (2026)

LORA-CRAFT: Cross-layer Rank Adaptation via Frozen Tucker Decomposition of Pre-trained Attention Weights
par: Dewage, Kasun, et autres
Publié: (2026)

Towards Symbolic XAI -- Explanation Through Human Understandable Logical Relationships Between Features
par: Schnake, Thomas, et autres
Publié: (2024)

Sink vs. diagonal patterns as mechanisms for attention switch and oversmoothing prevention
par: Súkeník, Peter, et autres
Publié: (2026)

Physics-informed GNN for medium-high voltage AC power flow with edge-aware attention and line search correction operator
par: Kim, Changhun, et autres
Publié: (2025)

Attention mechanisms in neural networks
par: Hays, Hasi
Publié: (2026)

Uncovering the Structure of Explanation Quality with Spectral Analysis
par: Maeß, Johannes, et autres
Publié: (2025)

Mode-Aware Non-Linear Tucker Autoencoder for Tensor-based Unsupervised Learning
par: Zheng, Junjing, et autres
Publié: (2025)

Expanding Expressivity in Transformer Models with MöbiusAttention
par: Halacheva, Anna-Maria, et autres
Publié: (2024)

Reorganizing attention-space geometry with expressive attention
par: Gros, Claudius
Publié: (2024)

A foundation model with multi-variate parallel attention to generate neuronal activity
par: Carzaniga, Francesco, et autres
Publié: (2025)

Worst-case low-rank approximations
par: Fries, Anya, et autres
Publié: (2026)

Efficiently Dispatching Flash Attention For Partially Filled Attention Masks
par: Sharma, Agniv, et autres
Publié: (2024)

MEGAN: Multi-Explanation Graph Attention Network
par: Teufel, Jonas, et autres
Publié: (2022)

Supervised learning pays attention
par: Craig, Erin, et autres
Publié: (2025)

EEG motor imagery decoding: A framework for comparative analysis with channel attention mechanisms
par: Wimpff, Martin, et autres
Publié: (2023)

Enhancing short-term traffic prediction by integrating trends and fluctuations with attention mechanism
par: Das, Adway, et autres
Publié: (2025)

A Diffusion-Based Method for Learning the Multi-Outcome Distribution of Medical Treatments
par: Ma, Yuchen, et autres
Publié: (2025)

k-Maximum Inner Product Attention for Graph Transformers and the Expressive Power of GraphGPS
par: De Schouwer, Jonas, et autres
Publié: (2026)

An end-to-end attention-based approach for learning on graphs
par: Buterez, David, et autres
Publié: (2024)

Short window attention enables long-term memorization
par: Cabannes, Loïc, et autres
Publié: (2025)

SortBench: Benchmarking LLMs based on their ability to sort lists
par: Herbold, Steffen
Publié: (2025)

AlphaIntegrator: Transformer Action Search for Symbolic Integration Proofs
par: Ünsal, Mert, et autres
Publié: (2024)

Depth-Recurrent Attention Mixtures: Giving Latent Reasoning the Attention it Deserves
par: Knupp, Jonas, et autres
Publié: (2026)

Cross-attentive Cohesive Subgraph Embedding to Mitigate Oversquashing in GNNs
par: Hossain, Tanvir, et autres
Publié: (2026)

CNN Explainability with Multivector Tucker Saliency Maps for Self-Supervised Models
par: Bouayed, Aymene Mohammed, et autres
Publié: (2024)

Twin Transformer using Gated Dynamic Learnable Attention mechanism for Fault Detection and Diagnosis in the Tennessee Eastman Process
par: Labbaf-Khaniki, Mohammad Ali, et autres
Publié: (2024)

Plasticity Loss in Deep Reinforcement Learning: A Survey
par: Klein, Timo, et autres
Publié: (2024)

GQA-μP: The maximal parameterization update for grouped query attention
par: Chickering, Kyle R., et autres
Publié: (2026)

GRC-Net: Gram Residual Co-attention Net for epilepsy prediction
par: You, Bihao, et autres
Publié: (2025)

Static and multivariate-temporal attentive fusion transformer for readmission risk prediction
par: Sun, Zhe, et autres
Publié: (2024)