Image de couverture de livre

Higher-Order Transformers With Kronecker-Structured Attention

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Omranpour, Soroush, Rabusseau, Guillaume, Rabbany, Reihaneh
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Higher Order Transformers: Enhancing Stock Movement Prediction On Multimodal Time-Series Data
par: Omranpour, Soroush, et autres
Publié: (2024)

RL Fine-Tuning Heals OOD Forgetting in SFT
par: Jin, Hangzhan, et autres
Publié: (2025)

Kurtosis-Guided Denoising Score Matching for Tabular Anomaly Detection
par: Livernoche, Victor, et autres
Publié: (2026)

TN-SHAP-G: Graph-Structured Tensor Network Surrogates for Shapley Values and Interactions
par: Heidari, Farzaneh, et autres
Publié: (2026)

TGM: a Modular and Efficient Library for Machine Learning on Temporal Graphs
par: Chmura, Jacob, et autres
Publié: (2025)

Towards Detecting Contextual Real-Time Toxicity for In-Game Chat
par: Yang, Zachary, et autres
Publié: (2023)

UTG: Towards a Unified View of Snapshot and Event Based Models for Temporal Graphs
par: Huang, Shenyang, et autres
Publié: (2024)

GPS-SSL: Guided Positive Sampling to Inject Prior Into Self-Supervised Learning
par: Feizi, Aarash, et autres
Publié: (2024)

Grokking Finite-Dimensional Algebra
par: Notsawo, Pascal Jr Tikeng, et autres
Publié: (2026)

Grokking Beyond the Euclidean Norm of Model Parameters
par: Notsawo, Pascal Jr Tikeng, et autres
Publié: (2025)

ClustRecNet: A Novel End-to-End Deep Learning Framework for Clustering Algorithm Recommendation
par: Bakhtyari, Mohammadreza, et autres
Publié: (2025)

PairBench: Are Vision-Language Models Reliable at Comparing What They See?
par: Feizi, Aarash, et autres
Publié: (2025)

ROSA: Random Subspace Adaptation for Efficient Fine-Tuning
par: Hameed, Marawan Gamal Abdel, et autres
Publié: (2024)

Spectral Higher-Order Neural Networks
par: Peri, Gianluca, et autres
Publié: (2026)

Weak Supervision for Real World Graphs
par: Nair, Pratheeksha, et autres
Publié: (2025)

Are Large Language Models Good Temporal Graph Learners?
par: Huang, Shenyang, et autres
Publié: (2025)

Singular Value Decomposition on Kronecker Adaptation for Large Language Model
par: Chong, Yee Hin, et autres
Publié: (2025)

Learning Higher-Order Structure from Incomplete Spatiotemporal Data: Multi-Scale Hypergraph Laplacians with Neural Refinement
par: Wu, Keshu, et autres
Publié: (2026)

Higher-Order DeepTrails: Unified Approach to *Trails
par: Koopmann, Tobias, et autres
Publié: (2023)

Effective Generative AI: The Human-Algorithm Centaur
par: Saghafian, Soroush, et autres
Publié: (2024)

Personalized Student Knowledge Modeling for Future Learning Resource Prediction
par: Hashemifar, Soroush, et autres
Publié: (2025)

MoKA: Mixture of Kronecker Adapters
par: Sadeghi, Mohammadreza, et autres
Publié: (2025)

Hypergraph Pattern Machine: Compositional Tokenization for Higher-Order Interactions
par: Zhao, Kyrie, et autres
Publié: (2026)

The Bayesian Geometry of Transformer Attention
par: Agarwal, Naman, et autres
Publié: (2025)

Robust Conformal Prediction with a Single Binary Certificate
par: Zargarbashi, Soroush H., et autres
Publié: (2025)

Efficient Knowledge Tracing Leveraging Higher-Order Information in Integrated Graphs
par: Han, Donghee, et autres
Publié: (2025)

Higher-order Linear Attention
par: Zhang, Yifan, et autres
Publié: (2025)

Multiple Kronecker RLS fusion-based link propagation for drug-side effect prediction
par: Qian, Yuqing, et autres
Publié: (2024)

Geometric Attention: A Regime-Explicit Operator Semantics for Transformer Attention
par: Freytes, Luis Rosario
Publié: (2026)

XicorAttention: Time Series Transformer Using Attention with Nonlinear Correlation
par: Kimura, Daichi, et autres
Publié: (2025)

Generative Correlation Manifolds: Generating Synthetic Data with Preserved Higher-Order Correlations
par: d'Hondt, Jens E., et autres
Publié: (2025)

OCN: Effectively Utilizing Higher-Order Common Neighbors for Better Link Prediction
par: Wang, Juntong, et autres
Publié: (2025)

Kron-LoRA: Hybrid Kronecker-LoRA Adapters for Scalable, Sustainable Fine-tuning
par: Shen, Yixin
Publié: (2025)

Attention Schema-based Attention Control (ASAC): A Cognitive-Inspired Approach for Attention Management in Transformers
par: Saxena, Krati, et autres
Publié: (2025)

The Routing and Filtering Structure of Attention
par: Jamil, Shafayeth, et autres
Publié: (2026)

Towards Interpretable Deep Reinforcement Learning Models via Inverse Reinforcement Learning
par: Xie, Sean, et autres
Publié: (2022)

Compressing Deep Neural Networks Using Explainable AI
par: Soroush, Kimia, et autres
Publié: (2025)

Efficient Triple Modular Redundancy for Reliability Enhancement of DNNs Using Explainable AI
par: Soroush, Kimia, et autres
Publié: (2025)

Large Language Models for Sequential Decision-Making: Improving In-Context Learning via Supervised Fine-Tuning
par: Zhang, Minmin, et autres
Publié: (2026)

Unveiling and Controlling Anomalous Attention Distribution in Transformers
par: Yan, Ruiqing, et autres
Publié: (2024)