Cover Image

Interdomain Attention: Beyond Token-Level Key-Value Memory

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Kiyohara, Naoki, Zhu, Harrison Bo Hua, Hassanin, Riccardo El, Sun, Zhuo, Chen, Wenlong, Bhatt, Samir, Li, Yingzhen
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Recurrent Memory for Online Interdomain Gaussian Processes
by: Chen, Wenlong, et al.
Published: (2025)

Neural Stochastic Flows: Solver-Free Modelling and Inference for SDE Solutions
by: Kiyohara, Naoki, et al.
Published: (2025)

Calibrating Transformers via Sparse Gaussian Processes
by: Chen, Wenlong, et al.
Published: (2023)

HiBBO: HiPPO-based Space Consistency for High-dimensional Bayesian Optimisation
by: Xuan, Junyu, et al.
Published: (2025)

Trellis: Learning to Compress Key-Value Memory in Attention Models
by: Karami, Mahdi, et al.
Published: (2025)

Compact Memory for Continual Logistic Regression
by: Jung, Yohan, et al.
Published: (2025)

Shallow Neural Networks Learn Low-Degree Spherical Polynomials with Feature Learning by Learnable Channel Attention
by: Yang, Yingzhen
Published: (2025)

Bayesian Computation in Deep Learning
by: Chen, Wenlong, et al.
Published: (2025)

Efficient Visual Transformer by Learnable Token Merging
by: Wang, Yancheng, et al.
Published: (2024)

TokenShapley: Token Level Context Attribution with Shapley Value
by: Xiao, Yingtai, et al.
Published: (2025)

Your Image is Secretly the Last Frame of a Pseudo Video
by: Chen, Wenlong, et al.
Published: (2024)

Saliency-Aware Regularized Quantization Calibration for Large Language Models
by: Zhao, Yanlong, et al.
Published: (2026)

Low-Rank Key Value Attention
by: O'Neill, James, et al.
Published: (2026)

Graph Contrastive Learning with Low-Rank Regularization and Low-Rank Attention for Noisy Node Classification
by: Wang, Yancheng, et al.
Published: (2024)

Value-State Gated Attention for Mitigating Extreme-Token Phenomena in Transformers
by: Bu, Rui, et al.
Published: (2025)

Locally Regularized Sparse Graph by Fast Proximal Gradient Descent
by: Sun, Dongfang, et al.
Published: (2024)

Learning Informative Attention Weights for Person Re-Identification
by: Wang, Yancheng, et al.
Published: (2025)

Is it a Real CD Mismatch in Interdomain Routing?
by: Letong, Sun, et al.
Published: (2024)

Transformer Key-Value Memories Are Nearly as Interpretable as Sparse Autoencoders
by: Ye, Mengyu, et al.
Published: (2025)

Diffusion Models for Inverse Problems in the Exponential Family
by: Micheli, Alessandro, et al.
Published: (2025)

NeuralSurv: Deep Survival Analysis with Bayesian Uncertainty Quantification
by: Monod, Mélodie, et al.
Published: (2025)

Self-Indexing KVCache: Predicting Sparse Attention from Compressed Keys
by: Yang, Xu, et al.
Published: (2026)

ZoomR: Memory Efficient Reasoning through Multi-Granularity Key Value Retrieval
by: Yang, David H., et al.
Published: (2026)

Improved Generalization Bounds for Transductive Learning by Transductive Local Complexity and Its Applications
by: Yang, Yingzhen
Published: (2023)

Visual Attention Methods in Deep Learning: An In-Depth Survey
by: Hassanin, Mohammed, et al.
Published: (2022)

LOOKAT: Lookup-Optimized Key-Attention for Memory-Efficient Transformers
by: Karmore, Aryan
Published: (2026)

MKA: Memory-Keyed Attention for Efficient Long-Context Reasoning
by: Liu, Dong, et al.
Published: (2026)

Neural Attention Search Linear: Towards Adaptive Token-Level Hybrid Attention Models
by: Deng, Difan, et al.
Published: (2026)

Key and Value Weights Are Probably All You Need: On the Necessity of the Query, Key, Value weight Triplet in Self-Attention Transformers
by: Karbevski, Marko, et al.
Published: (2025)

Variational Uncertainty Decomposition for In-Context Learning
by: Jayasekera, I. Shavindra, et al.
Published: (2025)

Diffusion Alignment Beyond KL: Variance Minimisation as Effective Policy Optimiser
by: Ou, Zijing, et al.
Published: (2026)

MLKV: Multi-Layer Key-Value Heads for Memory Efficient Transformer Decoding
by: Zuhri, Zayd Muhammad Kawakibi, et al.
Published: (2024)

Reducing Transformer Key-Value Cache Size with Cross-Layer Attention
by: Brandon, William, et al.
Published: (2024)

Thin Keys, Full Values: Reducing KV Cache via Low-Dimensional Attention Selection
by: Yao, Hengshuai, et al.
Published: (2026)

Causal Attention with Lookahead Keys
by: Song, Zhuoqing, et al.
Published: (2025)

OPPO: Bayesian Value Recursion for Token-Level Credit Assignment in LLM Reasoning
by: Li, Yu, et al.
Published: (2026)

Neural Flow Samplers with Shortcut Models
by: Chen, Wuhao, et al.
Published: (2025)

Spectral Transformer Neural Processes
by: Chen, Xianhe, et al.
Published: (2026)

Off-Policy Evaluation of Slate Bandit Policies via Optimizing Abstraction
by: Kiyohara, Haruka, et al.
Published: (2024)

Entropic Riemannian Neural Optimal Transport
by: Micheli, Alessandro, et al.
Published: (2026)