Cover Image

Continual Learning with Query-Only Attention

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Bekal, Gautham, Pujari, Ashish, Kelly, Scott David
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Continual Reinforcement Learning for HVAC Systems Control: Integrating Hypernetworks and Transfer Learning
by: Bekal, Gautham Udayakumar, et al.
Published: (2025)

Provably Learning Attention with Queries
by: Bhattamishra, Satwik, et al.
Published: (2026)

Forward-Only Continual Learning
by: Chen, Jiao, et al.
Published: (2025)

Apollo: A Posteriori Label-Only Membership Inference Attack Towards Machine Unlearning
by: Tang, Liou, et al.
Published: (2025)

Memory Injection Attacks on LLM Agents via Query-Only Interaction
by: Dong, Shen, et al.
Published: (2025)

From Categories to Classifiers: Name-Only Continual Learning by Exploring the Web
by: Prabhu, Ameya, et al.
Published: (2023)

Attention-Only Transformers via Unrolled Subspace Denoising
by: Wang, Peng, et al.
Published: (2025)

Efficient Reinforcement Learning by Reducing Forgetting with Elephant Activation Functions
by: Lan, Qingfeng, et al.
Published: (2025)

Optimised Grouped-Query Attention Mechanism for Transformers
by: Chen, Yuang, et al.
Published: (2024)

Sparse Query Attention (SQA): A Computationally Efficient Attention Mechanism with Query Heads Reduction
by: Filipek, Adam
Published: (2025)

Towards Universal and Black-Box Query-Response Only Attack on LLMs with QROA
by: Jawad, Hussein, et al.
Published: (2024)

Gated Adaptation for Continual Learning in Human Activity Recognition
by: Azghan, Reza Rahimi, et al.
Published: (2026)

Fine-Tuning Attention Modules Only: Enhancing Weight Disentanglement in Task Arithmetic
by: Jin, Ruochen, et al.
Published: (2024)

Coupled Query-Key Dynamics for Attention
by: Gahtan, Barak, et al.
Published: (2026)

Duplex: A Device for Large Language Models with Mixture of Experts, Grouped Query Attention, and Continuous Batching
by: Yun, Sungmin, et al.
Published: (2024)

Streaming Deep Reinforcement Learning Finally Works
by: Elsayed, Mohamed, et al.
Published: (2024)

LoMime: Query-Efficient Membership Inference using Model Extraction in Label-Only Settings
by: Oksuz, Abdullah Caglar, et al.
Published: (2026)

Interleaved Gibbs Diffusion: Generating Discrete-Continuous Data with Implicit Constraints
by: Anil, Gautham Govind, et al.
Published: (2025)

Imitation Learning by State-Only Distribution Matching
by: Boborzi, Damian, et al.
Published: (2022)

Sentiment Analysis of Cyberbullying Data in Social Media
by: Susmitha, Arvapalli Sai, et al.
Published: (2024)

A Novel Framework For Text Detection From Natural Scene Images With Complex Background
by: Kaladagi, Basavaraj, et al.
Published: (2024)

Beyond Uniform Query Distribution: Key-Driven Grouped Query Attention
by: Khan, Zohaib, et al.
Published: (2024)

CLAD-Net: Continual Activity Recognition in Multi-Sensor Wearable Systems
by: Azghan, Reza Rahimi, et al.
Published: (2025)

Beyond Linearity in Attention Projections: The Case for Nonlinear Queries
by: Karbevski, Marko
Published: (2026)

An Attention-based Feature Memory Design for Energy-Efficient Continual Learning
by: Wang, Yuandou, et al.
Published: (2025)

Query Drift Compensation: Enabling Compatibility in Continual Learning of Retrieval Embedding Models
by: Goswami, Dipam, et al.
Published: (2025)

Continual Learning as Computationally Constrained Reinforcement Learning
by: Kumar, Saurabh, et al.
Published: (2023)

Norm$\times$Direction: Restoring the Missing Query Norm in Vision Linear Attention
by: Meng, Weikang, et al.
Published: (2025)

Augmenting Attention with Exponentially Decaying Memory Improves Query-Aware KV Sparsity
by: Wei, Xiuying, et al.
Published: (2026)

vAttention: Dynamic Memory Management for Serving LLMs without PagedAttention
by: Prabhu, Ramya, et al.
Published: (2024)

Active Learning of General Halfspaces: Label Queries vs Membership Queries
by: Diakonikolas, Ilias, et al.
Published: (2024)

When can we Approximate Wide Contrastive Models with Neural Tangent Kernels and Principal Component Analysis?
by: Anil, Gautham Govind, et al.
Published: (2024)

Infinite Width Limits of Self Supervised Neural Networks
by: Fleissner, Maximilian, et al.
Published: (2024)

Reproduction Beyond Benchmarks: ConstBERT and ColBERT-v2 Across Backends and Query Distributions
by: Ghosh, Utshab Kumar, et al.
Published: (2026)

Geometric Preference Elicitation for Minimax Regret Optimization in Uncertainty Matroids
by: Ellendula, Aditya Sai, et al.
Published: (2025)

Emergence of Minimal Circuits for Indirect Object Identification in Attention-Only Transformers
by: Adhikari, Rabin
Published: (2025)

Is More Data Worth the Cost? Dataset Scaling Laws in a Tiny Attention-Only Decoder
by: Wiegand, Götz-Henrik, et al.
Published: (2026)

Not All Queries Need Rewriting: When Prompt-Only LLM Refinement Helps and Hurts Dense Retrieval
by: Kotte, Varun
Published: (2026)

Active Query Synthesis for Preference Learning
by: Nadagouda, Namrata, et al.
Published: (2026)

Active Value Querying to Minimize Additive Error in Subadditive Set Function Learning
by: Černý, Martin, et al.
Published: (2026)