Cover Image

SPHERICAL KV: Angle-Domain Attention and Rate-Distortion Retention for Efficient Long-Context Inference

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chauhan, Anay, Kumar, Gurucharan Marthi Krishna, Das, Arion, Dhanda, Amit, Jain, Vinija, Chadha, Aman, Das, Amitava
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Computation and Language Information Theory I.2.6; I.2.7
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

QuickSilver -- Speeding up LLM Inference through Dynamic Token Halting, KV Skipping, Contextual Token Fusion, and Adaptive Matryoshka Quantization
by: Khanna, Danush, et al.
Published: (2025)

Can LLMs faithfully generate their layperson-understandable 'self'?: A Case Study in High-Stakes Domains
by: Das, Arion, et al.
Published: (2024)

Transactional Attention: Semantic Sponsorship for KV-Cache Retention
by: Basu, Abhinaba
Published: (2026)

Hierarchical Prompting Taxonomy: A Universal Evaluation Framework for Large Language Models Aligned with Human Cognitive Principles
by: Budagam, Devichand, et al.
Published: (2024)

FEDTAIL: Federated Long-Tailed Domain Generalization with Sharpness-Guided Gradient Matching
by: Gupta, Sunny, et al.
Published: (2025)

TIME: Temporally Intelligent Meta-reasoning Engine for Context-Triggered Explicit Reasoning
by: Das, Susmit
Published: (2026)

SPINAL -- Scaling-law and Preference Integration in Neural Alignment Layers
by: Das, Arion, et al.
Published: (2026)

CCVA-FL: Cross-Client Variations Adaptive Federated Learning for Medical Imaging
by: Gupta, Sunny, et al.
Published: (2024)

SweEval: Do LLMs Really Swear? A Safety Benchmark for Testing Limits for Enterprise Use
by: Patel, Hitesh Laxmichand, et al.
Published: (2025)

On the Limits of Learned Importance Scoring for KV Cache Compression
by: Steele, Brady
Published: (2026)

Implementing Knowledge Representation and Reasoning with Object Oriented Design
by: Bassiouny, Abdelrhman, et al.
Published: (2026)

Lifelong Learning in Vision-Language Models: Enhanced EWC with Cross-Modal Knowledge Retention
by: Durrani, Hamza Ahmed, et al.
Published: (2026)

A Domain-Agnostic Neurosymbolic Approach for Big Social Data Analysis: Evaluating Mental Health Sentiment on Social Media during COVID-19
by: Khandelwal, Vedant, et al.
Published: (2024)

ProbeScale: Probing Analysis to Optimize Neural Scaling Laws for Efficient Small Language Model Inference
by: Das, Sourav
Published: (2026)

Recurrent Memory-Augmented Transformers with Chunked Attention for Long-Context Language Modeling
by: Kashyap, Ankit
Published: (2025)

Which Backbone to Use: A Resource-efficient Domain Specific Comparison for Computer Vision
by: Jeevan, Pranav, et al.
Published: (2024)

EvoIQA - Explaining Image Distortions with Evolved White-Box Logic
by: Gupta, Ruchika, et al.
Published: (2026)

Active Inference for an Intelligent Agent in Autonomous Reconnaissance Missions
by: Schubert, Johan, et al.
Published: (2025)

Curb Your Attention: Causal Attention Gating for Robust Trajectory Prediction in Autonomous Driving
by: Ahmadi, Ehsan, et al.
Published: (2024)

WaveMix: A Resource-efficient Neural Network for Image Analysis
by: Jeevan, Pranav, et al.
Published: (2022)

The Final-Stage Bottleneck: A Systematic Dissection of the R-Learner for Network Causal Inference
by: Sairam, S, et al.
Published: (2025)

MIRAGE: Scaling Test-Time Inference with Parallel Graph-Retrieval-Augmented Reasoning Chains
by: Wei, Kaiwen, et al.
Published: (2025)

KV-Fold: One-Step KV-Cache Recurrence for Long-Context Inference
by: Nadali, Alireza, et al.
Published: (2026)

FedStein: Enhancing Multi-Domain Federated Learning Through James-Stein Estimator
by: Gupta, Sunny, et al.
Published: (2024)

UniVarFL: Uniformity and Variance Regularized Federated Learning for Heterogeneous Data
by: Gupta, Sunny, et al.
Published: (2025)

EmoLoom-2B: Fast Base-Model Screening for Emotion Classification and VAD with Lexicon-Weak Supervision and KV-Off Evaluation
by: Li, Zilin, et al.
Published: (2026)

Bayesian Attention Mechanism: A Probabilistic Framework for Positional Encoding and Context Length Extrapolation
by: Bianchessi, Arthur S., et al.
Published: (2025)

Active Context Compression: Autonomous Memory Management in LLM Agents
by: Verma, Nikhil
Published: (2026)

FedAlign: Federated Domain Generalization with Cross-Client Feature Alignment
by: Gupta, Sunny, et al.
Published: (2025)

FLD+: Data-efficient Evaluation Metric for Generative Models
by: Jeevan, Pranav, et al.
Published: (2024)

WaveMixSR-V2: Enhancing Super-resolution with Higher Efficiency
by: Jeevan, Pranav, et al.
Published: (2024)

Normalizing Flow-Based Metric for Image Generation
by: Jeevan, Pranav, et al.
Published: (2024)

Genflow Ad Studio: A Compound AI Architecture for Brand-Aligned, Self-Correcting Video Generation
by: Das, Debanshu, et al.
Published: (2026)

Context-Aware Network Based on Multi-scale Spatio-temporal Attention for Action Recognition in Videos
by: Li, Xiaoyang, et al.
Published: (2025)

Attention-based sequential recommendation system using multimodal data
by: Oh, Hyungtaik, et al.
Published: (2024)

ContextBench: A Benchmark for Context Retrieval in Coding Agents
by: Li, Han, et al.
Published: (2026)

Zero-Shot Context Generalization in Reinforcement Learning from Few Training Contexts
by: Chapman, James, et al.
Published: (2025)

CSSDM Ontology to Enable Continuity of Care Data Interoperability
by: Das, Subhashis, et al.
Published: (2025)

MILLION: Mastering Long-Context LLM Inference Via Outlier-Immunized KV Product Quantization
by: Wang, Zongwu, et al.
Published: (2025)

APC-GNN++: An Adaptive Patient-Centric GNN with Context-Aware Attention and Mini-Graph Explainability for Diabetes Classification
by: Berkani, Khaled
Published: (2025)