Imagen de Portada

Polar Sparsity: High Throughput Batched LLM Inferencing with Scalable Contextual Sparsity

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Shrestha, Susav, Settlemyer, Brad, Dryden, Nikoli, Reddy, Narasimha
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Token-Driven GammaTune: Adaptive Calibration for Enhanced Speculative Decoding
por: Gautam, Aayush, et al.
Publicado: (2025)

Fast Forward: Accelerating LLM Prefill with Predictive FFN Sparsity
por: Gautam, Aayush, et al.
Publicado: (2026)

ShadowLLM: Predictor-based Contextual Sparsity for Large Language Models
por: Akhauri, Yash, et al.
Publicado: (2024)

S$^{2}$FT: Efficient, Scalable and Generalizable LLM Fine-tuning by Structured Sparsity
por: Yang, Xinyu, et al.
Publicado: (2024)

HashAttention: Semantic Sparsity for Faster Inference
por: Desai, Aditya, et al.
Publicado: (2024)

Inference Time Context Sparsity: Illusion or Opportunity?
por: Joshi, Sahil, et al.
Publicado: (2026)

WiSparse: Boosting LLM Inference Efficiency with Weight-Aware Mixed Activation Sparsity
por: Chen, Lei, et al.
Publicado: (2026)

Improving Decision Sparsity
por: Sun, Yiyang, et al.
Publicado: (2024)

Homeostasis and Sparsity in Transformer
por: Kotyuzanskiy, Leonid, et al.
Publicado: (2024)

Defending Membership Inference Attacks via Privacy-aware Sparsity Tuning
por: Hu, Qiang, et al.
Publicado: (2024)

RaaS: Reasoning-Aware Attention Sparsity for Efficient LLM Reasoning
por: Hu, Junhao, et al.
Publicado: (2025)

Sparsity and Superposition in Mixture of Experts
por: Chaudhari, Marmik, et al.
Publicado: (2025)

Sparsity and Out-of-Distribution Generalization
por: Aaronson, Scott, et al.
Publicado: (2026)

PLADIS: Pushing the Limits of Attention in Diffusion Models at Inference Time by Leveraging Sparsity
por: Kim, Kwanyoung, et al.
Publicado: (2025)

The Unseen Frontier: Pushing the Limits of LLM Sparsity with Surrogate-Free ADMM
por: Lee, Kwanhee, et al.
Publicado: (2025)

BatchLLM: Optimizing Large Batched LLM Inference with Global Prefix Sharing and Throughput-oriented Token Batching
por: Zheng, Zhen, et al.
Publicado: (2024)

Accelerating Transformer Inference and Training with 2:4 Activation Sparsity
por: Haziza, Daniel, et al.
Publicado: (2025)

Weight Sparsity Complements Activity Sparsity in Neuromorphic Language Models
por: Mukherji, Rishav, et al.
Publicado: (2024)

On the Sparsity of the Strong Lottery Ticket Hypothesis
por: Natale, Emanuele, et al.
Publicado: (2024)

On the Identifiability of Nonlinear ICA: Sparsity and Beyond
por: Zheng, Yujia, et al.
Publicado: (2022)

Wasserstein Distances, Neuronal Entanglement, and Sparsity
por: Sawmya, Shashata, et al.
Publicado: (2024)

Sparsity-Aware Evolution for Model Merging
por: Zhang, Huan, et al.
Publicado: (2026)

Scaling Attention via Feature Sparsity
por: Xie, Yan, et al.
Publicado: (2026)

Robot Learning with Sparsity and Scarcity
por: Xu, Jingxi
Publicado: (2025)

Memory-Efficient LLM Training with Dynamic Sparsity: From Stability to Practical Scaling
por: Xiao, Qiao, et al.
Publicado: (2026)

Weight Concentration Regularization for Improving Pruning Robustness Under High Sparsity
por: Yun, Vincent-Daniel, et al.
Publicado: (2025)

Dynamic Sparsity: Challenging Common Sparsity Assumptions for Learning World Models in Robotic Reinforcement Learning Benchmarks
por: Pandaram, Muthukumar, et al.
Publicado: (2025)

SVD Contextual Sparsity Predictors for Fast LLM Inference
por: Serbin, Georgii, et al.
Publicado: (2026)

Accelerating LLM Inference with Flexible N:M Sparsity via A Fully Digital Compute-in-Memory Accelerator
por: Ramachandran, Akshat, et al.
Publicado: (2025)

ALISA: Accelerating Large Language Model Inference via Sparsity-Aware KV Caching
por: Zhao, Youpeng, et al.
Publicado: (2024)

MaskLLM: Learnable Semi-Structured Sparsity for Large Language Models
por: Fang, Gongfan, et al.
Publicado: (2024)

Mitigating Non-IID Drift in Zeroth-Order Federated LLM Fine-Tuning with Transferable Sparsity
por: Ran, Yide, et al.
Publicado: (2025)

On the Interplay Between Sparsity and Training in Deep Reinforcement Learning
por: Davelouis, Fatima, et al.
Publicado: (2025)

An Efficient Training Algorithm for Models with Block-wise Sparsity
por: Zhu, Ding, et al.
Publicado: (2025)

Sparsity-Driven Plasticity in Multi-Task Reinforcement Learning
por: Todorov, Aleksandar, et al.
Publicado: (2025)

Joint Training Across Multiple Activation Sparsity Regimes
por: Wang, Haotian
Publicado: (2026)

Towards the Connection between Activation Sparsity and Flat Minima
por: Peng, Ze, et al.
Publicado: (2026)

Compositional Sparsity as an Inductive Bias for Neural Architecture Design
por: Lin, Hongyu, et al.
Publicado: (2026)

Navigating Extremes: Dynamic Sparsity in Large Output Spaces
por: Ullah, Nasib, et al.
Publicado: (2024)

Post-Training Statistical Calibration for Higher Activation Sparsity
por: Chua, Vui Seng, et al.
Publicado: (2024)