Image de couverture de livre

Compiler-First State Space Duality and Portable $O(1)$ Autoregressive Caching for Inference

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteur principal:	Santoni, Cosmo
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning Artificial Intelligence Distributed, Parallel, and Cluster Computing Performance
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

OSCAR: Offline Spectral Covariance-Aware Rotation for 2-bit KV Cache Quantization
par: Zhou, Zhongzhu, et autres
Publié: (2026)

KVPR: Efficient LLM Inference with I/O-Aware KV Cache Partial Recomputation
par: Jiang, Chaoyi, et autres
Publié: (2024)

Sometimes Painful but Certainly Promising: Feasibility and Trade-offs of Language Model Inference at the Edge
par: Abstreiter, Maximilian, et autres
Publié: (2025)

QPART: Adaptive Model Quantization and Dynamic Workload Balancing for Accuracy-aware Edge Inference
par: Li, Xiangchen, et autres
Publié: (2025)

DUAL-BLADE: Dual-Path NVMe-Direct KV-Cache Offloading for Edge LLM Inference
par: Jeong, Bodon, et autres
Publié: (2026)

Agentic Plan Caching: Test-Time Memory for Fast and Cost-Efficient LLM Agents
par: Zhang, Qizheng, et autres
Publié: (2025)

The Illusion of Power Capping in LLM Decode: A Phase-Aware Energy Characterisation Across Attention Architectures
par: Ma, Bole, et autres
Publié: (2026)

Record-Remix-Replay: Hierarchical GPU Kernel Optimization using Evolutionary Search
par: Nichols, Daniel, et autres
Publié: (2026)

Training Time Prediction for Mixed Precision-based Distributed Training
par: Kang, Minchul, et autres
Publié: (2026)

Democratizing AI: A Comparative Study in Deep Learning Efficiency and Future Trends in Computational Processing
par: Amin, Lisan Al, et autres
Publié: (2026)

MQ-GNN: A Multi-Queue Pipelined Architecture for Scalable and Efficient GNN Training
par: Ullah, Irfan, et autres
Publié: (2026)

Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to Systems
par: Miao, Xupeng, et autres
Publié: (2023)

Prompt-Aware Scheduling for Low-Latency LLM Serving
par: Tao, Yiheng, et autres
Publié: (2025)

Multi-Dimensional Autoscaling of Stream Processing Services on Edge Devices
par: Sedlak, Boris, et autres
Publié: (2025)

ProTrain: Efficient LLM Training via Memory-Aware Techniques
par: Yang, Hanmei, et autres
Publié: (2024)

Syno: Structured Synthesis for Neural Operators
par: Zhuo, Yongqi, et autres
Publié: (2024)

Low-Rank GEMM: Efficient Matrix Multiplication via Low-Rank Approximation with FP8 Acceleration
par: Metere, Alfredo
Publié: (2025)

Reliable Microservice Tail Latency Prediction via Decoupled Dual-Stream Learning and Gradient Modulation
par: Qian, Wenzhuo, et autres
Publié: (2025)

TrainMover: An Interruption-Resilient Runtime for ML Training
par: Lao, ChonLam, et autres
Publié: (2024)

FastPersist: Accelerating Model Checkpointing in Deep Learning
par: Wang, Guanhua, et autres
Publié: (2024)

Lightweight Software Kernels and Hardware Extensions for Efficient Sparse Deep Neural Networks on Microcontrollers
par: Daghero, Francesco, et autres
Publié: (2025)

Longer Attention Span: Increasing Transformer Context Length with Sparse Graph Processing Techniques
par: Tomczak, Nathaniel, et autres
Publié: (2025)

Mixture of Experts with Mixture of Precisions for Tuning Quality of Service
par: Imani, HamidReza, et autres
Publié: (2024)

Prism: Unleashing GPU Sharing for Cost-Efficient Multi-LLM Serving
par: Yu, Shan, et autres
Publié: (2025)

GPU Kernel Optimization Beyond Full Builds: An LLM Framework with Minimal Executable Programs
par: Chu, Ruifan, et autres
Publié: (2025)

A Comparative Study of OpenMP Scheduling Algorithm Selection Strategies
par: Korndörfer, Jonas H. Müller, et autres
Publié: (2025)

Cost-Efficient LLM Training with Lifetime-Aware Tensor Offloading via GPUDirect Storage
par: Yuan, Ziqi, et autres
Publié: (2025)

STAlloc: Enhancing Memory Efficiency in Large-Scale Model Training with Spatio-Temporal Planning
par: Huang, Zixiao, et autres
Publié: (2025)

A 4D Hybrid Algorithm to Scale Parallel Training to Thousands of GPUs
par: Singh, Siddharth, et autres
Publié: (2023)

Optimizing the Deployment of Tiny Transformers on Low-Power MCUs
par: Jung, Victor J. B., et autres
Publié: (2024)

Equilibrium in the Computing Continuum through Active Inference
par: Sedlak, Boris, et autres
Publié: (2023)

AutoSP: Unlocking Long-Context LLM Training Via Compiler-Based Sequence Parallelism
par: Gupta, Ahan, et autres
Publié: (2026)

Adaptive Workload Distribution for Accuracy-aware DNN Inference on Collaborative Edge Platforms
par: Taufique, Zain, et autres
Publié: (2023)

KVDirect: Distributed Disaggregated LLM Inference
par: Chen, Shiyang, et autres
Publié: (2024)

CoServe: Efficient Collaboration-of-Experts (CoE) Model Inference with Limited Memory
par: Suo, Jiashun, et autres
Publié: (2025)

ExpertFlow: Adaptive Expert Scheduling and Memory Coordination for Efficient MoE Inference
par: Shen, Zixu, et autres
Publié: (2025)

Deep Optimizer States: Towards Scalable Training of Transformer Models Using Interleaved Offloading
par: Maurya, Avinash, et autres
Publié: (2024)

Multi-DNN Inference of Sparse Models on Edge SoCs
par: Luo, Jiawei, et autres
Publié: (2026)

Efficient Chromosome Parallelization for Precision Medicine Genomic Workflows
par: Montserrat, Daniel Mas, et autres
Publié: (2025)

Glinthawk: A Two-Tiered Architecture for Offline LLM Inference
par: Hamadanian, Pouya, et autres
Publié: (2025)