:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Author:	Das, Anurita
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	https://arxiv.org/abs/2604.21026
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Temporal Abstraction in Reinforcement Learning with Offline Data
by: Ayyagari, Ranga Shaarad, et al.
Published: (2024)

Constrained Edge AI Deployment: Fine-Tuning vs Distillation for LLM Compression
by: Sander, Jacob, et al.
Published: (2025)

Memori: A Persistent Memory Layer for Efficient, Context-Aware LLM Agents
by: Borro, Luiz C., et al.
Published: (2026)

MNN-LLM: A Generic Inference Engine for Fast Large Language Model Deployment on Mobile Devices
by: Wang, Zhaode, et al.
Published: (2025)

BAR Conjecture: the Feasibility of Inference Budget-Constrained LLM Services with Authenticity and Reasoning
by: Zhou, Jinan, et al.
Published: (2025)

Transformer^-1: Input-Adaptive Computation for Resource-Constrained Deployment
by: AI, Lumen, et al.
Published: (2025)

LMCache: An Efficient KV Cache Layer for Enterprise-Scale LLM Inference
by: Liu, Yuhan, et al.
Published: (2025)

Pie: Pooling CPU Memory for LLM Inference
by: Xu, Yi, et al.
Published: (2024)

XQuant: Breaking the Memory Wall for LLM Inference with KV Cache Rematerialization
by: Tomar, Aditya, et al.
Published: (2025)

Adaptive Layer Selection for Layer-Wise Token Pruning in LLM Inference
by: Taniguchi, Rei, et al.
Published: (2026)

Optimizing Mixture-of-Experts Inference Time Combining Model Deployment and Communication Scheduling
by: Li, Jialong, et al.
Published: (2024)

A Study of Skews, Imbalances, and Pathological Conditions in LLM Inference Deployment on GPU Clusters detectable from DPU
by: Moye, Javed I. Khan an Henry Uwabor
Published: (2025)

LIDS: LLM Summary Inference Under the Layered Lens
by: Park, Dylan, et al.
Published: (2026)

Memory- and Latency-Constrained Inference of Large Language Models via Adaptive Split Computing
by: Sung, Mingyu, et al.
Published: (2025)

SpecOffload: Unlocking Latent GPU Capacity for LLM Inference on Resource-Constrained Devices
by: Zhuge, Xiangwen, et al.
Published: (2025)

Memory-Efficient Partitioned DNN Inference on Resource-Constrained Android Crowds
by: Manamperi, Lakshani, et al.
Published: (2026)

BuddyMoE: Exploiting Expert Redundancy to Accelerate Memory-Constrained Mixture-of-Experts Inference
by: Wang, Yun, et al.
Published: (2025)

Energy-Efficient Vision Transformer Inference for Edge-AI Deployment
by: Amanzhol, Nursultan, et al.
Published: (2025)

Safety Game: Inference-Time Alignment of Black-Box LLMs via Constrained Optimization
by: Nguyen, Tuan, et al.
Published: (2025)

HeadInfer: Memory-Efficient LLM Inference by Head-wise Offloading
by: Luo, Cheng, et al.
Published: (2025)

FIT-GNN: Faster Inference Time for GNNs that 'FIT' in Memory Using Coarsening
by: Roy, Shubhajit, et al.
Published: (2024)

STEER: Inference-Time Risk Control via Constrained Quality-Diversity Search
by: Yang, Eric, et al.
Published: (2026)

Constrained Online Convex Optimization with Memory and Predictions
by: Abdullah, Mohammed, et al.
Published: (2026)

CATS: Cascaded Adaptive Tree Speculation for Memory-Limited LLM Inference Acceleration
by: Han, Yuning, et al.
Published: (2026)

XKV: Personalized KV Cache Memory Reduction for Long-Context LLM Inference
by: Li, Weizhuo, et al.
Published: (2024)

Hardware-Aware Parallel Prompt Decoding for Memory-Efficient Acceleration of LLM Inference
by: Chen, Hao Mark, et al.
Published: (2024)

Private LLM Inference on Consumer Blackwell GPUs: A Practical Guide for Cost-Effective Local Deployment in SMEs
by: Knoop, Jonathan, et al.
Published: (2026)

C-Learner: Constrained Learning for Causal Inference
by: Cai, Tiffany Tianhui, et al.
Published: (2024)

Memory by Design: Probabilistic Sequence Layers
by: Dowling, Matthew, et al.
Published: (2026)

Fast Heterogeneous Serving: Scalable Mixed-Scale LLM Allocation for SLO-Constrained Inference
by: Cheng, Jiaming, et al.
Published: (2026)

Outcome-Aware Tool Selection for Semantic Routers: Latency-Constrained Learning Without LLM Inference
by: Chen, Huamin, et al.
Published: (2026)

LCSB: Layer-Cyclic Selective Backpropagation for Memory-Efficient On-Device LLM Fine-Tuning
by: Park, Juneyoung, et al.
Published: (2026)

Feasible-First Exploration for Constrained ML Deployment Optimization in Crash-Prone Hierarchical Search Spaces
by: Lysenstøen, Christian
Published: (2026)

Models Know Their Shortcuts: Deployment-Time Shortcut Mitigation
by: Li, Jiayi, et al.
Published: (2026)

CHIME: Chiplet-based Heterogeneous Near-Memory Acceleration for Edge Multimodal LLM Inference
by: Chen, Yanru, et al.
Published: (2025)

Transformers Don't Need LayerNorm at Inference Time: Scaling LayerNorm Removal to GPT-2 XL and the Implications for Mechanistic Interpretability
by: Baroni, Luca, et al.
Published: (2025)

Forecasting LLM Inference Performance via Hardware-Agnostic Analytical Modeling
by: Patwari, Rajeev, et al.
Published: (2025)

HELIOS: Adaptive Model And Early-Exit Selection for Efficient LLM Inference Serving
by: Kumar, Avinash, et al.
Published: (2025)

MicroNAS: Memory and Latency Constrained Hardware-Aware Neural Architecture Search for Time Series Classification on Microcontrollers
by: King, Tobias, et al.
Published: (2023)

Beyond Test-Time Memory: State-Space Optimal Control for LLM Reasoning
by: Wang, Peihao, et al.
Published: (2026)