Image de couverture de livre

Tail-Optimized Caching for LLM Inference

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Zhang, Wenxin, Li, Yueying, Moallemi, Ciamac C., Peng, Tianyi
Format:	Preprint
Publié:	2025
Sujets:	Systems and Control
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Multidimensional Blockchain Fees are (Essentially) Optimal
par: Angeris, Guillermo, et autres
Publié: (2024)

Automated Market Making and Arbitrage Profits in the Presence of Fees
par: Milionis, Jason, et autres
Publié: (2023)

Outbidding and Outbluffing Elite Humans: Mastering Liar's Poker via Self-Play and Reinforcement Learning
par: Dewey, Richard, et autres
Publié: (2025)

am-AMM: An Auction-Managed Automated Market Maker
par: Adams, Austin, et autres
Publié: (2024)

Automated Market Making and Loss-Versus-Rebalancing
par: Milionis, Jason, et autres
Publié: (2022)

MegaCacheX: Towards Cost-Effective Hierarchical Collaborative Content Caching in Emerging Mega-Constellations
par: Shi, Haoyang, et autres
Publié: (2025)

Temperature-Aware Scheduling of LLM Inference in Large-Scale Geo-Distributed Edge Data Centers with Distributed Optimization
par: Khalatbarisoltani, Arash, et autres
Publié: (2026)

Loss-Versus-Fair: Efficiency of Dutch Auctions on Blockchains
par: Moallemi, Ciamac C., et autres
Publié: (2024)

Alternating Direction Method of Multipliers-Based Parallel Optimization for Multi-Agent Collision-Free Model Predictive Control
par: Cheng, Zilong, et autres
Publié: (2021)

CDKFormer: Contextual Deviation Knowledge-Based Transformer for Long-Tail Trajectory Prediction
par: Lian, Yuansheng, et autres
Publié: (2025)

Resource Optimization for Tail-Based Control in Wireless Networked Control Systems
par: Vijithasena, Rasika, et autres
Publié: (2024)

Algorithm Design and Comparative Test of Natural Gradient Gaussian Approximation Filter
par: Cao, Wenhan, et autres
Publié: (2025)

Natural Gradient Gaussian Approximation Filter with Positive Definiteness Guarantee
par: Zhang, Tianyi, et autres
Publié: (2026)

Explicit Solution of Tunable Input-to-State Safe-Based Controller Under High-Relative-Degree Constraints
par: Wei, Yan, et autres
Publié: (2025)

Reducing End-to-End Latency of Cause-Effect Chains with Shared Cache Analysis
par: Zhu, Yixuan, et autres
Publié: (2026)

Efficient LLM Inference over Heterogeneous Edge Networks with Speculative Decoding
par: Zhu, Bingjie, et autres
Publié: (2025)

Genie: Smart ROS-based Caching for Connected Autonomous Robots
par: Li, Zexin, et autres
Publié: (2024)

Revenue Optimization in Wireless Video Caching Networks: A Privacy-Preserving Two-Stage Solution
par: Zhang, Yijing, et autres
Publié: (2025)

DynamicAdaptiveClimb: Adaptive Cache Replacement with Dynamic Resizing
par: Berend, Daniel, et autres
Publié: (2025)

Optimization and Control Technologies for Renewable-Dominated Hydrogen-Blended Integrated Gas-Electricity System: A Review
par: Liu, Wenxin, et autres
Publié: (2025)

Beyond Gaussian Assumptions: A General Fractional HJB Control Framework for Lévy-Driven Heavy-Tailed Channels in 6G
par: Li, Mengqi, et autres
Publié: (2025)

A Truthful Mechanism Design for Distributed Optimisation Algorithms in Networks with Self-interested Agents
par: Zhong, Tianyi, et autres
Publié: (2025)

Dual-Loop Robust Control of Biased Koopman Operator Model by Noisy Data of Nonlinear Systems
par: He, Tianyi, et autres
Publié: (2024)

Development of a Simple and Novel Digital Twin Framework for Industrial Robots in Intelligent robotics manufacturing
par: Xiang, Tianyi, et autres
Publié: (2024)

Voluntary Renewable Programs: Optimal Pricing and Revenue Allocation
par: Fan, Zhiyuan, et autres
Publié: (2026)

Stochastic Geometry-Based Performance Evaluation for LEO Satellite-Assisted Space Caching
par: Ma, Chunyi, et autres
Publié: (2025)

Adaptive Federated Learning to Optimize Integrated Flows in Cyber-Physical Data Centers
par: Liu, Junhong, et autres
Publié: (2025)

EV Charging Optimization based on Day-ahead Pricing Incorporating Consumer Behavior
par: Zhang, Qun, et autres
Publié: (2019)

Cooperative Learning-Based Framework for VNF Caching and Placement Optimization over Low Earth Orbit Satellite Networks
par: Doan, Khai, et autres
Publié: (2024)

Topology Inference for Network Systems with Unknown Inputs
par: Jiao, Qing, et autres
Publié: (2020)

Decentralized Optimization on Compact Submanifolds by Quantized Riemannian Gradient Tracking
par: Chen, Jun, et autres
Publié: (2025)

Edge Caching Optimization with PPO and Transfer Learning for Dynamic Environments
par: Niknia, Farnaz, et autres
Publié: (2024)

Conceptualizing and Modeling Communication-Based Cyberattacks on Automated Vehicles
par: Li, Tianyi, et autres
Publié: (2025)

Scale-Invariant Neural Network Optimization: Norm Geometry and Heavy-Tailed Noise
par: Zhang, Jiayu, et autres
Publié: (2026)

Inverse Inference on Cooperative Control of Networked Dynamical Systems
par: Li, Yushan, et autres
Publié: (2025)

LLM-Aided Efficient Hardware Design Automation
par: Xu, Kangwei, et autres
Publié: (2024)

Risk-Aware Robotics: Tail Risk Measures in Planning, Control, and Verification
par: Akella, Prithvi, et autres
Publié: (2024)

Large Language Model (LLM)-enabled In-context Learning for Wireless Network Optimization: A Case Study of Power Control
par: Zhou, Hao, et autres
Publié: (2024)

Design and Optimization of Wearables for Human Motion Energy Harvesting
par: Peng, Weijia, et autres
Publié: (2025)

Nonlinear Bayesian Filtering with Natural Gradient Gaussian Approximation
par: Cao, Wenhan, et autres
Publié: (2024)