Imagen de Portada

Tail-Optimized Caching for LLM Inference

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Zhang, Wenxin, Li, Yueying, Moallemi, Ciamac C., Peng, Tianyi
Formato:	Preprint
Publicado:	2025
Materias:	Systems and Control
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Multidimensional Blockchain Fees are (Essentially) Optimal
por: Angeris, Guillermo, et al.
Publicado: (2024)

Automated Market Making and Arbitrage Profits in the Presence of Fees
por: Milionis, Jason, et al.
Publicado: (2023)

Outbidding and Outbluffing Elite Humans: Mastering Liar's Poker via Self-Play and Reinforcement Learning
por: Dewey, Richard, et al.
Publicado: (2025)

am-AMM: An Auction-Managed Automated Market Maker
por: Adams, Austin, et al.
Publicado: (2024)

Automated Market Making and Loss-Versus-Rebalancing
por: Milionis, Jason, et al.
Publicado: (2022)

MegaCacheX: Towards Cost-Effective Hierarchical Collaborative Content Caching in Emerging Mega-Constellations
por: Shi, Haoyang, et al.
Publicado: (2025)

Temperature-Aware Scheduling of LLM Inference in Large-Scale Geo-Distributed Edge Data Centers with Distributed Optimization
por: Khalatbarisoltani, Arash, et al.
Publicado: (2026)

Loss-Versus-Fair: Efficiency of Dutch Auctions on Blockchains
por: Moallemi, Ciamac C., et al.
Publicado: (2024)

Alternating Direction Method of Multipliers-Based Parallel Optimization for Multi-Agent Collision-Free Model Predictive Control
por: Cheng, Zilong, et al.
Publicado: (2021)

CDKFormer: Contextual Deviation Knowledge-Based Transformer for Long-Tail Trajectory Prediction
por: Lian, Yuansheng, et al.
Publicado: (2025)

Resource Optimization for Tail-Based Control in Wireless Networked Control Systems
por: Vijithasena, Rasika, et al.
Publicado: (2024)

Algorithm Design and Comparative Test of Natural Gradient Gaussian Approximation Filter
por: Cao, Wenhan, et al.
Publicado: (2025)

Natural Gradient Gaussian Approximation Filter with Positive Definiteness Guarantee
por: Zhang, Tianyi, et al.
Publicado: (2026)

Explicit Solution of Tunable Input-to-State Safe-Based Controller Under High-Relative-Degree Constraints
por: Wei, Yan, et al.
Publicado: (2025)

Reducing End-to-End Latency of Cause-Effect Chains with Shared Cache Analysis
por: Zhu, Yixuan, et al.
Publicado: (2026)

Efficient LLM Inference over Heterogeneous Edge Networks with Speculative Decoding
por: Zhu, Bingjie, et al.
Publicado: (2025)

Genie: Smart ROS-based Caching for Connected Autonomous Robots
por: Li, Zexin, et al.
Publicado: (2024)

Revenue Optimization in Wireless Video Caching Networks: A Privacy-Preserving Two-Stage Solution
por: Zhang, Yijing, et al.
Publicado: (2025)

DynamicAdaptiveClimb: Adaptive Cache Replacement with Dynamic Resizing
por: Berend, Daniel, et al.
Publicado: (2025)

Optimization and Control Technologies for Renewable-Dominated Hydrogen-Blended Integrated Gas-Electricity System: A Review
por: Liu, Wenxin, et al.
Publicado: (2025)

Beyond Gaussian Assumptions: A General Fractional HJB Control Framework for Lévy-Driven Heavy-Tailed Channels in 6G
por: Li, Mengqi, et al.
Publicado: (2025)

A Truthful Mechanism Design for Distributed Optimisation Algorithms in Networks with Self-interested Agents
por: Zhong, Tianyi, et al.
Publicado: (2025)

Dual-Loop Robust Control of Biased Koopman Operator Model by Noisy Data of Nonlinear Systems
por: He, Tianyi, et al.
Publicado: (2024)

Development of a Simple and Novel Digital Twin Framework for Industrial Robots in Intelligent robotics manufacturing
por: Xiang, Tianyi, et al.
Publicado: (2024)

Voluntary Renewable Programs: Optimal Pricing and Revenue Allocation
por: Fan, Zhiyuan, et al.
Publicado: (2026)

Stochastic Geometry-Based Performance Evaluation for LEO Satellite-Assisted Space Caching
por: Ma, Chunyi, et al.
Publicado: (2025)

Adaptive Federated Learning to Optimize Integrated Flows in Cyber-Physical Data Centers
por: Liu, Junhong, et al.
Publicado: (2025)

EV Charging Optimization based on Day-ahead Pricing Incorporating Consumer Behavior
por: Zhang, Qun, et al.
Publicado: (2019)

Cooperative Learning-Based Framework for VNF Caching and Placement Optimization over Low Earth Orbit Satellite Networks
por: Doan, Khai, et al.
Publicado: (2024)

Topology Inference for Network Systems with Unknown Inputs
por: Jiao, Qing, et al.
Publicado: (2020)

Decentralized Optimization on Compact Submanifolds by Quantized Riemannian Gradient Tracking
por: Chen, Jun, et al.
Publicado: (2025)

Edge Caching Optimization with PPO and Transfer Learning for Dynamic Environments
por: Niknia, Farnaz, et al.
Publicado: (2024)

Conceptualizing and Modeling Communication-Based Cyberattacks on Automated Vehicles
por: Li, Tianyi, et al.
Publicado: (2025)

Scale-Invariant Neural Network Optimization: Norm Geometry and Heavy-Tailed Noise
por: Zhang, Jiayu, et al.
Publicado: (2026)

Inverse Inference on Cooperative Control of Networked Dynamical Systems
por: Li, Yushan, et al.
Publicado: (2025)

LLM-Aided Efficient Hardware Design Automation
por: Xu, Kangwei, et al.
Publicado: (2024)

Risk-Aware Robotics: Tail Risk Measures in Planning, Control, and Verification
por: Akella, Prithvi, et al.
Publicado: (2024)

Large Language Model (LLM)-enabled In-context Learning for Wireless Network Optimization: A Case Study of Power Control
por: Zhou, Hao, et al.
Publicado: (2024)

Design and Optimization of Wearables for Human Motion Energy Harvesting
por: Peng, Weijia, et al.
Publicado: (2025)

Nonlinear Bayesian Filtering with Natural Gradient Gaussian Approximation
por: Cao, Wenhan, et al.
Publicado: (2024)