Image de couverture de livre

MTServe: Efficient Serving for Generative Recommendation Models with Hierarchical Caches

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Wang, Xin, Ma, Chi, Chen, Shaobin, Wang, Pu, Zhou, Menglei, Qiu, Junyi, Chen, Qiaorui, Sun, Jiayu, Liu, Shijie, Wang, Zehuan, Yu, Lei, Liu, Chuan, Jiang, Fei, Lin, Wei, Wang, Hao, Jiang, Jiawei, Yan, Xiao
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

HLLM: Enhancing Sequential Recommendations via Hierarchical Large Language Models for Item and User Modeling
par: Chen, Junyi, et autres
Publié: (2024)

Efficient Serving for Dynamic Agent Workflows with Prediction-based KV-Cache Management
par: Zheng, Haoyu, et autres
Publié: (2026)

MemServe: Context Caching for Disaggregated LLM Serving with Elastic Memory Pool
par: Hu, Cunchen, et autres
Publié: (2024)

MTGenRec: An Efficient Distributed Training System for Generative Recommendation Models in Meituan
par: Wang, Yuxiang, et autres
Publié: (2025)

HLLM-Creator: Hierarchical LLM-based Personalized Creative Generation
par: Chen, Junyi, et autres
Publié: (2025)

Hierarchical Semantic RL: Tackling the Problem of Dynamic Action Space for RL-based Recommendations
par: Wang, Minmao, et autres
Publié: (2025)

HierarchicalKV: A GPU Hash Table with Cache Semantics for Continuous Online Embedding Storage
par: Rong, Haidong, et autres
Publié: (2026)

Apt-Serve: Adaptive Request Scheduling on Hybrid Cache for Scalable LLM Inference Serving
par: Gao, Shihong, et autres
Publié: (2025)

MTGR: Industrial-Scale Generative Recommendation Framework in Meituan
par: Han, Ruidong, et autres
Publié: (2025)

Adaptive KV Cache Reuse for Fast Long-Context LLM Serving
par: li, Fei, et autres
Publié: (2026)

Continuous Semantic Caching for Low-Cost LLM Serving
par: Atalar, Baran, et autres
Publié: (2026)

EPIC: Efficient Position-Independent Caching for Serving Large Language Models
par: Hu, Junhao, et autres
Publié: (2024)

TinyServe: Query-Aware Cache Selection for Efficient LLM Serving
par: Liu, Dong, et autres
Publié: (2025)

HexAGenT: Efficient Agentic LLM Serving via Workflow- and Heterogeneity-Aware Scheduling
par: Peng, You, et autres
Publié: (2026)

SparKV: Overhead-Aware KV Cache Loading for Efficient On-Device LLM Inference
par: Liu, Hongyao, et autres
Publié: (2026)

ZipMoE: Efficient On-Device MoE Serving via Lossless Compression and Cache-Affinity Scheduling
par: Yang, Yuchen, et autres
Publié: (2026)

Energy‐Efficient Electro‐Fenton Oxidation Enabled by CoCu Dual‐Atom Catalysts with High Oxygen Utilization
par: Wenxin Sun, et autres
Publié: (2025)

EVICPRESS: Joint KV-Cache Compression and Eviction for Efficient LLM Serving
par: Feng, Shaoting, et autres
Publié: (2025)

MEPIC: Memory Efficient Position Independent Caching for LLM Serving
par: Wang, Qian, et autres
Publié: (2025)

One Pool, Two Caches: Adaptive HBM Partitioning for Accelerating Generative Recommender Serving
par: Yu, Wenjun, et autres
Publié: (2026)

SparseX: Efficient Segment-Level KV Cache Sharing for Interleaved LLM Serving
par: Zhang, Quqing, et autres
Publié: (2026)

Ads Recommendation in a Collapsed and Entangled World
par: Pan, Junwei, et autres
Publié: (2024)

Tutti: Making SSD-Backed KV Cache Practical for Long-Context LLM Serving
par: Qiu, Shi, et autres
Publié: (2026)

Efficient Unified Caching for Accelerating Heterogeneous AI Workloads
par: Wang, Tianze, et autres
Publié: (2025)

RAGCache: Efficient Knowledge Caching for Retrieval-Augmented Generation
par: Jin, Chao, et autres
Publié: (2024)

PreciseCache: Precise Feature Caching for Efficient and High-fidelity Video Generation
par: Wang, Jiangshan, et autres
Publié: (2026)

InstCache: A Predictive Cache for LLM Serving
par: Zou, Longwei, et autres
Publié: (2024)

ShadowServe: Interference-Free KV Cache Fetching for Distributed Prefix Caching
par: Xiang, Xingyu, et autres
Publié: (2025)

Hierarchical Deep Counterfactual Regret Minimization
par: Chen, Jiayu, et autres
Publié: (2023)

ReasonCache: Accelerating Large Reasoning Model Serving through KV Cache Sharing
par: Chen, Kaiwen, et autres
Publié: (2025)

Efficient calcium fumarate overproduction from xylose and corncob-derived xylose by engineered strains of Aureobasidium pullulans var. Aubasidani DH177.
par: Wang, Peng, et autres
Publié: (2024)

CacheBlend: Fast Large Language Model Serving for RAG with Cached Knowledge Fusion
par: Yao, Jiayi, et autres
Publié: (2024)

RcLLM: Accelerating Generative Recommendation via Beyond-Prefix KV Caching
par: Zhao, Zhan, et autres
Publié: (2026)

ZSMerge: Zero-Shot KV Cache Compression for Memory-Efficient Long-Context LLMs
par: Liu, Xin, et autres
Publié: (2025)

HatLLM: Hierarchical Attention Masking for Enhanced Collaborative Modeling in LLM-based Recommendation
par: Cui, Yu, et autres
Publié: (2025)

The Coverage Overlapping Problem of Serving Arbitrary Crowds in 3D Drone Cellular Networks
par: Lai, Chuan-Chi, et autres
Publié: (2020)

ForesightKV: Optimizing KV Cache Eviction for Reasoning Models by Learning Long-Term Contribution
par: Dong, Zican, et autres
Publié: (2026)

Beyond Token Eviction: Mixed-Dimension Budget Allocation for Efficient KV Cache Compression
par: Miao, Ruijie, et autres
Publié: (2026)

KV-CoRE: Benchmarking Data-Dependent Low-Rank Compressibility of KV-Caches in LLMs
par: Chen, Jian, et autres
Publié: (2026)

Continuous-time Discrete-space Diffusion Model for Recommendation
par: Liu, Chengyi, et autres
Publié: (2025)