Copertina

MTServe: Efficient Serving for Generative Recommendation Models with Hierarchical Caches

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Wang, Xin, Ma, Chi, Chen, Shaobin, Wang, Pu, Zhou, Menglei, Qiu, Junyi, Chen, Qiaorui, Sun, Jiayu, Liu, Shijie, Wang, Zehuan, Yu, Lei, Liu, Chuan, Jiang, Fei, Lin, Wei, Wang, Hao, Jiang, Jiawei, Yan, Xiao
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Machine Learning Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

HLLM: Enhancing Sequential Recommendations via Hierarchical Large Language Models for Item and User Modeling
di: Chen, Junyi, et al.
Pubblicazione: (2024)

Efficient Serving for Dynamic Agent Workflows with Prediction-based KV-Cache Management
di: Zheng, Haoyu, et al.
Pubblicazione: (2026)

MemServe: Context Caching for Disaggregated LLM Serving with Elastic Memory Pool
di: Hu, Cunchen, et al.
Pubblicazione: (2024)

MTGenRec: An Efficient Distributed Training System for Generative Recommendation Models in Meituan
di: Wang, Yuxiang, et al.
Pubblicazione: (2025)

HLLM-Creator: Hierarchical LLM-based Personalized Creative Generation
di: Chen, Junyi, et al.
Pubblicazione: (2025)

Hierarchical Semantic RL: Tackling the Problem of Dynamic Action Space for RL-based Recommendations
di: Wang, Minmao, et al.
Pubblicazione: (2025)

HierarchicalKV: A GPU Hash Table with Cache Semantics for Continuous Online Embedding Storage
di: Rong, Haidong, et al.
Pubblicazione: (2026)

Apt-Serve: Adaptive Request Scheduling on Hybrid Cache for Scalable LLM Inference Serving
di: Gao, Shihong, et al.
Pubblicazione: (2025)

MTGR: Industrial-Scale Generative Recommendation Framework in Meituan
di: Han, Ruidong, et al.
Pubblicazione: (2025)

Adaptive KV Cache Reuse for Fast Long-Context LLM Serving
di: li, Fei, et al.
Pubblicazione: (2026)

Continuous Semantic Caching for Low-Cost LLM Serving
di: Atalar, Baran, et al.
Pubblicazione: (2026)

EPIC: Efficient Position-Independent Caching for Serving Large Language Models
di: Hu, Junhao, et al.
Pubblicazione: (2024)

TinyServe: Query-Aware Cache Selection for Efficient LLM Serving
di: Liu, Dong, et al.
Pubblicazione: (2025)

HexAGenT: Efficient Agentic LLM Serving via Workflow- and Heterogeneity-Aware Scheduling
di: Peng, You, et al.
Pubblicazione: (2026)

SparKV: Overhead-Aware KV Cache Loading for Efficient On-Device LLM Inference
di: Liu, Hongyao, et al.
Pubblicazione: (2026)

ZipMoE: Efficient On-Device MoE Serving via Lossless Compression and Cache-Affinity Scheduling
di: Yang, Yuchen, et al.
Pubblicazione: (2026)

Energy‐Efficient Electro‐Fenton Oxidation Enabled by CoCu Dual‐Atom Catalysts with High Oxygen Utilization
di: Wenxin Sun, et al.
Pubblicazione: (2025)

EVICPRESS: Joint KV-Cache Compression and Eviction for Efficient LLM Serving
di: Feng, Shaoting, et al.
Pubblicazione: (2025)

MEPIC: Memory Efficient Position Independent Caching for LLM Serving
di: Wang, Qian, et al.
Pubblicazione: (2025)

One Pool, Two Caches: Adaptive HBM Partitioning for Accelerating Generative Recommender Serving
di: Yu, Wenjun, et al.
Pubblicazione: (2026)

SparseX: Efficient Segment-Level KV Cache Sharing for Interleaved LLM Serving
di: Zhang, Quqing, et al.
Pubblicazione: (2026)

Ads Recommendation in a Collapsed and Entangled World
di: Pan, Junwei, et al.
Pubblicazione: (2024)

Tutti: Making SSD-Backed KV Cache Practical for Long-Context LLM Serving
di: Qiu, Shi, et al.
Pubblicazione: (2026)

Efficient Unified Caching for Accelerating Heterogeneous AI Workloads
di: Wang, Tianze, et al.
Pubblicazione: (2025)

RAGCache: Efficient Knowledge Caching for Retrieval-Augmented Generation
di: Jin, Chao, et al.
Pubblicazione: (2024)

PreciseCache: Precise Feature Caching for Efficient and High-fidelity Video Generation
di: Wang, Jiangshan, et al.
Pubblicazione: (2026)

InstCache: A Predictive Cache for LLM Serving
di: Zou, Longwei, et al.
Pubblicazione: (2024)

ShadowServe: Interference-Free KV Cache Fetching for Distributed Prefix Caching
di: Xiang, Xingyu, et al.
Pubblicazione: (2025)

Hierarchical Deep Counterfactual Regret Minimization
di: Chen, Jiayu, et al.
Pubblicazione: (2023)

ReasonCache: Accelerating Large Reasoning Model Serving through KV Cache Sharing
di: Chen, Kaiwen, et al.
Pubblicazione: (2025)

Efficient calcium fumarate overproduction from xylose and corncob-derived xylose by engineered strains of Aureobasidium pullulans var. Aubasidani DH177.
di: Wang, Peng, et al.
Pubblicazione: (2024)

CacheBlend: Fast Large Language Model Serving for RAG with Cached Knowledge Fusion
di: Yao, Jiayi, et al.
Pubblicazione: (2024)

RcLLM: Accelerating Generative Recommendation via Beyond-Prefix KV Caching
di: Zhao, Zhan, et al.
Pubblicazione: (2026)

ZSMerge: Zero-Shot KV Cache Compression for Memory-Efficient Long-Context LLMs
di: Liu, Xin, et al.
Pubblicazione: (2025)

HatLLM: Hierarchical Attention Masking for Enhanced Collaborative Modeling in LLM-based Recommendation
di: Cui, Yu, et al.
Pubblicazione: (2025)

The Coverage Overlapping Problem of Serving Arbitrary Crowds in 3D Drone Cellular Networks
di: Lai, Chuan-Chi, et al.
Pubblicazione: (2020)

ForesightKV: Optimizing KV Cache Eviction for Reasoning Models by Learning Long-Term Contribution
di: Dong, Zican, et al.
Pubblicazione: (2026)

Beyond Token Eviction: Mixed-Dimension Budget Allocation for Efficient KV Cache Compression
di: Miao, Ruijie, et al.
Pubblicazione: (2026)

KV-CoRE: Benchmarking Data-Dependent Low-Rank Compressibility of KV-Caches in LLMs
di: Chen, Jian, et al.
Pubblicazione: (2026)

Continuous-time Discrete-space Diffusion Model for Recommendation
di: Liu, Chengyi, et al.
Pubblicazione: (2025)