Imagen de Portada

Parrot: Efficient Serving of LLM-based Applications with Semantic Variable

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Lin, Chaofan, Han, Zhenhua, Zhang, Chengruidong, Yang, Yuqing, Yang, Fan, Chen, Chen, Qiu, Lili
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

LeanK: Learnable K Cache Channel Pruning for Efficient Decoding
por: Zhang, Yike, et al.
Publicado: (2025)

SortedRL: Accelerating RL Training for LLMs through Online Length-Aware Scheduling
por: Zhang, Yiqi, et al.
Publicado: (2026)

Efficient Serving of LLM Applications with Probabilistic Demand Modeling
por: Liu, Yifei, et al.
Publicado: (2025)

VL Norm: Rethink Loss Aggregation in RLVR
por: He, Zhiyuan, et al.
Publicado: (2025)

Scaling Graph Chain-of-Thought Reasoning: A Multi-Agent Framework with Efficient LLM Serving
por: Huan, Chengying, et al.
Publicado: (2025)

QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving
por: Lin, Yujun, et al.
Publicado: (2024)

MTServe: Efficient Serving for Generative Recommendation Models with Hierarchical Caches
por: Wang, Xin, et al.
Publicado: (2026)

LLM Serving Optimization with Variable Prefill and Decode Lengths
por: Wang, Meixuan, et al.
Publicado: (2025)

Position Engineering: Boosting Large Language Models through Positional Information Manipulation
por: He, Zhiyuan, et al.
Publicado: (2024)

RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval
por: Liu, Di, et al.
Publicado: (2024)

Parrot: Multilingual Visual Instruction Tuning
por: Sun, Hai-Long, et al.
Publicado: (2024)

FlashInfer: Efficient and Customizable Attention Engine for LLM Inference Serving
por: Ye, Zihao, et al.
Publicado: (2025)

Analytical Provisioning for Attention-FFN Disaggregated LLM Serving under Stochastic Workloads
por: Song, Chendong, et al.
Publicado: (2026)

EVICPRESS: Joint KV-Cache Compression and Eviction for Efficient LLM Serving
por: Feng, Shaoting, et al.
Publicado: (2025)

Detecting Generative Parroting through Overfitting Masked Autoencoders
por: Taghanaki, Saeid Asgari, et al.
Publicado: (2024)

MTraining: Distributed Dynamic Sparse Attention for Efficient Ultra-Long Context Training
por: Li, Wenxuan, et al.
Publicado: (2025)

AdaServe: Accelerating Multi-SLO LLM Serving with SLO-Customized Speculative Decoding
por: Li, Zikun, et al.
Publicado: (2025)

SUN: Shared Use of Next-token Prediction for Efficient Multi-LLM Disaggregated Serving
por: Woo, Sunghyeon, et al.
Publicado: (2026)

Progressive Sparse Attention: Algorithm and System Co-design for Efficient Attention in LLM Serving
por: Zhou, Qihui, et al.
Publicado: (2025)

TimeSAF: Towards LLM-Guided Semantic Asynchronous Fusion for Time Series Forecasting
por: Zhang, Fan, et al.
Publicado: (2026)

LASA: Language-Agnostic Semantic Alignment at the Semantic Bottleneck for LLM Safety
por: Yang, Junxiao, et al.
Publicado: (2026)

Autellix: An Efficient Serving Engine for LLM Agents as General Programs
por: Luo, Michael, et al.
Publicado: (2025)

VoltanaLLM: Feedback-Driven Frequency Control and State-Space Routing for Energy-Efficient LLM Serving
por: Yu, Jiahuan, et al.
Publicado: (2025)

Region-Adaptive Sampling for Diffusion Transformers
por: Liu, Ziming, et al.
Publicado: (2025)

LServe: Efficient Long-sequence LLM Serving with Unified Sparse Attention
por: Yang, Shang, et al.
Publicado: (2025)

REASONING COMPILER: LLM-Guided Optimizations for Efficient Model Serving
por: Tang, Annabelle Sujun, et al.
Publicado: (2025)

AdaBlock-dLLM: Semantic-Aware Diffusion LLM Inference via Adaptive Block Size
por: Lu, Guanxi, et al.
Publicado: (2025)

Efficient Training-Free Online Routing for High-Volume Multi-LLM Serving
por: Wu, Fangzhou, et al.
Publicado: (2025)

SwiftDiffusion: Efficient Diffusion Model Serving with Add-on Modules
por: Li, Suyi, et al.
Publicado: (2024)

Act Only When It Pays: Efficient Reinforcement Learning for LLM Reasoning via Selective Rollouts
por: Zheng, Haizhong, et al.
Publicado: (2025)

Contrastive Language-Image Pre-Training Model based Semantic Communication Performance Optimization
por: Yang, Shaoran, et al.
Publicado: (2025)

CUDA-LLM: LLMs Can Write Efficient CUDA Kernels
por: Chen, Wentao, et al.
Publicado: (2025)

Get More with LESS: Synthesizing Recurrence with KV Cache Compression for Efficient LLM Inference
por: Dong, Harry, et al.
Publicado: (2024)

SemanticOpt: Towards LLM-Based Semantic Black-Box Optimization
por: Meindl, Jamison, et al.
Publicado: (2025)

Exploratory Memory-Augmented LLM Agent via Hybrid On- and Off-Policy Optimization
por: Liu, Zeyuan, et al.
Publicado: (2026)

Sparse Prefix Caching for Hybrid and Recurrent LLM Serving
por: Shirokikh, Mikhail, et al.
Publicado: (2026)

Prism: Unleashing GPU Sharing for Cost-Efficient Multi-LLM Serving
por: Yu, Shan, et al.
Publicado: (2025)

Taming the Titans: A Survey of Efficient LLM Inference Serving
por: Zhen, Ranran, et al.
Publicado: (2025)

Efficient LLM Reasoning via Variational Posterior Guidance with Efficiency Awareness
por: Chen, Zizhao, et al.
Publicado: (2026)

Personal Information Parroting in Language Models
por: Subramani, Nishant, et al.
Publicado: (2026)