Image de couverture de livre

LLM-dCache: Improving Tool-Augmented LLMs with GPT-Driven Localized Data Caching

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Singh, Simranjit, Fore, Michael, Karatzas, Andreas, Lee, Chaehong, Jian, Yanan, Shangguan, Longfei, Yu, Fuxun, Anagnostopoulos, Iraklis, Stamoulis, Dimitrios
Format:	Preprint
Publié:	2024
Sujets:	Distributed, Parallel, and Cluster Computing Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

RankMap: Priority-Aware Multi-DNN Manager for Heterogeneous Embedded Devices
par: Karatzas, Andreas, et autres
Publié: (2024)

Ecomap: Sustainability-Driven Optimization of Multi-Tenant DNN Execution on Edge Servers
par: Paramanayakam, Varatheepan, et autres
Publié: (2025)

Less is More: Optimizing Function Calling for LLM Execution on Edge Devices
par: Paramanayakam, Varatheepan, et autres
Publié: (2024)

KV Cache Compression for Inference Efficiency in LLMs: A Review
par: Liu, Yanyu, et autres
Publié: (2025)

PerCache: Predictive Hierarchical Cache for RAG Applications on Mobile Devices
par: Liu, Kaiwei, et autres
Publié: (2025)

Adaptive K-PackCache: Cost-Centric Data Caching in Cloud
par: Sarkar, Suvarthi, et autres
Publié: (2025)

CARM Tool: Cache-Aware Roofline Model Automatic Benchmarking and Application Analysis
par: Morgado, José, et autres
Publié: (2026)

CacheFlow: Efficient LLM Serving with 3D-Parallel KV Cache Restoration
par: Nian, Sean, et autres
Publié: (2026)

FedCache: A Knowledge Cache-driven Federated Learning Architecture for Personalized Edge Intelligence
par: Wu, Zhiyuan, et autres
Publié: (2023)

InstCache: A Predictive Cache for LLM Serving
par: Zou, Longwei, et autres
Publié: (2024)

Bridging Cache-Friendliness and Concurrency: A Locality-Optimized In-Memory B-Skiplist
par: Luo, Yicong, et autres
Publié: (2025)

CacheFL: Privacy-Preserving and Efficient Federated Cache Model Fine-Tuning for Vision-Language Models
par: Yi, Mengjun, et autres
Publié: (2025)

Caching Aided Multi-Tenant Serverless Computing
par: Qiao, Chu, et autres
Publié: (2024)

Accelerating Local LLMs on Resource-Constrained Edge Devices via Distributed Prompt Caching
par: Matsutani, Hiroki, et autres
Publié: (2026)

Experimental Analysis of Server-Side Caching for Web Performance
par: Umar, Mohammad, et autres
Publié: (2026)

Efficient LLM Inference with Activation Checkpointing and Hybrid Caching
par: Lee, Sanghyeon, et autres
Publié: (2025)

FastCache: Optimizing Multimodal LLM Serving through Lightweight KV-Cache Compression Framework
par: Zhu, Jianian, et autres
Publié: (2025)

Transaction-Driven Dynamic Reconfiguration for Certificate-Based Payment Systems
par: Shangguan, Lingkang
Publié: (2026)

FLeeC: a Fast Lock-Free Application Cache
par: Costa, André J., et autres
Publié: (2024)

Strata: Hierarchical Context Caching for Long Context Language Model Serving
par: Xie, Zhiqiang, et autres
Publié: (2025)

Comparative Analysis of Distributed Caching Algorithms: Performance Metrics and Implementation Considerations
par: Mayer, Helen, et autres
Publié: (2025)

MemServe: Context Caching for Disaggregated LLM Serving with Elastic Memory Pool
par: Hu, Cunchen, et autres
Publié: (2024)

DiFache: Efficient and Scalable Caching on Disaggregated Memory using Decentralized Coherence
par: Zhang, Hanze, et autres
Publié: (2025)

RcLLM: Accelerating Generative Recommendation via Beyond-Prefix KV Caching
par: Zhao, Zhan, et autres
Publié: (2026)

Fine-Grained Vectorized Merge Sorting on RISC-V: From Register to Cache
par: Zhang, Jin, et autres
Publié: (2024)

RAGCache: Efficient Knowledge Caching for Retrieval-Augmented Generation
par: Jin, Chao, et autres
Publié: (2024)

10Cache: Heterogeneous Resource-Aware Tensor Caching and Migration for LLM Training
par: Afroz, Sabiha, et autres
Publié: (2025)

DualMap: Enabling Both Cache Affinity and Load Balancing for Distributed LLM Serving
par: Yuan, Ying, et autres
Publié: (2026)

PCR: A Prefetch-Enhanced Cache Reuse System for Low-Latency RAG Serving
par: Wang, Wenfeng, et autres
Publié: (2026)

Maxing Out the SVM: Performance Impact of Memory and Program Cache Sizes in the Agave Validator
par: Vural, Turan, et autres
Publié: (2025)

SkyMemory: A LEO Edge Cache for Transformer Inference Optimization and Scale Out
par: Sandholm, Thomas, et autres
Publié: (2025)

TDC-Cache: A Trustworthy Decentralized Cooperative Caching Framework for Web3.0
par: Chen, Jinyu, et autres
Publié: (2025)

KVCache Cache in the Wild: Characterizing and Optimizing KVCache Cache at a Large Cloud Provider
par: Wang, Jiahao, et autres
Publié: (2025)

Not All Tokens Are Worth Caching: Learning Semantic-Aware Eviction for LLM Prefix Caches
par: Fang, Shaoke, et autres
Publié: (2026)

SPAARC: Spatial Proximity and Association based prefetching for Augmented Reality in edge Cache
par: Sreekumar, Nikhil, et autres
Publié: (2025)

Data Caching for Enterprise-Grade Petabyte-Scale OLAP
par: Tang, Chunxu, et autres
Publié: (2024)

Idiosyncrasies of Programmable Caching Engines
par: Peixoto, José, et autres
Publié: (2026)

TraCT: Disaggregated LLM Serving with CXL Shared Memory KV Cache at Rack-Scale
par: Yoon, Dongha, et autres
Publié: (2025)

CausalMesh: A Formally Verified Causally Consistent Distributed Cache with Support for Client Migration
par: Zhang, Haoran, et autres
Publié: (2025)

Adaptive Cache Management for Complex Storage Systems Using CNN-LSTM-Based Spatiotemporal Prediction
par: Wang, Xiaoye, et autres
Publié: (2024)