Image de couverture de livre

Accelerating Local LLMs on Resource-Constrained Edge Devices via Distributed Prompt Caching

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Matsutani, Hiroki, Matsuda, Naoki, Sugiura, Naoto
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning Distributed, Parallel, and Cluster Computing
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

10Cache: Heterogeneous Resource-Aware Tensor Caching and Migration for LLM Training
par: Afroz, Sabiha, et autres
Publié: (2025)

HACK: Homomorphic Acceleration via Compression of the Key-Value Cache for Disaggregated LLM Inference
par: Zhang, Zeyu, et autres
Publié: (2025)

FedMHO: Heterogeneous One-Shot Federated Learning Towards Resource-Constrained Edge Devices
par: Yao, Dezhong, et autres
Publié: (2025)

Efficient Unified Caching for Accelerating Heterogeneous AI Workloads
par: Wang, Tianze, et autres
Publié: (2025)

Will LLMs Scaling Hit the Wall? Breaking Barriers via Distributed Resources on Massive Edge Devices
par: Shen, Tao, et autres
Publié: (2025)

SlimCaching: Edge Caching of Mixture-of-Experts for Distributed Inference
par: Chen, Qian, et autres
Publié: (2025)

Accelerating Transposed Convolutions on FPGA-based Edge Devices
par: Haris, Jude, et autres
Publié: (2025)

REFT: Resource-Efficient Federated Training Framework for Heterogeneous and Resource-Constrained Environments
par: Desai, Humaid Ahmed, et autres
Publié: (2023)

Adaptive Stream Processing on Edge Devices through Active Inference
par: Sedlak, Boris, et autres
Publié: (2024)

Efficient Federated Finetuning of Tiny Transformers with Resource-Constrained Devices
par: Pfeiffer, Kilian, et autres
Publié: (2024)

Detection of Global Anomalies on Distributed IoT Edges with Device-to-Device Communication
par: Ochiai, Hideya, et autres
Publié: (2024)

LIME:Accelerating Collaborative Lossless LLM Inference on Memory-Constrained Edge Devices
par: Sun, Mingyu, et autres
Publié: (2025)

Accelerating Depthwise Separable Convolutions on Ultra-Low-Power Devices
par: Daghero, Francesco, et autres
Publié: (2024)

Two-Timescale Model Caching and Resource Allocation for Edge-Enabled AI-Generated Content Services
par: Liu, Zhang, et autres
Publié: (2024)

Boosting Resource-Constrained Federated Learning Systems with Guessed Updates
par: Boukhari, Mohamed Yassine, et autres
Publié: (2021)

Accelerating Wireless Distributed Learning via Hybrid Split and Federated Learning Optimization
par: Guo, Kun, et autres
Publié: (2025)

Demo: A Practical Testbed for Decentralized Federated Learning on Physical Edge Devices
par: Feng, Chao, et autres
Publié: (2025)

Efficient Split Learning LSTM Models for FPGA-based Edge IoT Devices
par: Molina, Romina Soledad, et autres
Publié: (2025)

Improved Decision Module Selection for Hierarchical Inference in Resource-Constrained Edge Devices
par: Behera, Adarsh Prasad, et autres
Publié: (2024)

Accelerating AIGC Services with Latent Action Diffusion Scheduling in Edge Networks
par: Xu, Changfu, et autres
Publié: (2024)

FEDBUD: Joint Incentive and Privacy Optimization for Resource-Constrained Federated Learning
par: Liu, Tao, et autres
Publié: (2026)

DHO$_2$: Accelerating Distributed Hybrid Order Optimization via Model Parallelism and ADMM
par: Gu, Shunxian, et autres
Publié: (2025)

Model Partition and Resource Allocation for Split Learning in Vehicular Edge Networks
par: Yu, Lu, et autres
Publié: (2024)

Federated Distillation on Edge Devices: Efficient Client-Side Filtering for Non-IID Data
par: Mujtaba, Ahmed, et autres
Publié: (2025)

Priority-Aware Model-Distributed Inference at Edge Networks
par: Li, Teng, et autres
Publié: (2024)

Prada: Black-Box LLM Adaptation with Private Data on Resource-Constrained Devices
par: Wang, Ziyao, et autres
Publié: (2025)

AdaptiveFL: Adaptive Heterogeneous Federated Learning for Resource-Constrained AIoT Systems
par: Jia, Chentao, et autres
Publié: (2023)

EDGE-LLM: Enabling Efficient Large Language Model Adaptation on Edge Devices via Layerwise Unified Compression and Adaptive Layer Tuning and Voting
par: Yu, Zhongzhi, et autres
Publié: (2024)

Leveraging Foundation Models for Efficient Federated Learning in Resource-restricted Edge Networks
par: Atapour, S. Kawa, et autres
Publié: (2024)

MultiTASC++: A Continuously Adaptive Scheduler for Edge-Based Multi-Device Cascade Inference
par: Nikolaidis, Sokratis, et autres
Publié: (2024)

Preble: Efficient Distributed Prompt Scheduling for LLM Serving
par: Srivatsa, Vikranth, et autres
Publié: (2024)

Not All Tokens Are Worth Caching: Learning Semantic-Aware Eviction for LLM Prefix Caches
par: Fang, Shaoke, et autres
Publié: (2026)

TDC-Cache: A Trustworthy Decentralized Cooperative Caching Framework for Web3.0
par: Chen, Jinyu, et autres
Publié: (2025)

Intelligent Orchestration of Distributed Large Foundation Model Inference at the Edge
par: Koch, Fernando, et autres
Publié: (2025)

Distributed Convolutional Neural Network Training on Mobile and Edge Clusters
par: Rama, Pranav, et autres
Publié: (2024)

Incentivizing Permissionless Distributed Learning of LLMs
par: Lidin, Joel, et autres
Publié: (2025)

Learn More by Using Less: Distributed Learning with Energy-Constrained Devices
par: Pereira, Roberto, et autres
Publié: (2024)

LLMBridge: Reducing Costs to Access LLMs in a Prompt-Centric Internet
par: Martin, Noah, et autres
Publié: (2024)

Tackling Resource-Constrained and Data-Heterogeneity in Federated Learning with Double-Weight Sparse Pack
par: Yang, Qiantao, et autres
Publié: (2026)

Efficient Data Distribution Estimation for Accelerated Federated Learning
par: Wang, Yuanli, et autres
Publié: (2024)