Image de couverture de livre

LLMBridge: Reducing Costs to Access LLMs in a Prompt-Centric Internet

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Martin, Noah, Faisal, Abdullah Bin, Eltigani, Hiba, Haroon, Rukhshan, Lamelas, Swaminathan, Dogar, Fahad
Format:	Preprint
Publié:	2024
Sujets:	Distributed, Parallel, and Cluster Computing Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Towards providing reliable job completion time predictions using PCS
par: Faisal, Abdullah Bin, et autres
Publié: (2024)

WANSpec: Leveraging Global Compute Capacity for LLM Inference
par: Martin, Noah, et autres
Publié: (2026)

RLBoost: Harvesting Preemptible Resources for Cost-Efficient Reinforcement Learning on LLMs
par: Wu, Yongji, et autres
Publié: (2025)

Adaptive K-PackCache: Cost-Centric Data Caching in Cloud
par: Sarkar, Suvarthi, et autres
Publié: (2025)

WaLLM -- Insights from an LLM-Powered Chatbot deployment via WhatsApp
par: Eltigani, Hiba, et autres
Publié: (2025)

Revisiting the Time Cost Model of AllReduce
par: Xiong, Dian, et autres
Publié: (2024)

Accelerating Local LLMs on Resource-Constrained Edge Devices via Distributed Prompt Caching
par: Matsutani, Hiroki, et autres
Publié: (2026)

ServerlessLoRA: Minimizing Latency and Cost in Serverless Inference for LoRA-Based LLMs
par: Sui, Yifan, et autres
Publié: (2025)

Dion2: A Simple Method to Shrink Matrix in Muon
par: Ahn, Kwangjun, et autres
Publié: (2025)

Efficient AllReduce with Stragglers
par: Devraj, Arjun, et autres
Publié: (2025)

Application-Centric Benchmarking of Distributed FaaS Platforms using BeFaaS
par: Grambow, Martin, et autres
Publié: (2023)

GeoT: Tensor Centric Library for Graph Neural Network via Efficient Segment Reduction on GPU
par: Yu, Zhongming, et autres
Publié: (2024)

Reducing Energy Bloat in Large Model Training
par: Chung, Jae-Won, et autres
Publié: (2023)

Towards cost-effective and resource-aware aggregation at Edge for Federated Learning
par: Khan, Ahmad Faraz, et autres
Publié: (2022)

Low-Cost Privacy-Preserving Decentralized Learning
par: Biswas, Sayan, et autres
Publié: (2024)

Device Scheduling and Assignment in Hierarchical Federated Learning for Internet of Things
par: Zhang, Tinghao, et autres
Publié: (2024)

Multimodal Online Federated Learning with Modality Missing in Internet of Things
par: Wang, Heqiang, et autres
Publié: (2025)

Cost-aware Duration Prediction for Software Upgrades in Datacenters
par: Ding, Yi, et autres
Publié: (2022)

Cortex: Achieving Low-Latency, Cost-Efficient Remote Data Access For LLM via Semantic-Aware Knowledge Caching
par: Ruan, Chaoyi, et autres
Publié: (2025)

Fault-tolerant Reduce and Allreduce operations based on correction
par: Kuettler, Martin, et autres
Publié: (2026)

Preble: Efficient Distributed Prompt Scheduling for LLM Serving
par: Srivatsa, Vikranth, et autres
Publié: (2024)

DrJAX: Scalable and Differentiable MapReduce Primitives in JAX
par: Rush, Keith, et autres
Publié: (2024)

Reducing Communication for Split Learning by Randomized Top-k Sparsification
par: Zheng, Fei, et autres
Publié: (2023)

Distributed client selection with multi-objective in federated learning assisted Internet of Vehicles
par: Cha, Narisu, et autres
Publié: (2024)

Adaptive Resolution Inference (ARI): Energy-Efficient Machine Learning for Internet of Things
par: Wang, Ziheng, et autres
Publié: (2024)

Age-of-Gradient Updates for Federated Learning over Random Access Channels
par: Wu, Yu Heng, et autres
Publié: (2024)

FedAuxHMTL: Federated Auxiliary Hard-Parameter Sharing Multi-Task Learning for Network Edge Traffic Classification
par: Ahmed, Faisal, et autres
Publié: (2024)

Parallel Track Transformers: Enabling Fast GPU Inference with Reduced Synchronization
par: Wang, Chong, et autres
Publié: (2026)

Speeding up Model Loading with fastsafetensors
par: Yoshimura, Takeshi, et autres
Publié: (2025)

BOute: Cost-Efficient LLM Serving with Heterogeneous LLMs and GPUs via Multi-Objective Bayesian Optimization
par: Jiang, Youhe, et autres
Publié: (2026)

Reducing Memory Contention and I/O Congestion for Disk-based GNN Training
par: Jiang, Qisheng, et autres
Publié: (2024)

An All-Reduce Compatible Top-K Compressor for Communication-Efficient Distributed Learning
par: Chen, Chuyan, et autres
Publié: (2025)

Fair Distributed Cooperative Bandit Learning on Networks for Intelligent Internet of Things Systems (Technical Report)
par: Chen, Ziqun, et autres
Publié: (2024)

Mélange: Cost Efficient Large Language Model Serving by Exploiting GPU Heterogeneity
par: Griggs, Tyler, et autres
Publié: (2024)

Scalable and Cost-Efficient ML Inference: Parallel Batch Processing with Serverless Functions
par: Barrak, Amine, et autres
Publié: (2025)

Cost-Efficient LLM Serving in the Cloud: VM Selection with KV Cache Offloading
par: Kim, Kihyun, et autres
Publié: (2025)

Preserving Near-Optimal Gradient Sparsification Cost for Scalable Distributed Deep Learning
par: Yoon, Daegun, et autres
Publié: (2024)

Cost-Effective Methodology for Complex Tuning Searches in HPC: Navigating Interdependencies and Dimensionality
par: Dieguez, Adrian Perez, et autres
Publié: (2024)

Incentivizing Permissionless Distributed Learning of LLMs
par: Lidin, Joel, et autres
Publié: (2025)

Understanding and Reducing Metadata-Driven Host Overheads in Sampling-Based GNN Training
par: Gong, Yidong, et autres
Publié: (2026)