Imagen de Portada

LLMBridge: Reducing Costs to Access LLMs in a Prompt-Centric Internet

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Martin, Noah, Faisal, Abdullah Bin, Eltigani, Hiba, Haroon, Rukhshan, Lamelas, Swaminathan, Dogar, Fahad
Formato:	Preprint
Publicado:	2024
Materias:	Distributed, Parallel, and Cluster Computing Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Towards providing reliable job completion time predictions using PCS
por: Faisal, Abdullah Bin, et al.
Publicado: (2024)

WANSpec: Leveraging Global Compute Capacity for LLM Inference
por: Martin, Noah, et al.
Publicado: (2026)

RLBoost: Harvesting Preemptible Resources for Cost-Efficient Reinforcement Learning on LLMs
por: Wu, Yongji, et al.
Publicado: (2025)

Adaptive K-PackCache: Cost-Centric Data Caching in Cloud
por: Sarkar, Suvarthi, et al.
Publicado: (2025)

WaLLM -- Insights from an LLM-Powered Chatbot deployment via WhatsApp
por: Eltigani, Hiba, et al.
Publicado: (2025)

Revisiting the Time Cost Model of AllReduce
por: Xiong, Dian, et al.
Publicado: (2024)

Accelerating Local LLMs on Resource-Constrained Edge Devices via Distributed Prompt Caching
por: Matsutani, Hiroki, et al.
Publicado: (2026)

ServerlessLoRA: Minimizing Latency and Cost in Serverless Inference for LoRA-Based LLMs
por: Sui, Yifan, et al.
Publicado: (2025)

Dion2: A Simple Method to Shrink Matrix in Muon
por: Ahn, Kwangjun, et al.
Publicado: (2025)

Efficient AllReduce with Stragglers
por: Devraj, Arjun, et al.
Publicado: (2025)

Application-Centric Benchmarking of Distributed FaaS Platforms using BeFaaS
por: Grambow, Martin, et al.
Publicado: (2023)

GeoT: Tensor Centric Library for Graph Neural Network via Efficient Segment Reduction on GPU
por: Yu, Zhongming, et al.
Publicado: (2024)

Reducing Energy Bloat in Large Model Training
por: Chung, Jae-Won, et al.
Publicado: (2023)

Towards cost-effective and resource-aware aggregation at Edge for Federated Learning
por: Khan, Ahmad Faraz, et al.
Publicado: (2022)

Low-Cost Privacy-Preserving Decentralized Learning
por: Biswas, Sayan, et al.
Publicado: (2024)

Device Scheduling and Assignment in Hierarchical Federated Learning for Internet of Things
por: Zhang, Tinghao, et al.
Publicado: (2024)

Multimodal Online Federated Learning with Modality Missing in Internet of Things
por: Wang, Heqiang, et al.
Publicado: (2025)

Cost-aware Duration Prediction for Software Upgrades in Datacenters
por: Ding, Yi, et al.
Publicado: (2022)

Cortex: Achieving Low-Latency, Cost-Efficient Remote Data Access For LLM via Semantic-Aware Knowledge Caching
por: Ruan, Chaoyi, et al.
Publicado: (2025)

Fault-tolerant Reduce and Allreduce operations based on correction
por: Kuettler, Martin, et al.
Publicado: (2026)

Preble: Efficient Distributed Prompt Scheduling for LLM Serving
por: Srivatsa, Vikranth, et al.
Publicado: (2024)

DrJAX: Scalable and Differentiable MapReduce Primitives in JAX
por: Rush, Keith, et al.
Publicado: (2024)

Reducing Communication for Split Learning by Randomized Top-k Sparsification
por: Zheng, Fei, et al.
Publicado: (2023)

Distributed client selection with multi-objective in federated learning assisted Internet of Vehicles
por: Cha, Narisu, et al.
Publicado: (2024)

Adaptive Resolution Inference (ARI): Energy-Efficient Machine Learning for Internet of Things
por: Wang, Ziheng, et al.
Publicado: (2024)

Age-of-Gradient Updates for Federated Learning over Random Access Channels
por: Wu, Yu Heng, et al.
Publicado: (2024)

FedAuxHMTL: Federated Auxiliary Hard-Parameter Sharing Multi-Task Learning for Network Edge Traffic Classification
por: Ahmed, Faisal, et al.
Publicado: (2024)

Parallel Track Transformers: Enabling Fast GPU Inference with Reduced Synchronization
por: Wang, Chong, et al.
Publicado: (2026)

Speeding up Model Loading with fastsafetensors
por: Yoshimura, Takeshi, et al.
Publicado: (2025)

BOute: Cost-Efficient LLM Serving with Heterogeneous LLMs and GPUs via Multi-Objective Bayesian Optimization
por: Jiang, Youhe, et al.
Publicado: (2026)

Reducing Memory Contention and I/O Congestion for Disk-based GNN Training
por: Jiang, Qisheng, et al.
Publicado: (2024)

An All-Reduce Compatible Top-K Compressor for Communication-Efficient Distributed Learning
por: Chen, Chuyan, et al.
Publicado: (2025)

Fair Distributed Cooperative Bandit Learning on Networks for Intelligent Internet of Things Systems (Technical Report)
por: Chen, Ziqun, et al.
Publicado: (2024)

Mélange: Cost Efficient Large Language Model Serving by Exploiting GPU Heterogeneity
por: Griggs, Tyler, et al.
Publicado: (2024)

Scalable and Cost-Efficient ML Inference: Parallel Batch Processing with Serverless Functions
por: Barrak, Amine, et al.
Publicado: (2025)

Cost-Efficient LLM Serving in the Cloud: VM Selection with KV Cache Offloading
por: Kim, Kihyun, et al.
Publicado: (2025)

Preserving Near-Optimal Gradient Sparsification Cost for Scalable Distributed Deep Learning
por: Yoon, Daegun, et al.
Publicado: (2024)

Cost-Effective Methodology for Complex Tuning Searches in HPC: Navigating Interdependencies and Dimensionality
por: Dieguez, Adrian Perez, et al.
Publicado: (2024)

Incentivizing Permissionless Distributed Learning of LLMs
por: Lidin, Joel, et al.
Publicado: (2025)

Understanding and Reducing Metadata-Driven Host Overheads in Sampling-Based GNN Training
por: Gong, Yidong, et al.
Publicado: (2026)