Image de couverture de livre

ConfigSpec: Profiling-Based Configuration Selection for Distributed Edge--Cloud Speculative LLM Serving

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Li, Xiangchen, Ghafouri, Saeid, Fan, Jiakun, Ali, Babar, Vandierendonck, Hans, Nikolopoulos, Dimitrios S.
Format:	Preprint
Publié:	2026
Sujets:	Distributed, Parallel, and Cluster Computing Artificial Intelligence C.2.4; D.4.8; D.4.1; F.2.2; I.2.7; D.4.7
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

WISP: Waste- and Interference-Suppressed Distributed Speculative LLM Serving at the Edge via Dynamic Drafting and SLO-Aware Batching
par: Li, Xiangchen, et autres
Publié: (2026)

nvidia-pcm: A D-Bus-Driven Platform Configuration Manager for OpenBMC Environments
par: Singh, Harinder
Publié: (2026)

DPDPU: Data Processing with DPUs
par: Hu, Jiasheng, et autres
Publié: (2024)

Secure and Scalable Blockchain Voting: A Comparative Framework and the Role of Large Language Models
par: Kiashemshaki, Kiana, et autres
Publié: (2025)

push0: Scalable and Fault-Tolerant Orchestration for Zero-Knowledge Proof Generation
par: Ahmadvand, Mohsen, et autres
Publié: (2026)

C8s: A Confidential Kubernetes Architecture
par: Asad, Amean, et autres
Publié: (2026)

Hardening the OSv Unikernel with Efficient Address Randomization: Design and Performance Evaluation
par: Wollman, Alex, et autres
Publié: (2026)

GridPilot: Real-Time Grid-Responsive Control for AI Supercomputers
par: Constantinescu, Denisa-Andreea, et autres
Publié: (2026)

Fast, Secure, Adaptable: LionsOS Design, Implementation and Performance
par: Heiser, Gernot, et autres
Publié: (2025)

PoCL-R: An Open Standard Based Offloading Layer for Heterogeneous Multi-Access Edge Computing with Server Side Scalability
par: Solanti, Jan, et autres
Publié: (2023)

ICAN-Deploy: Identity-Stable Canary Deployment for Safety-Critical Embodied Agents
par: Qin, Xue, et autres
Publié: (2026)

Is (Selective) Round-To-Nearest Quantization All You Need?
par: Kogan, Alex
Publié: (2025)

Evaluating Large Language Models for Workload Mapping and Scheduling in Heterogeneous HPC Systems
par: Sharma, Aasish Kumar, et autres
Publié: (2025)

Combining Serverless and High-Performance Computing Paradigms to support ML Data-Intensive Applications
par: Staylor, Mills, et autres
Publié: (2025)

Deep RC: A Scalable Data Engineering and Deep Learning Pipeline
par: Sarker, Arup Kumar, et autres
Publié: (2025)

Design and Implementation of an Analysis Pipeline for Heterogeneous Data
par: Sarker, Arup Kumar, et autres
Publié: (2024)

Sink or SWIM: Tackling Real-Time ASR at Scale
par: Bruzzone, Federico, et autres
Publié: (2026)

Service Discovery-Based Hybrid Network Middleware for Efficient Communication in Distributed Robotic Systems
par: Sang, Shiyao, et autres
Publié: (2025)

Secure coding for web applications: Frameworks, challenges, and the role of LLMs
par: Kiashemshaki, Kiana, et autres
Publié: (2025)

SLED: A Speculative LLM Decoding Framework for Efficient Edge Serving
par: Li, Xiangchen, et autres
Publié: (2025)

LLM-FACETS: A Privacy-Preserving Framework for Evaluating LLM Transparency and Accountability
par: Lucas, Tom, et autres
Publié: (2026)

A Faster and More Reliable Middleware for Autonomous Driving Systems
par: He, Yuankai, et autres
Publié: (2025)

Boosting Cross-Architectural Emulation Performance by Foregoing the Intermediate Representation Model
par: Parker, Amy Iris
Publié: (2025)

Enhancing Adaptive Mixed-Criticality Scheduling with Deep Reinforcement Learning
par: Mendes, Bruno, et autres
Publié: (2024)

Serving LLMs in HPC Clusters: A Comparative Study of Qualcomm Cloud AI 100 Ultra and NVIDIA Data Center GPUs
par: Sada, Mohammad Firas, et autres
Publié: (2025)

Send: Objects, History, and Transactions in a Single-Verb Kernel
par: Goes, Christopher
Publié: (2026)

Sky$^ε$-Tree: Embracing the Batch Updates of B$^ε$-trees through Access Port Parallelism on Skyrmion Racetrack Memory
par: Tsai, Yu-Shiang, et autres
Publié: (2024)

GraphBit: A Graph-based Agentic Framework for Non-Linear Agent Orchestration
par: Sarker, Yeahia, et autres
Publié: (2026)

Efficiently Scheduling Parallel DAG Tasks on Identical Multiprocessors
par: Lendve, Shardul, et autres
Publié: (2024)

A History Equivalence Algorithm for Dynamic Process Migration
par: Bakshi, Gargi, et autres
Publié: (2024)

Governed Capability Evolution: Lifecycle-Time Compatibility Checking and Rollback for AI-Component-Based Systems, with Embodied Agents as Case Study
par: Qin, Xue, et autres
Publié: (2026)

Scalable Engine and the Performance of Different LLM Models in a SLURM based HPC architecture
par: Luiz, Anderson de Lima, et autres
Publié: (2025)

Flex-MIG: Enabling Distributed Execution on MIG
par: Kim, Myeongsu, et autres
Publié: (2025)

Spreadsheet Engineering: A Research Framework
par: Grossman, Thomas A.
Publié: (2007)

Trident: Adaptive Scheduling for Heterogeneous Multimodal Data Pipelines
par: Pan, Ding, et autres
Publié: (2026)

GALA: Multimodal Graph Alignment for Bug Localization in Automated Program Repair
par: Liu, Zhuoyao, et autres
Publié: (2026)

Laminar: A Probe-First Scheduling Paradigm with Deterministic Runtime Survival
par: Chu, Zhengyan
Publié: (2026)

Rank-Aware Resource Scheduling for Tightly-Coupled MPI Workloads on Kubernetes
par: Xie, Tianfang
Publié: (2026)

LLMs as Idiomatic Decompilers: Recovering High-Level Code from x86-64 Assembly for Dart
par: Abualazm, Raafat, et autres
Publié: (2026)

KV Cache Optimization Strategies for Scalable and Efficient LLM Inference
par: Xu, Yichun, et autres
Publié: (2026)