Image de couverture de livre

Compass: A Decentralized Scheduler for Latency-Sensitive ML Workflows

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Yang, Yuting, Merlina, Andrea, Song, Weijia, Yuan, Tiancheng, Birman, Ken, Vitenberg, Roman
Format:	Preprint
Publié:	2024
Sujets:	Distributed, Parallel, and Cluster Computing Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Keep Your Friends Close: Leveraging Affinity Groups to Accelerate AI Inference Workflows
par: Garrett, Thiago, et autres
Publié: (2023)

On Replacing Cryptopuzzles with Useful Computation in Blockchain Proof-of-Work Protocols
par: Merlina, Andrea, et autres
Publié: (2024)

Speculative Decoding in Decentralized LLM Inference: Turning Communication Latency into Computation Throughput
par: Song, Jingwei, et autres
Publié: (2025)

Compass: Optimizing Compound AI Workflows for Dynamic Adaptation
par: Gravara, Milos, et autres
Publié: (2026)

Scalable Runtime Architecture for Data-driven, Hybrid HPC and ML Workflow Applications
par: Merzky, Andre, et autres
Publié: (2025)

A Discussion about Computational Challenges of Programmable Money in Blockchain-based CBDCs
par: da Conceição, Arlindo F., et autres
Publié: (2024)

Reinforcement Learning-driven Data-intensive Workflow Scheduling for Volunteer Edge-Cloud
par: Mounesan, Motahare, et autres
Publié: (2024)

WORKSWORLD: A Domain for Integrated Numeric Planning and Scheduling of Distributed Pipelined Workflows
par: Paul, Taylor, et autres
Publié: (2026)

Reconstruction-Based Adaptive Scheduling Using AI Inferences in Safety-Critical Systems
par: Alshaer, Samer, et autres
Publié: (2025)

Decentralized Distributed Proximal Policy Optimization (DD-PPO) for High Performance Computing Scheduling on Multi-User Systems
par: Sgambati, Matthew, et autres
Publié: (2025)

Duration-Informed Workload Scheduler
par: Loreti, Daniela, et autres
Publié: (2026)

Mixture-of-Schedulers: An Adaptive Scheduling Agent as a Learned Router for Expert Policies
par: Wang, Xinbo, et autres
Publié: (2025)

AI Inference as Relocatable Electricity Demand: A Latency-Constrained Energy-Geography Framework
par: Luo, Xubin, et autres
Publié: (2026)

DeServe: Towards Affordable Offline LLM Inference via Decentralization
par: Wu, Linyu, et autres
Publié: (2025)

LegoDiffusion: Micro-Serving Text-to-Image Diffusion Workflows
par: Yang, Lingyun, et autres
Publié: (2026)

Towards Multi-Model LLM Schedulers: Empirical Insights into Offloading and Preemption
par: Yildiz, Mert, et autres
Publié: (2026)

ELANA: A Simple Energy and Latency Analyzer for LLMs
par: Chiang, Hung-Yueh, et autres
Publié: (2025)

Large Language Model Partitioning for Low-Latency Inference at the Edge
par: Kafetzis, Dimitrios, et autres
Publié: (2025)

FlowKV: A Disaggregated Inference Framework with Low-Latency KV Cache Transfer and Load-Aware Scheduling
par: Li, Weiqing, et autres
Publié: (2025)

Topology-aware Preemptive Scheduling for Co-located LLM Workloads
par: Zhang, Ping, et autres
Publié: (2024)

Prompt-Aware Scheduling for Low-Latency LLM Serving
par: Tao, Yiheng, et autres
Publié: (2025)

CoRaiS: Lightweight Real-Time Scheduler for Multi-Edge Cooperative Computing
par: Hu, Yujiao, et autres
Publié: (2024)

TRAIL: Trust-Aware Client Scheduling for Semi-Decentralized Federated Learning
par: Hu, Gangqiang, et autres
Publié: (2024)

D$^{2}$MoE: Dual Routing and Dynamic Scheduling for Efficient On-Device MoE-based LLM Serving
par: Wang, Haodong, et autres
Publié: (2025)

Latency-Aware 2-Opt Monotonic Local Search for Distributed Constraint Optimization
par: Rachmut, Ben, et autres
Publié: (2025)

On the Impact of White-box Deployment Strategies for Edge AI on Latency and Model Performance
par: Singh, Jaskirat, et autres
Publié: (2024)

StreamServe: Adaptive Speculative Flows for Low-Latency Disaggregated LLM Serving
par: Kumar, Satyam, et autres
Publié: (2026)

A Scheduling Framework for Efficient MoE Inference on Edge GPU-NDP Systems
par: Wu, Qi, et autres
Publié: (2026)

Boosting Asynchronous Decentralized Learning with Model Fragmentation
par: Biswas, Sayan, et autres
Publié: (2024)

Byzantine-Robust Decentralized Coordination of LLM Agents
par: Jo, Yongrae, et autres
Publié: (2025)

Scepsy: Serving Agentic Workflows Using Aggregate LLM Pipelines
par: Wagenländer, Marcel, et autres
Publié: (2026)

Workload Schedulers -- Genesis, Algorithms and Differences
par: Sliwko, Leszek, et autres
Publié: (2025)

Optimizing Split Learning Latency in TinyML-Based IoT Systems
par: Jenhani, Zied, et autres
Publié: (2025)

Sentinel: An Aggregation Function to Secure Decentralized Federated Learning
par: Feng, Chao, et autres
Publié: (2023)

Decentralized AI: Permissionless LLM Inference on POKT Network
par: Olshansky, Daniel, et autres
Publié: (2024)

The (R)evolution of Scientific Workflows in the Agentic AI Era: Towards Autonomous Science
par: Shin, Woong, et autres
Publié: (2025)

Electricity Cost Minimization for Multi-Workflow Allocation in Geo-Distributed Data Centers
par: Wang, Shuang, et autres
Publié: (2025)

UnifyFL: Enabling Decentralized Cross-Silo Federated Learning
par: S, Sarang, et autres
Publié: (2025)

Accelerating Latency-Critical Applications with AI-Powered Semi-Automatic Fine-Grained Parallelization on SMT Processors
par: Los, Denis, et autres
Publié: (2025)

iScheduler: Reinforcement Learning-Driven Continual Optimization for Large-Scale Resource Investment Problems
par: Hu, Yi-Xiang, et autres
Publié: (2026)