Computation and Communication Co-scheduling for Multi-Task Remote Inference
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866915456298778624 |
|---|---|
| author | Shisher, Md Kamran Chowdhury Piaseczny, Adam Sun, Yin Brinton, Christopher G. |
| author_facet | Shisher, Md Kamran Chowdhury Piaseczny, Adam Sun, Yin Brinton, Christopher G. |
| contents | In multi-task remote inference systems, an intelligent receiver (e.g., command center) performs multiple inference tasks (e.g., target detection) using data features received from several remote sources (e.g., edge devices). Key challenges to facilitating timely inference in these systems arise from (i) limited computational power of the sources to produce features from their inputs, and (ii) limited communication resources of the channels to carry simultaneous feature transmissions to the receiver. We develop a novel computation and communication co-scheduling methodology which determines feature generation and transmission scheduling to minimize inference errors subject to these resource constraints. Specifically, we formulate the co-scheduling problem as a weakly-coupled Markov decision process with Age of Information (AoI)-based timeliness gauging the inference errors. To overcome its PSPACE-hard complexity, we analyze a Lagrangian relaxation of the problem, which yields gain indices assessing the improvement in inference error for each potential feature generation-transmission scheduling action. Based on this, we develop a reoptimized maximum gain first (MGF) policy. We show that this policy is asymptotically optimal for the original problem as the number of inference tasks and the available communication and computation resources increase, provided the ratio among them remains fixed. Experiments demonstrate that reoptimized MGF obtains significant improvements over baseline policies for varying numbers of tasks, channels, and sources. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_04231 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Computation and Communication Co-scheduling for Multi-Task Remote Inference Shisher, Md Kamran Chowdhury Piaseczny, Adam Sun, Yin Brinton, Christopher G. Information Theory Networking and Internet Architecture In multi-task remote inference systems, an intelligent receiver (e.g., command center) performs multiple inference tasks (e.g., target detection) using data features received from several remote sources (e.g., edge devices). Key challenges to facilitating timely inference in these systems arise from (i) limited computational power of the sources to produce features from their inputs, and (ii) limited communication resources of the channels to carry simultaneous feature transmissions to the receiver. We develop a novel computation and communication co-scheduling methodology which determines feature generation and transmission scheduling to minimize inference errors subject to these resource constraints. Specifically, we formulate the co-scheduling problem as a weakly-coupled Markov decision process with Age of Information (AoI)-based timeliness gauging the inference errors. To overcome its PSPACE-hard complexity, we analyze a Lagrangian relaxation of the problem, which yields gain indices assessing the improvement in inference error for each potential feature generation-transmission scheduling action. Based on this, we develop a reoptimized maximum gain first (MGF) policy. We show that this policy is asymptotically optimal for the original problem as the number of inference tasks and the available communication and computation resources increase, provided the ratio among them remains fixed. Experiments demonstrate that reoptimized MGF obtains significant improvements over baseline policies for varying numbers of tasks, channels, and sources. |
| title | Computation and Communication Co-scheduling for Multi-Task Remote Inference |
| topic | Information Theory Networking and Internet Architecture |
| url | https://arxiv.org/abs/2501.04231 |