Active Inference-Based Adaptive Routing for Heterogeneous Edge AI Services

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Wang, Zihang, Sedlak, Boris, Dustdar, Schahram
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913045226192896
author Wang, Zihang
Sedlak, Boris
Dustdar, Schahram
author_facet Wang, Zihang
Sedlak, Boris
Dustdar, Schahram
contents Edge computing enables AI inference closer to data sources, reducing latency and bandwidth costs. However, orchestrating AI services across the cloud-edge continuum remains challenging due to dynamic workloads and infrastructure variability. We present AIF-Router, an Active Inference--based routing framework that autonomously learns to balance latency, throughput, and resource utilization across multi-tier AI services without offline training. AIF-Router performs Bayesian state inference and expected free energy minimization to guide routing decisions based on observability-driven real-time metrics. Despite device instability on edge nodes, AIF-Router exhibits stable online learning behavior and demonstrates the feasibility of applying Active Inference for adaptive AI service orchestration in unreliable edge environments. Our findings highlight both the promise and practical challenges of deploying self-adaptive decision-making frameworks for real-world edge AI systems.
format Preprint
id arxiv_https___arxiv_org_abs_2604_17373
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Active Inference-Based Adaptive Routing for Heterogeneous Edge AI Services
Wang, Zihang
Sedlak, Boris
Dustdar, Schahram
Distributed, Parallel, and Cluster Computing
Emerging Technologies
Performance
Edge computing enables AI inference closer to data sources, reducing latency and bandwidth costs. However, orchestrating AI services across the cloud-edge continuum remains challenging due to dynamic workloads and infrastructure variability. We present AIF-Router, an Active Inference--based routing framework that autonomously learns to balance latency, throughput, and resource utilization across multi-tier AI services without offline training. AIF-Router performs Bayesian state inference and expected free energy minimization to guide routing decisions based on observability-driven real-time metrics. Despite device instability on edge nodes, AIF-Router exhibits stable online learning behavior and demonstrates the feasibility of applying Active Inference for adaptive AI service orchestration in unreliable edge environments. Our findings highlight both the promise and practical challenges of deploying self-adaptive decision-making frameworks for real-world edge AI systems.
title Active Inference-Based Adaptive Routing for Heterogeneous Edge AI Services
topic Distributed, Parallel, and Cluster Computing
Emerging Technologies
Performance
url https://arxiv.org/abs/2604.17373