Quality-of-Service Aware LLM Routing for Edge Computing with Multiple Experts
Fuente:
arXiv
Saved in:
| Main Authors: | Yang, Jin, Wu, Qiong, Feng, Zhiying, Zhou, Zhi, Guo, Deke, Chen, Xu |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Optimizing Age of Information in Vehicular Edge Computing with Federated Graph Neural Network Multi-Agent Reinforcement Learning
by: Wang, Wenhua, et al.
Published: (2024)
by: Wang, Wenhua, et al.
Published: (2024)
Sensing and Storing Less: A MARL-based Solution for Energy Saving in Edge Internet of Things
by: Yuan, Zongyang, et al.
Published: (2025)
by: Yuan, Zongyang, et al.
Published: (2025)
Cordial Miners: Fast and Efficient Consensus for Every Eventuality
by: Keidar, Idit, et al.
Published: (2022)
by: Keidar, Idit, et al.
Published: (2022)
PerLLM: Personalized Inference Scheduling with Edge-Cloud Collaboration for Diverse LLM Services
by: Yang, Zheming, et al.
Published: (2024)
by: Yang, Zheming, et al.
Published: (2024)
Asynchronous MultiAgent Reinforcement Learning for 5G Routing under Side Constraints
by: Racedo, Sebastian, et al.
Published: (2026)
by: Racedo, Sebastian, et al.
Published: (2026)
Multitier Service Migration Framework Based on Mobility Prediction in Mobile Edge Computing
by: Yang, Run, et al.
Published: (2024)
by: Yang, Run, et al.
Published: (2024)
RouterWise: Joint Resource Allocation and Routing for Latency-Aware Multi-Model LLM Serving
by: Kasnavieh, Hossein Hosseini, et al.
Published: (2026)
by: Kasnavieh, Hossein Hosseini, et al.
Published: (2026)
Urgent Edge Computing
by: Dazzi, Patrizio, et al.
Published: (2024)
by: Dazzi, Patrizio, et al.
Published: (2024)
Toward Edge General Intelligence with Multiple-Large Language Model (Multi-LLM): Architecture, Trust, and Orchestration
by: Luo, Haoxiang, et al.
Published: (2025)
by: Luo, Haoxiang, et al.
Published: (2025)
Placing Timely Refreshing Services at the Network Edge
by: Li, Xishuo, et al.
Published: (2024)
by: Li, Xishuo, et al.
Published: (2024)
Reconfigurable Intelligent Surface Assisted VEC Based on Multi-Agent Reinforcement Learning
by: Qi, Kangwei, et al.
Published: (2024)
by: Qi, Kangwei, et al.
Published: (2024)
MultiPath Memory Access: Breaking Host-GPU Bandwidth Bottlenecks in LLM Services
by: Tang, Lingfeng, et al.
Published: (2025)
by: Tang, Lingfeng, et al.
Published: (2025)
Towards Timely Video Analytics Services at the Network Edge
by: Li, Xishuo, et al.
Published: (2024)
by: Li, Xishuo, et al.
Published: (2024)
A Multi-Layered Distributed Computing Framework for Enhanced Edge Computing
by: Ma, Ke, et al.
Published: (2024)
by: Ma, Ke, et al.
Published: (2024)
Trust-Aware Routing for Distributed Generative AI Inference at the Edge
by: Nguyen, Chanh, et al.
Published: (2026)
by: Nguyen, Chanh, et al.
Published: (2026)
PeerSync: Accelerating Containerized Service Delivery at the Network Edge
by: Deng, Yinuo, et al.
Published: (2025)
by: Deng, Yinuo, et al.
Published: (2025)
EdgeTimer: Adaptive Multi-Timescale Scheduling in Mobile Edge Computing with Deep Reinforcement Learning
by: Hao, Yijun, et al.
Published: (2024)
by: Hao, Yijun, et al.
Published: (2024)
Network Anomaly Detection in Distributed Edge Computing Infrastructure
by: Marfo, William, et al.
Published: (2025)
by: Marfo, William, et al.
Published: (2025)
GENIO: Synergizing Edge Computing with Optical Network Infrastructures
by: Cesarano, Carmine, et al.
Published: (2025)
by: Cesarano, Carmine, et al.
Published: (2025)
Contention-Aware Microservice Deployment in Collaborative Mobile Edge Networks
by: Ge, Xinlei, et al.
Published: (2024)
by: Ge, Xinlei, et al.
Published: (2024)
Resilient by Design -- Active Inference for Distributed Continuum Intelligence
by: Donta, Praveen Kumar, et al.
Published: (2025)
by: Donta, Praveen Kumar, et al.
Published: (2025)
Scaling Mobile Agent Systems: From Capability Density to Collective Intelligence
by: He, Bowei
Published: (2026)
by: He, Bowei
Published: (2026)
MOD-X: A Modular Open Decentralized eXchange Framework proposal for Heterogeneous Interoperable Artificial Intelligence Agents
by: Ioannides, Georgios, et al.
Published: (2025)
by: Ioannides, Georgios, et al.
Published: (2025)
UserCentrix: An Agentic Memory-augmented AI Framework for Smart Spaces
by: Saleh, Alaa, et al.
Published: (2025)
by: Saleh, Alaa, et al.
Published: (2025)
Resource Sharing in the Edge: A Distributed Bargaining-Theoretic Approach
by: Zafari, Faheem, et al.
Published: (2020)
by: Zafari, Faheem, et al.
Published: (2020)
Strategic Server Deployment under Uncertainty in Mobile Edge Computing
by: Tran, Duc A., et al.
Published: (2025)
by: Tran, Duc A., et al.
Published: (2025)
OrchestrRL: Dynamic Compute and Network Orchestration for Disaggregated RL
by: Tan, Xin, et al.
Published: (2026)
by: Tan, Xin, et al.
Published: (2026)
Multi-Source Coflow Scheduling in Collaborative Edge Computing with Multihop Network
by: Sahni, Yuvraj, et al.
Published: (2024)
by: Sahni, Yuvraj, et al.
Published: (2024)
Decentralized Network Topology Design for Task Offloading in Mobile Edge Computing
by: Ma, Ke, et al.
Published: (2024)
by: Ma, Ke, et al.
Published: (2024)
Deduplicator: When Computation Reuse Meets Load Balancing at the Network Edge
by: Azad, Md Washik Al, et al.
Published: (2024)
by: Azad, Md Washik Al, et al.
Published: (2024)
HALO: Semantic-Aware Distributed LLM Inference in Lossy Edge Network
by: Zheng, Peirong, et al.
Published: (2026)
by: Zheng, Peirong, et al.
Published: (2026)
Risk-Aware and Stable Edge Server Selection Under Network Latency SLOs
by: Liyanage, Mohan, et al.
Published: (2026)
by: Liyanage, Mohan, et al.
Published: (2026)
ncsim: A Lightweight Simulator for Networked Edge Computing with Wireless Interference Modeling
by: Krishnamachari, Bhaskar, et al.
Published: (2026)
by: Krishnamachari, Bhaskar, et al.
Published: (2026)
Dynamic DAG-Application Scheduling for Multi-Tier Edge Computing in Heterogeneous Networks
by: Li, Xiang, et al.
Published: (2024)
by: Li, Xiang, et al.
Published: (2024)
Temporal-Aware GPU Resource Allocation for Distributed LLM Inference via Reinforcement Learning
by: Du, Chengze, et al.
Published: (2025)
by: Du, Chengze, et al.
Published: (2025)
RailS: Load Balancing for All-to-All Communication in Distributed Mixture-of-Experts Training
by: Xu, Heng, et al.
Published: (2025)
by: Xu, Heng, et al.
Published: (2025)
Dynamic Edge Server Selection in Time-Varying Environments: A Reliability-Aware Predictive Approach
by: Burbano, Jaime Sebastian, et al.
Published: (2025)
by: Burbano, Jaime Sebastian, et al.
Published: (2025)
DRL-Based Federated Self-Supervised Learning for Task Offloading and Resource Allocation in ISAC-Enabled Vehicle Edge Computing
by: Gu, Xueying, et al.
Published: (2024)
by: Gu, Xueying, et al.
Published: (2024)
SARS: A Resource Selection Algorithm for Autonomous Driving Tasks in Heterogeneous Mobile Edge Computing
by: Zakerian, Reza, et al.
Published: (2024)
by: Zakerian, Reza, et al.
Published: (2024)
A Combined Environmental Monitoring Framework based on WSN Clustering and VANET Edge Computation Offloading
by: Mamalis, Basilis, et al.
Published: (2024)
by: Mamalis, Basilis, et al.
Published: (2024)
Similar Items
-
Optimizing Age of Information in Vehicular Edge Computing with Federated Graph Neural Network Multi-Agent Reinforcement Learning
by: Wang, Wenhua, et al.
Published: (2024) -
Sensing and Storing Less: A MARL-based Solution for Energy Saving in Edge Internet of Things
by: Yuan, Zongyang, et al.
Published: (2025) -
Cordial Miners: Fast and Efficient Consensus for Every Eventuality
by: Keidar, Idit, et al.
Published: (2022) -
PerLLM: Personalized Inference Scheduling with Edge-Cloud Collaboration for Diverse LLM Services
by: Yang, Zheming, et al.
Published: (2024) -
Asynchronous MultiAgent Reinforcement Learning for 5G Routing under Side Constraints
by: Racedo, Sebastian, et al.
Published: (2026)