Cover Image

Deploying Foundation Model Powered Agent Services: A Survey

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Xu, Wenchao, Chen, Jinyu, Zheng, Peirong, Yi, Xiaoquan, Tian, Tianyi, Zhu, Wenhui, Wan, Quan, Wang, Haozhao, Fan, Yunfeng, Su, Qinliang, Shen, Xuemin
Format:	Preprint
Published:	2024
Subjects:	Distributed, Parallel, and Cluster Computing Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

HALO: Semantic-Aware Distributed LLM Inference in Lossy Edge Network
by: Zheng, Peirong, et al.
Published: (2026)

OTAS: An Elastic Transformer Serving System via Token Adaptation
by: Chen, Jinyu, et al.
Published: (2024)

Collaborative Inference and Learning between Edge SLMs and Cloud LLMs: A Survey of Algorithms, Execution, and Open Challenges
by: Li, Senyao, et al.
Published: (2025)

Unleashing the Power of Continual Learning on Non-Centralized Devices: A Survey
by: Li, Yichen, et al.
Published: (2024)

Administrative Decentralization in Edge-Cloud Multi-Agent for Mobile Automation
by: Li, Senyao, et al.
Published: (2026)

Fog Device-as-a-Service (FDaaS): A Framework for Service Deployment in Public Fog Environments
by: Battula, Sudheer Kumar, et al.
Published: (2023)

Personalized Federated Domain-Incremental Learning based on Adaptive Knowledge Matching
by: Li, Yichen, et al.
Published: (2024)

Unleashing the Power of Tree-of-Thoughts for Edge-Enabled AIGC Service Provisioning
by: Liu, Zhang, et al.
Published: (2026)

Performance Evaluation of Automated Multi-Service Deployment in Edge-Cloud Environments with the CODECO Toolkit
by: Koukis, Georgios, et al.
Published: (2026)

Communication-Efficient Collaborative LLM Inference over LEO Satellite Networks
by: Zhang, Songge, et al.
Published: (2026)

Adaptive Device-Edge Collaboration on DNN Inference in AIoT: A Digital Twin-Assisted Approach
by: Hu, Shisheng, et al.
Published: (2024)

Agentic AI-Driven UAV Network Deployment: An LLM-Enhanced Exact Potential Game Approach
by: Tang, Xin, et al.
Published: (2026)

A Survey on Model-heterogeneous Federated Learning: Problems, Methods, and Prospects
by: Fan, Boyu, et al.
Published: (2023)

A Survey of Distributed Graph Algorithms on Massive Graphs
by: Meng, Lingkai, et al.
Published: (2024)

Split Fine-Tuning for Large Language Models in Wireless Networks
by: Zhang, Songge, et al.
Published: (2025)

MAP-UOT: A Memory-Efficient Approach to Unbalanced Optimal Transport Implementation
by: Sun, Chengyu, et al.
Published: (2024)

Parallax: Efficient LLM Inference Service over Decentralized Environment
by: Tong, Chris, et al.
Published: (2025)

Kairos: Low-latency Multi-Agent Serving with Shared LLMs and Excessive Loads in the Public Cloud
by: Chen, Jinyuan, et al.
Published: (2025)

Coordinating GPU Data Centers and Power Grid Regulation Service for Exogenous Carbon Benefits
by: Jahanshahi, Ali, et al.
Published: (2026)

Dynamic Resource Manager for Automating Deployments in the Computing Continuum
by: Samani, Zahra Najafabadi, et al.
Published: (2024)

CIR: Lightweight Container Image for Cross-Platform Deployment
by: Li, Fengzhi, et al.
Published: (2026)

Designing Large Foundation Models for Efficient Training and Inference: A Survey
by: Liu, Dong, et al.
Published: (2024)

When Agents are Powerful: Black Hole Search with Verification in Time-Varying Graphs
by: Kaur, Tanvir, et al.
Published: (2025)

Green by Design: Constraint-Based Adaptive Deployment in the Cloud Continuum
by: D'Iapico, Andrea, et al.
Published: (2026)

ReviveMoE: Fast Recovery for Hardware Failures in Large-Scale MoE LLM Inference Deployments
by: Li, Haley, et al.
Published: (2026)

AgentX: Towards Orchestrating Robust Agentic Workflow Patterns with FaaS-hosted MCP Services
by: Tokal, Shiva Sai Krishna Anand, et al.
Published: (2025)

Carbon-Aware Microservice Deployment for Optimal User Experience on a Budget
by: Kreutz, Kevin, et al.
Published: (2025)

FedBAT: Communication-Efficient Federated Learning via Learnable Binarization
by: Li, Shiwei, et al.
Published: (2024)

Failure-Resilient and Carbon-Efficient Deployment of Microservices over the Cloud-Edge Continuum
by: Ponce, Francisco, et al.
Published: (2026)

SpotKube: Cost-Optimal Microservices Deployment with Cluster Autoscaling and Spot Pricing
by: Edirisinghe, Dasith, et al.
Published: (2024)

FlowMesh: A Service Fabric for Composable LLM Workflows
by: Shen, Junyi, et al.
Published: (2025)

Accelerating the Delivery of Data Services over Uncertain Mobile Crowdsensing Networks
by: Liwang, Minghui, et al.
Published: (2022)

Integrating Power-to-Heat Services in Geographically Distributed Multi-Energy Systems: A Case Study from the ERIGrid 2.0 Project
by: Silano, Giuseppe, et al.
Published: (2024)

Scheduling Coflows in Multi-Core OCS Networks with Performance Guarantee
by: Wang, Xin, et al.
Published: (2026)

O(K)-Approximation Coflow Scheduling in K-Core Optical Circuit Switching Networks
by: Wang, Xin, et al.
Published: (2026)

Beyond A Single AI Cluster: A Survey of Decentralized LLM Training
by: Dong, Haotian, et al.
Published: (2025)

Mao: Machine learning approach for NUMA optimization in Warehouse Scale Computers
by: Liu, Yueji, et al.
Published: (2024)

FedQuad: Adaptive Layer-wise LoRA Deployment and Activation Quantization for Federated Fine-Tuning
by: Li, Rukuo, et al.
Published: (2025)

Expert-as-a-Service: Towards Efficient, Scalable, and Robust Large-scale MoE Serving
by: Liu, Ziming, et al.
Published: (2025)

S-HPLB: Efficient LLM Attention Serving via Sparsity-Aware Head Parallelism Load Balance
by: Liu, Di, et al.
Published: (2026)