Cover Image

Distributed Mixture-of-Agents for Edge Inference with Large Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Mitra, Purbesh, Kaswan, Priyanka, Ulukus, Sennur
Format:	Preprint
Published:	2024
Subjects:	Information Theory Computation and Language Distributed, Parallel, and Cluster Computing Machine Learning Networking and Internet Architecture
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Multi-Agent Distributed Optimization With Feasible Set Privacy
by: Meel, Shreya, et al.
Published: (2025)

Breaking the Storage-Bandwidth Tradeoff in Distributed Storage with Quantum Entanglement
by: Hu, Lei, et al.
Published: (2026)

SlimCaching: Edge Caching of Mixture-of-Experts for Distributed Inference
by: Chen, Qian, et al.
Published: (2025)

GELATO: Generative Entropy- and Lyapunov-based Adaptive Token Offloading for Device-Edge Speculative LLM Inference
by: Tang, Zengzipeng, et al.
Published: (2026)

Low-Latency Task-Oriented Communications with Multi-Round, Multi-Task Deep Learning
by: Sagduyu, Yalin E., et al.
Published: (2024)

Uncertainty-Aware Hybrid Inference with On-Device Small and Remote Large Language Models
by: Oh, Seungeun, et al.
Published: (2024)

Toward Edge General Intelligence with Multiple-Large Language Model (Multi-LLM): Architecture, Trust, and Orchestration
by: Luo, Haoxiang, et al.
Published: (2025)

Capacity Scalability of LEO Constellations With Dynamic Link Failures
by: Li, Wei, et al.
Published: (2026)

Machine Learning-Driven Performance Analysis of Compressed Communication in Aerial-RIS Networks for Future 6G Networks
by: Khan, Muhammad Farhan, et al.
Published: (2025)

Approximate Wireless Communication for Lossy Gradient Updates in IoT Federated Learning
by: Ma, Xiang, et al.
Published: (2024)

Network Anomaly Detection in Distributed Edge Computing Infrastructure
by: Marfo, William, et al.
Published: (2025)

Q-GADMM: Quantized Group ADMM for Communication Efficient Decentralized Machine Learning
by: Elgabli, Anis, et al.
Published: (2019)

A Generalized Hierarchical Federated Learning Framework with Theoretical Guarantees
by: Azimi-Abarghouyi, Seyed Mohammad, et al.
Published: (2025)

A Theoretical Framework for Energy-Aware Gradient Pruning in Federated Learning
by: Athanasakos, Emmanouil M.
Published: (2026)

RailS: Load Balancing for All-to-All Communication in Distributed Mixture-of-Experts Training
by: Xu, Heng, et al.
Published: (2025)

PerLLM: Personalized Inference Scheduling with Edge-Cloud Collaboration for Diverse LLM Services
by: Yang, Zheming, et al.
Published: (2024)

Early-Exit meets Model-Distributed Inference at Edge Networks
by: Colocrese, Marco, et al.
Published: (2024)

A Multi-Layered Distributed Computing Framework for Enhanced Edge Computing
by: Ma, Ke, et al.
Published: (2024)

Toward 6G Native-AI Network: Foundation Model based Cloud-Edge-End Collaboration Framework
by: Chen, Xiang, et al.
Published: (2023)

Optimizing Resource Allocation for Geographically-Distributed Inference by Large Language Models
by: Sun, Tingyang, et al.
Published: (2025)

Diffusion Models on the Edge: Challenges, Optimizations, and Applications
by: Zheng, Dongqi
Published: (2025)

Joint Optimization of Training and Inference in Federated Edge Learning via Constrained Multi-Objective Deep Reinforcement Learning
by: Li, Zhen, et al.
Published: (2026)

The AutoSPADA Platform: User-Friendly Edge Computing for Distributed Learning and Data Analytics in Connected Vehicles
by: Nilsson, Adrian, et al.
Published: (2023)

Temporal-Aware GPU Resource Allocation for Distributed LLM Inference via Reinforcement Learning
by: Du, Chengze, et al.
Published: (2025)

Trust-Aware Routing for Distributed Generative AI Inference at the Edge
by: Nguyen, Chanh, et al.
Published: (2026)

Urgent Edge Computing
by: Dazzi, Patrizio, et al.
Published: (2024)

Communication-Efficient Hybrid Language Model via Uncertainty-Aware Opportunistic and Compressed Transmission
by: Oh, Seungeun, et al.
Published: (2025)

On Capacity and Delay of Wireless Networks with Node Failures
by: Li, Wei, et al.
Published: (2026)

ncsim: A Lightweight Simulator for Networked Edge Computing with Wireless Interference Modeling
by: Krishnamachari, Bhaskar, et al.
Published: (2026)

Lightweight Latency Prediction Scheme for Edge Applications: A Rational Modelling Approach
by: Liyanage, Mohan, et al.
Published: (2025)

Joint Partitioning and Placement of Foundation Models for Real-Time Edge AI
by: Djuhera, Aladin, et al.
Published: (2025)

HALO: Semantic-Aware Distributed LLM Inference in Lossy Edge Network
by: Zheng, Peirong, et al.
Published: (2026)

Edge Offloading in Smart Grid
by: Arcas, Gabriel Ioan, et al.
Published: (2024)

EdgeTimer: Adaptive Multi-Timescale Scheduling in Mobile Edge Computing with Deep Reinforcement Learning
by: Hao, Yijun, et al.
Published: (2024)

Scale-Robust Timely Asynchronous Decentralized Learning
by: Mitra, Purbesh, et al.
Published: (2024)

DeepEdge: A Deep Reinforcement Learning based Task Orchestrator for Edge Computing
by: Yamansavascilar, Baris, et al.
Published: (2021)

Ethereal: Divide and Conquer Network Load Balancing in Large-Scale Distributed Training
by: Addanki, Vamsi, et al.
Published: (2024)

SpaceMoE: Realizing Distributed Mixture-of-Experts Inference over Space Networks
by: Wang, Zhanwei, et al.
Published: (2026)

EdgeLinker: Practical Blockchain-based Framework for Healthcare Fog Applications to Enhance Security in Edge-IoT Data Communications
by: Zarkesh, Mahdi Akbari, et al.
Published: (2024)

Placing Timely Refreshing Services at the Network Edge
by: Li, Xishuo, et al.
Published: (2024)