Copertina

Scalability Optimization in Cloud-Based AI Inference Services: Strategies for Real-Time Load Balancing and Automated Scaling

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Jin, Yihong, Yang, Ze
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Distributed, Parallel, and Cluster Computing Artificial Intelligence F.2.2; I.2.8
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Evaluating Large Language Models for Workload Mapping and Scheduling in Heterogeneous HPC Systems
di: Sharma, Aasish Kumar, et al.
Pubblicazione: (2025)

FedMon: Federated eBPF Monitoring for Distributed Anomaly Detection in Multi-Cluster Cloud Environments
di: Zehra, Sehar, et al.
Pubblicazione: (2025)

AAFLOW: Scalable Patterns for Agentic AI Workflows
di: Sarker, Arup Kumar, et al.
Pubblicazione: (2026)

Experimentally Evaluating the Resource Efficiency of Big Data Autoscaling
di: Will, Jonathan, et al.
Pubblicazione: (2025)

Scalable overset computation between a forest-of-octrees- and an arbitrary distributed parallel mesh
di: Brandt, Hannes, et al.
Pubblicazione: (2026)

CooperLLM: Cloud-Edge-End Cooperative Federated Fine-tuning for LLMs via ZOO-based Gradient Correction
di: Sun, He, et al.
Pubblicazione: (2026)

Deadline-Aware Joint Task Scheduling and Offloading in Mobile Edge Computing Systems
di: Nguyen, Ngoc Hung, et al.
Pubblicazione: (2025)

Sublinear-Time Sampling of Spanning Trees in the Congested Clique
di: Pemmaraju, Sriram V., et al.
Pubblicazione: (2024)

Token Arena: A Continuous Benchmark Unifying Energy and Cognition in AI Inference
di: Gao, Yuxuan, et al.
Pubblicazione: (2026)

A Note on Solving Problems of Substantially Super-linear Complexity in $N^{o(1)}$ Rounds of the Congested Clique
di: Lingas, Andrzej
Pubblicazione: (2024)

Efficient Construction of Large Search Spaces for Auto-Tuning
di: Willemsen, Floris-Jan, et al.
Pubblicazione: (2025)

Scalable Co-Clustering for Large-Scale Data through Dynamic Partitioning and Hierarchical Merging
di: Wu, Zihan, et al.
Pubblicazione: (2024)

Challenges of Heterogeneity in Big Data: A Comparative Study of Classification in Large-Scale Structured and Unstructured Domains
di: Eduardo, González Trigueros Jesús, et al.
Pubblicazione: (2025)

Deterministic Fault-Tolerant Local Load Balancing and its Applications against Adaptive Adversaries
di: Kowalski, Dariusz R., et al.
Pubblicazione: (2025)

Data Scheduling Algorithm for Scalable and Efficient IoT Sensing in Cloud Computing
di: Mohammad, Noor Islam S.
Pubblicazione: (2025)

Near-Optimal Wafer-Scale Reduce
di: Luczynski, Piotr, et al.
Pubblicazione: (2024)

Obfuscated Consensus
di: Aspnes, James, et al.
Pubblicazione: (2025)

Why Canonical Rounds Fail for Optimal Byzantine Resilience
di: Attiya, Hagit, et al.
Pubblicazione: (2025)

Improving Efficiency in Near-State and State-Optimal Self-Stabilising Leader Election Population Protocols
di: Gąsieniec, Leszek, et al.
Pubblicazione: (2025)

Anonymous Self-Stabilising Localisation via Spatial Population Protocols
di: Gąsieniec, Leszek, et al.
Pubblicazione: (2024)

An Analysis of Avalanche Consensus
di: Amores-Sesar, Ignacio, et al.
Pubblicazione: (2024)

The consensus number of a shift register equals its width
di: Aspnes, James
Pubblicazione: (2025)

Deploy, Calibrate, Monitor, Heal -- No Human Required: An Autonomous AI SRE Agent for Elasticsearch
di: Mukkolakkal, Muhamed Ramees Cheriya
Pubblicazione: (2026)

Clock Synchronization Is Almost Impossible with Bounded Memory
di: Charron-Bost, Bernadette, et al.
Pubblicazione: (2024)

RadiK: Scalable and Optimized GPU-Parallel Radix Top-K Selection
di: Li, Yifei, et al.
Pubblicazione: (2025)

Cost-Aware Logging: Measuring the Financial Impact of Excessive Log Retention in Small-Scale Cloud Deployments
di: Putra, Jody Almaida
Pubblicazione: (2026)

Agentic Compilation: Mitigating the LLM Rerun Crisis for Minimized-Inference-Cost Web Automation
di: Chundru, Jagadeesh
Pubblicazione: (2026)

Optimizing edge AI models on HPC systems with the edge in the loop
di: Aach, Marcel, et al.
Pubblicazione: (2025)

Low-Bandwidth Matrix Multiplication: Faster Algorithms and More General Forms of Sparsity
di: Gupta, Chetan, et al.
Pubblicazione: (2024)

Augmenting the FedProx Algorithm by Minimizing Convergence
di: Sarkar, Anomitra, et al.
Pubblicazione: (2024)

N2N: A Parallel Framework for Large-Scale MILP under Distributed Memory
di: Wang, Longfei, et al.
Pubblicazione: (2025)

Boolean Matrix Multiplication for Highly Clustered Data on the Congested Clique
di: Lingas, Andrzej
Pubblicazione: (2024)

Learning Interpretable Scheduling Algorithms for Data Processing Clusters
di: Hu, Zhibo, et al.
Pubblicazione: (2024)

Scalable Mesh Coupling for Atmospheric Wave Simulation
di: Brandt, Hannes, et al.
Pubblicazione: (2026)

Heuristic Search Space Partitioning for Low-Latency Multi-Tenant Cloud Queries
di: Pathak, Prashant Kumar, et al.
Pubblicazione: (2026)

When Does Global Attention Help? A Unified Empirical Study on Atomistic Graph Learning
di: Chowdhury, Arindam, et al.
Pubblicazione: (2025)

FLEdge: Benchmarking Federated Machine Learning Applications in Edge Computing Systems
di: Woisetschläger, Herbert, et al.
Pubblicazione: (2023)

Operational Memory Architecture for Kubernetes:Preserving Causal Context Across the Evidence Horizon
di: Khan, Shamsher
Pubblicazione: (2026)

Distributed Rhombus Formation of Sliding Squares
di: Kostitsyna, Irina, et al.
Pubblicazione: (2025)

Benchmarking Federated Learning for Throughput Prediction in 5G Live Streaming Applications
di: Dutta, Yuvraj, et al.
Pubblicazione: (2025)