Cover Image

Enhancing reliability in AI inference services: An empirical study on real production incidents

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ranganathan, Bhala, Zhang, Mickey, Wu, Kai
Format:	Preprint
Published:	2025
Subjects:	Distributed, Parallel, and Cluster Computing Computers and Society
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Towards a real-time distributed feedback system for the transportation assistance of PwD
by: Polenakis, Iosif, et al.
Published: (2024)

Ethics of Blockchain Technologies
by: Ishmaev, Georgy
Published: (2025)

Urban Green Governance: IoT-Driven Management and Enhancement of Urban Green Spaces in Campobasso
by: Salis, Antonio, et al.
Published: (2025)

Cloud based DevOps Framework for Identifying Risk Factors of Hospital Utilization
by: Banerjee, Monojit, et al.
Published: (2025)

Element and Everything Tokens: Two-Tier Architecture for Mobilizing Alternative Assets
by: Borjigin, Ailiya, et al.
Published: (2025)

Share a Tiny Space of Your Freezer to Increase Resilience of Ex-situ Seed Conservation
by: Vitaletti, Andrea
Published: (2025)

Possible Futures for Cloud Cost Models
by: Sochat, Vanessa, et al.
Published: (2025)

Ethical Risk Analysis of L2 Rollups
by: Ishmaev, Georgy, et al.
Published: (2025)

Beyond right or wrong: towards redefining adaptive learning indicators in virtual learning environments
by: Sachete, Andreia dos Santos, et al.
Published: (2025)

How Does Stake Distribution Influence Consensus? Analyzing Blockchain Decentralization
by: Motepalli, Shashank, et al.
Published: (2023)

BeerReview: A Blockchain-enabled Peer Review Platform
by: Jin, Guodong, et al.
Published: (2024)

Exploring User Acceptance of Blockchain-Based Student Certificate Sharing System: A Study on Non Fungible Token (NFT) Utilization
by: Khati, Prakhyat, et al.
Published: (2024)

Gaming and Blockchain: Hype and Reality
by: McGuinness, Max
Published: (2024)

Developing a Portable Solution for Post-Event Analysis Pipelines
by: Pelonero, Leonardo, et al.
Published: (2026)

Everywhere & Nowhere: Envisioning a Computing Continuum for Science
by: Parashar, Manish
Published: (2024)

Scrutiny new framework in integrated distributed reliable systems
by: Gashti, Mehdi Zekriyapanah
Published: (2025)

Cloud Platforms for Developing Generative AI Solutions: A Scoping Review of Tools and Services
by: Patel, Dhavalkumar, et al.
Published: (2024)

A Grassroots Network and Community Roadmap for Interconnected Autonomous Science Laboratories for Accelerated Discovery
by: da Silva, Rafael Ferreira, et al.
Published: (2025)

PVU: Design and Implementation of a Posit Vector Arithmetic Unit (PVU) for Enhanced Floating-Point Computing in Edge and AI Applications
by: Wu, Xinyu, et al.
Published: (2025)

Agentic AI-Driven UAV Network Deployment: An LLM-Enhanced Exact Potential Game Approach
by: Tang, Xin, et al.
Published: (2026)

RASC: Enhancing Observability & Programmability in Smart Spaces
by: Karanika, Anna, et al.
Published: (2026)

Audo-Sight: AI-driven Ambient Perception Across Edge-Cloud for Blind and Low Vision Users
by: Bradshaw, Jacob, et al.
Published: (2026)

Cronus: Efficient LLM inference on Heterogeneous GPU Clusters via Partially Disaggregated Prefill
by: Liu, Yunzhao, et al.
Published: (2025)

inference-fleet-sim: A Queueing-Theory-Grounded Fleet Capacity Planner for LLM Inference
by: Chen, Huamin, et al.
Published: (2026)

Enhancing Traffic Safety with AI and 6G: Latency Requirements and Real-Time Threat Detection
by: Horvath, Kurt, et al.
Published: (2025)

GeoNimbus: A serverless framework to build earth observation and environmental services
by: Sánchez-Gallegos, Dante D., et al.
Published: (2025)

Resource Slicing through Intelligent Orchestration of Energy-aware IoT services in Edge-Cloud Continuum
by: Shahid, Hafiz Faheem, et al.
Published: (2024)

Genetic-based fog colony optimization hybridized with hierarchical clustering and its influence in the placement of fog services
by: Talavera, Francisco, et al.
Published: (2022)

Leveraging knowledge-as-a-service (KaaS) for QoS-aware resource management in multi-user video transcoding
by: Costero, Luis, et al.
Published: (2024)

HyperParallel: A Supernode-Affinity AI Framework
by: Zhang, Xin, et al.
Published: (2026)

An Empirical Study of Production Incidents in Generative AI Cloud Services
by: Yan, Haoran, et al.
Published: (2025)

A Structure-Aware Irregular Blocking Method for Sparse LU Factorization
by: Hu, Zhen, et al.
Published: (2025)

A 410GFLOP/s, 64 RISC-V Cores, 204.8GBps Shared-Memory Cluster in 12nm FinFET with Systolic Execution Support for Efficient B5G/6G AI-Enhanced O-RAN
by: Zhang, Yichao, et al.
Published: (2025)

Infer-EDGE: Dynamic DNN Inference Optimization in 'Just-in-time' Edge-AI Implementations
by: Mounesan, Motahare, et al.
Published: (2025)

AI-driven Predictive Shard Allocation for Scalable Next Generation Blockchains
by: Haider, M. Zeeshan, et al.
Published: (2025)

Distributed On-Device LLM Inference With Over-the-Air Computation
by: Zhang, Kai, et al.
Published: (2025)

BandPilot: Towards Performance- and Contention-Aware GPU Dispatching in AI Clusters
by: Zhang, Kunming, et al.
Published: (2025)

Edge AI: A Taxonomy, Systematic Review and Future Directions
by: Gill, Sukhpal Singh, et al.
Published: (2024)

When Servers Meet Species: A Fab-to-Grave Lens on Computing's Biodiversity Impact
by: Shi, Tianyao, et al.
Published: (2025)

Are you a DePIN? A Decision Tree to Classify Decentralized Physical Infrastructure Networks
by: Andrew, Michael S., et al.
Published: (2025)