Cover Image

Scalable AI Inference: Performance Analysis and Optimization of AI Model Serving

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Pham, Hung Cuong, Gedikli, Fatih
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Inference Optimization of Foundation Models on AI Accelerators
by: Park, Youngsuk, et al.
Published: (2024)

An AI-powered Bayesian Generative Modeling Approach for Arbitrary Conditional Inference
by: Liu, Qiao, et al.
Published: (2026)

Reasoning Language Model Inference Serving Unveiled: An Empirical Study
by: Li, Qi, et al.
Published: (2025)

Joint Explainability-Performance Optimization With Surrogate Models for AI-Driven Edge Services
by: Charalampakos, Foivos, et al.
Published: (2025)

Modeling Human Beliefs about AI Behavior for Scalable Oversight
by: Lang, Leon, et al.
Published: (2025)

3D Optimization for AI Inference Scaling: Balancing Accuracy, Cost, and Latency
by: Jung, Minseok, et al.
Published: (2025)

FedKDX: Federated Learning with Negative Knowledge Distillation for Enhanced Healthcare AI Systems
by: Pham, Quang-Tu, et al.
Published: (2026)

On Evaluating Performance of LLM Inference Serving Systems
by: Agrawal, Amey, et al.
Published: (2025)

Joint Encoding of KV-Cache Blocks for Scalable LLM Serving
by: Kampeas, Joseph, et al.
Published: (2026)

Interpretable by AI Mother Tongue: Native Symbolic Reasoning in Neural Models
by: Liu, Hung Ming
Published: (2025)

On the Sustainability of AI Inferences in the Edge
by: Sobhani, Ghazal, et al.
Published: (2025)

AI-Powered Bayesian Inference
by: O'Hagan, Sean, et al.
Published: (2025)

Detecting Neurovascular Instability from Multimodal Physiological Signals Using Wearable-Compatible Edge AI: A Responsible Computational Framework
by: Hoa, Truong Quynh, et al.
Published: (2026)

EL-MIA: Quantifying Membership Inference Risks of Sensitive Entities in LLMs
by: Satvaty, Ali, et al.
Published: (2025)

Consistency Models for Scalable and Fast Simulation-Based Inference
by: Schmitt, Marvin, et al.
Published: (2023)

Online Location Planning for AI-Defined Vehicles: Optimizing Joint Tasks of Order Serving and Spatio-Temporal Heterogeneous Model Fine-Tuning
by: Zheng, Bokeng, et al.
Published: (2025)

From Abstract to Actionable: Pairwise Shapley Values for Explainable AI
by: Xu, Jiaxin, et al.
Published: (2025)

HybridoNet-Adapt: A Domain-Adapted Framework for Accurate Lithium-Ion Battery RUL Prediction
by: Tran, Khoa, et al.
Published: (2025)

Stargazer: A Scalable Model-Fitting Benchmark Environment for AI Agents under Astrophysical Constraints
by: Liu, Xinge, et al.
Published: (2026)

The Nature of Mathematical Modeling and Probabilistic Optimization Engineering in Generative AI
by: Li, Fulu
Published: (2024)

Federated Inference: Toward Privacy-Preserving Collaborative and Incentivized Model Serving
by: Seo, Jungwon, et al.
Published: (2026)

SeqBattNet: A Discrete-State Physics-Informed Neural Network with Aging Adaptation for Battery Modeling
by: Tran, Khoa, et al.
Published: (2025)

Efficient Bilevel Optimization for Meta Label Correction in Noisy Label Learning
by: Nguyen, Ba Hoang Anh, et al.
Published: (2026)

Joint Task Offloading, Inference Optimization and UAV Trajectory Planning for Generative AI Empowered Intelligent Transportation Digital Twin
by: Li, Xiaohuan, et al.
Published: (2026)

Scalable Simulation-Based Model Inference with Test-Time Complexity Control
by: Gloeckler, Manuel, et al.
Published: (2026)

FAIREDU: A Multiple Regression-Based Method for Enhancing Fairness in Machine Learning Models for Educational Applications
by: Pham, Nga, et al.
Published: (2024)

An AI-powered Bayesian generative modeling approach for causal inference in observational studies
by: Liu, Qiao, et al.
Published: (2025)

Deploying Atmospheric and Oceanic AI Models on Chinese Hardware and Framework: Migration Strategies, Performance Optimization and Analysis
by: Sun, Yuze, et al.
Published: (2025)

Local Control Networks (LCNs): Optimizing Flexibility in Neural Network Data Pattern Capture
by: Nguyen, Hy, et al.
Published: (2025)

REASONING COMPILER: LLM-Guided Optimizations for Efficient Model Serving
by: Tang, Annabelle Sujun, et al.
Published: (2025)

EnviroPiNet: A Physics-Guided AI Model for Predicting Biofilter Performance
by: Uzma, et al.
Published: (2025)

DmC: Nearest Neighbor Guidance Diffusion Model for Offline Cross-domain Reinforcement Learning
by: Van, Linh Le Pham, et al.
Published: (2025)

Inference Energy and Latency in AI-Mediated Education: A Learning-per-Watt Analysis of Edge and Cloud Models
by: Khemani, Kushal
Published: (2026)

BOxCrete: A Bayesian Optimization Open-Source AI Model for Concrete Strength Forecasting and Mix Optimization
by: Baten, Bayezid, et al.
Published: (2026)

Balancing Knowledge Distillation for Imbalance Learning with Bilevel Optimization
by: Nguyen, Anh B. H., et al.
Published: (2026)

UnIT: Scalable Unstructured Inference-Time Pruning for MAC-efficient Neural Inference on MCUs
by: Neth, Ashe, et al.
Published: (2025)

Recursive Inference Scaling: A Winning Path to Scalable Inference in Language and Multimodal Systems
by: Alabdulmohsin, Ibrahim, et al.
Published: (2025)

ALADIN: Accuracy-Latency-Aware Design-space Inference Analysis for Embedded AI Accelerators
by: Baldi, T., et al.
Published: (2026)

Agentic AI for Mobile Network RAN Management and Optimization
by: Pellejero, Jorge, et al.
Published: (2025)

Optimizing Risk-averse Human-AI Hybrid Teams
by: Fuchs, Andrew, et al.
Published: (2024)