Image de couverture de livre

A Study of Skews, Imbalances, and Pathological Conditions in LLM Inference Deployment on GPU Clusters detectable from DPU

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteur principal:	Moye, Javed I. Khan an Henry Uwabor
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Skew-Probabilistic Neural Networks for Learning from Imbalanced Data
par: Naik, Shraddha M., et autres
Publié: (2023)

Harvest: Opportunistic Peer-to-Peer GPU Caching for LLM Inference
par: Gopal, Nikhil, et autres
Publié: (2026)

Provable Imbalanced Point Clustering
par: Denisov, David, et autres
Publié: (2024)

HGCA: Hybrid GPU-CPU Attention for Long Context LLM Inference
par: Deng, Weishu, et autres
Publié: (2025)

MCAP: Deployment-Time Layer Profiling for Memory-Constrained LLM Inference
par: Das, Anurita
Publié: (2026)

A Generalized Unified Skew-Normal Process with Neural Bayes Inference
par: Wang, Kesen, et autres
Publié: (2024)

AGFT: An Adaptive GPU Frequency Tuner for Real-Time LLM Inference Optimization
par: Ye, Zicong, et autres
Publié: (2025)

Characterizing LLM Inference Energy-Performance Tradeoffs across Workloads and GPU Scaling
par: Maliakel, Paul Joe, et autres
Publié: (2025)

SpecOffload: Unlocking Latent GPU Capacity for LLM Inference on Resource-Constrained Devices
par: Zhuge, Xiangwen, et autres
Publié: (2025)

EnergyLens: Predictive Energy-Aware Exploration for Multi-GPU LLM Inference Optimization
par: Song, Zhiye, et autres
Publié: (2026)

A systematic literature Review for Transformer-based Software Vulnerability detection
par: Naseer, Fiza, et autres
Publié: (2026)

Conformal Inference for Open-Set and Imbalanced Classification
par: Xie, Tianmin, et autres
Publié: (2025)

LiteCache: A Query Similarity-Driven, GPU-Centric KVCache Subsystem for Efficient LLM Inference
par: Yi, Jiawei, et autres
Publié: (2025)

MNN-LLM: A Generic Inference Engine for Fast Large Language Model Deployment on Mobile Devices
par: Wang, Zhaode, et autres
Publié: (2025)

Accelerating Sparse Transformer Inference on GPU
par: Dai, Wenhao, et autres
Publié: (2025)

Imbalanced Data Clustering using Equilibrium K-Means
par: He, Yudong
Publié: (2024)

Recovering Imbalanced Clusters via Gradient-Based Projection Pursuit
par: Eppert, Martin, et autres
Publié: (2025)

Challenging GPU Dominance: When CPUs Outperform for On-Device LLM Inference
par: Zhang, Haolin, et autres
Publié: (2025)

The cognitive companion: a lightweight parallel monitoring architecture for detecting and recovering from reasoning degradation in LLM agents
par: Khan, Rafflesia, et autres
Publié: (2026)

Addressing Class Imbalance with Probabilistic Graphical Models and Variational Inference
par: Lou, Yujia, et autres
Publié: (2025)

ECGN: A Cluster-Aware Approach to Graph Neural Networks for Imbalanced Classification
par: Thapaliya, Bishal, et autres
Publié: (2024)

CHAI: Clustered Head Attention for Efficient LLM Inference
par: Agarwal, Saurabh, et autres
Publié: (2024)

A Robust Clustered Federated Learning Approach for Non-IID Data with Quantity Skew
par: Ali, Michael Ben, et autres
Publié: (2025)

Confidential LLM Inference: Performance and Cost Across CPU and GPU TEEs
par: Chrapek, Marcin, et autres
Publié: (2025)

DPU or GPU for Accelerating Neural Networks Inference -- Why not both? Split CNN Inference
par: Oztas, Ali Emre, et autres
Publié: (2026)

ModeSwitch-LLM: A Lightweight Phase-Aware Controller for Cross-Mode LLM Inference on a Single GPU
par: Sunesh, Aman, et autres
Publié: (2026)

Mind the Memory Gap: Unveiling GPU Bottlenecks in Large-Batch LLM Inference
par: Recasens, Pol G., et autres
Publié: (2025)

CoLLM: Continuous Adaptation for SLO-Aware LLM Serving on Shared GPU Clusters
par: Huang, Shaoyuan, et autres
Publié: (2026)

Characterizing WebGPU Dispatch Overhead for LLM Inference Across Four GPU Vendors, Three Backends, and Three Browsers
par: Maczan, Jędrzej
Publié: (2026)

Energy-Efficient Vision Transformer Inference for Edge-AI Deployment
par: Amanzhol, Nursultan, et autres
Publié: (2025)

Forecasting GPU Performance for Deep Learning Training and Inference
par: Lee, Seonho, et autres
Publié: (2024)

An Analytical Multiple Criteria Framework for Temporal and Dynamic Business-to-Business Customer Segmentation in Manufacturing
par: Raees, Muhammad, et autres
Publié: (2026)

Efficient Edge LLMs Deployment via HessianAware Quantization and CPU GPU Collaborative
par: Zhang, Tuo, et autres
Publié: (2025)

CTTVAE: Latent Space Structuring for Conditional Tabular Data Generation on Imbalanced Datasets
par: Devic, Milosh, et autres
Publié: (2026)

LO-BCQ: Block Clustered Quantization for 4-bit (W4A4) LLM Inference
par: Elangovan, Reena, et autres
Publié: (2025)

Skew-adaptive conformal prediction
par: F., Paulo C. Marques, et autres
Publié: (2026)

Private LLM Inference on Consumer Blackwell GPUs: A Practical Guide for Cost-Effective Local Deployment in SMEs
par: Knoop, Jonathan, et autres
Publié: (2026)

PROTOCOL: Partial Optimal Transport-enhanced Contrastive Learning for Imbalanced Multi-view Clustering
par: Xue, Xuqian, et autres
Publié: (2025)

FloE: On-the-Fly MoE Inference on Memory-constrained GPU
par: Zhou, Yuxin, et autres
Publié: (2025)

Toward Robust and Efficient ML-Based GPU Caching for Modern Inference
par: Chen, Peng, et autres
Publié: (2025)