Imagen de Portada

A Study of Skews, Imbalances, and Pathological Conditions in LLM Inference Deployment on GPU Clusters detectable from DPU

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	Moye, Javed I. Khan an Henry Uwabor
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Skew-Probabilistic Neural Networks for Learning from Imbalanced Data
por: Naik, Shraddha M., et al.
Publicado: (2023)

Harvest: Opportunistic Peer-to-Peer GPU Caching for LLM Inference
por: Gopal, Nikhil, et al.
Publicado: (2026)

Provable Imbalanced Point Clustering
por: Denisov, David, et al.
Publicado: (2024)

HGCA: Hybrid GPU-CPU Attention for Long Context LLM Inference
por: Deng, Weishu, et al.
Publicado: (2025)

MCAP: Deployment-Time Layer Profiling for Memory-Constrained LLM Inference
por: Das, Anurita
Publicado: (2026)

A Generalized Unified Skew-Normal Process with Neural Bayes Inference
por: Wang, Kesen, et al.
Publicado: (2024)

AGFT: An Adaptive GPU Frequency Tuner for Real-Time LLM Inference Optimization
por: Ye, Zicong, et al.
Publicado: (2025)

Characterizing LLM Inference Energy-Performance Tradeoffs across Workloads and GPU Scaling
por: Maliakel, Paul Joe, et al.
Publicado: (2025)

SpecOffload: Unlocking Latent GPU Capacity for LLM Inference on Resource-Constrained Devices
por: Zhuge, Xiangwen, et al.
Publicado: (2025)

EnergyLens: Predictive Energy-Aware Exploration for Multi-GPU LLM Inference Optimization
por: Song, Zhiye, et al.
Publicado: (2026)

A systematic literature Review for Transformer-based Software Vulnerability detection
por: Naseer, Fiza, et al.
Publicado: (2026)

Conformal Inference for Open-Set and Imbalanced Classification
por: Xie, Tianmin, et al.
Publicado: (2025)

LiteCache: A Query Similarity-Driven, GPU-Centric KVCache Subsystem for Efficient LLM Inference
por: Yi, Jiawei, et al.
Publicado: (2025)

MNN-LLM: A Generic Inference Engine for Fast Large Language Model Deployment on Mobile Devices
por: Wang, Zhaode, et al.
Publicado: (2025)

Accelerating Sparse Transformer Inference on GPU
por: Dai, Wenhao, et al.
Publicado: (2025)

Imbalanced Data Clustering using Equilibrium K-Means
por: He, Yudong
Publicado: (2024)

Recovering Imbalanced Clusters via Gradient-Based Projection Pursuit
por: Eppert, Martin, et al.
Publicado: (2025)

Challenging GPU Dominance: When CPUs Outperform for On-Device LLM Inference
por: Zhang, Haolin, et al.
Publicado: (2025)

The cognitive companion: a lightweight parallel monitoring architecture for detecting and recovering from reasoning degradation in LLM agents
por: Khan, Rafflesia, et al.
Publicado: (2026)

Addressing Class Imbalance with Probabilistic Graphical Models and Variational Inference
por: Lou, Yujia, et al.
Publicado: (2025)

ECGN: A Cluster-Aware Approach to Graph Neural Networks for Imbalanced Classification
por: Thapaliya, Bishal, et al.
Publicado: (2024)

CHAI: Clustered Head Attention for Efficient LLM Inference
por: Agarwal, Saurabh, et al.
Publicado: (2024)

A Robust Clustered Federated Learning Approach for Non-IID Data with Quantity Skew
por: Ali, Michael Ben, et al.
Publicado: (2025)

Confidential LLM Inference: Performance and Cost Across CPU and GPU TEEs
por: Chrapek, Marcin, et al.
Publicado: (2025)

DPU or GPU for Accelerating Neural Networks Inference -- Why not both? Split CNN Inference
por: Oztas, Ali Emre, et al.
Publicado: (2026)

ModeSwitch-LLM: A Lightweight Phase-Aware Controller for Cross-Mode LLM Inference on a Single GPU
por: Sunesh, Aman, et al.
Publicado: (2026)

Mind the Memory Gap: Unveiling GPU Bottlenecks in Large-Batch LLM Inference
por: Recasens, Pol G., et al.
Publicado: (2025)

CoLLM: Continuous Adaptation for SLO-Aware LLM Serving on Shared GPU Clusters
por: Huang, Shaoyuan, et al.
Publicado: (2026)

Characterizing WebGPU Dispatch Overhead for LLM Inference Across Four GPU Vendors, Three Backends, and Three Browsers
por: Maczan, Jędrzej
Publicado: (2026)

Energy-Efficient Vision Transformer Inference for Edge-AI Deployment
por: Amanzhol, Nursultan, et al.
Publicado: (2025)

Forecasting GPU Performance for Deep Learning Training and Inference
por: Lee, Seonho, et al.
Publicado: (2024)

An Analytical Multiple Criteria Framework for Temporal and Dynamic Business-to-Business Customer Segmentation in Manufacturing
por: Raees, Muhammad, et al.
Publicado: (2026)

Efficient Edge LLMs Deployment via HessianAware Quantization and CPU GPU Collaborative
por: Zhang, Tuo, et al.
Publicado: (2025)

CTTVAE: Latent Space Structuring for Conditional Tabular Data Generation on Imbalanced Datasets
por: Devic, Milosh, et al.
Publicado: (2026)

LO-BCQ: Block Clustered Quantization for 4-bit (W4A4) LLM Inference
por: Elangovan, Reena, et al.
Publicado: (2025)

Skew-adaptive conformal prediction
por: F., Paulo C. Marques, et al.
Publicado: (2026)

Private LLM Inference on Consumer Blackwell GPUs: A Practical Guide for Cost-Effective Local Deployment in SMEs
por: Knoop, Jonathan, et al.
Publicado: (2026)

PROTOCOL: Partial Optimal Transport-enhanced Contrastive Learning for Imbalanced Multi-view Clustering
por: Xue, Xuqian, et al.
Publicado: (2025)

FloE: On-the-Fly MoE Inference on Memory-constrained GPU
por: Zhou, Yuxin, et al.
Publicado: (2025)

Toward Robust and Efficient ML-Based GPU Caching for Modern Inference
por: Chen, Peng, et al.
Publicado: (2025)