Cover Image

Serving LLMs in HPC Clusters: A Comparative Study of Qualcomm Cloud AI 100 Ultra and NVIDIA Data Center GPUs

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Sada, Mohammad Firas, Graham, John J., Khoda, Elham E, Tatineni, Mahidhar, Mishin, Dmitry, Gupta, Rajesh K., Wagner, Rick, Smarr, Larry, DeFanti, Thomas A., Würthwein, Frank
Format:	Preprint
Published:	2025
Subjects:	Distributed, Parallel, and Cluster Computing Artificial Intelligence 68M20, 68T50 C.4; I.2.7; D.4.8
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Real-Time In-Network Machine Learning on P4-Programmable FPGA SmartNICs with Fixed-Point Arithmetic and Taylor
by: Sada, Mohammad Firas, et al.
Published: (2025)

The National Research Platform: Stretched, Multi-Tenant, Scientific Kubernetes Cluster
by: Weitzel, Derek, et al.
Published: (2025)

Scalable Engine and the Performance of Different LLM Models in a SLURM based HPC architecture
by: Luiz, Anderson de Lima, et al.
Published: (2025)

Few-Class Arena: A Benchmark for Efficient Selection of Vision Models and Dataset Difficulty Measurement
by: Cao, Bryan Bo, et al.
Published: (2024)

On Immutable Memory Systems for Artificial Agents: A Blockchain-Indexed Automata-Theoretic Framework Using ECDH-Keyed Merkle Chains
by: Wright, Craig Steven
Published: (2025)

Proceedings of the 20th International Conference on Knowledge, Information and Creativity Support Systems (KICSS 2025)
by: Hayama, Edited by Tessai, et al.
Published: (2025)

A Landmark-Aware Visual Navigation Dataset
by: Johnson, Faith, et al.
Published: (2024)

An innovative data collection method to eliminate the preprocessing phase in web usage mining
by: Canay, Ozkan, et al.
Published: (2025)

PROV-AGENT: Unified Provenance for Tracking AI Agent Interactions in Agentic Workflows
by: Souza, Renan, et al.
Published: (2025)

Benchmarking Online Sequence-to-Sequence and Character-based Handwriting Recognition from IMU-Enhanced Pens
by: Ott, Felix, et al.
Published: (2022)

StatsMerging: Statistics-Guided Model Merging via Task-Specific Teacher Distillation
by: Merugu, Ranjith, et al.
Published: (2025)

Identity Deepfake Threats to Biometric Authentication Systems: Public and Expert Perspectives
by: He, Shijing, et al.
Published: (2025)

Conformance Checking of Fuzzy Logs against Declarative Temporal Specifications
by: Donadello, Ivan, et al.
Published: (2024)

Depth Priors in Removal Neural Radiance Fields
by: Guo, Zhihao, et al.
Published: (2024)

The number of primitive words of unbounded exponent in the language of an HD0L-system is finite
by: Klouda, Karel, et al.
Published: (2021)

MVTamperBench: Evaluating Robustness of Vision-Language Models
by: Agarwal, Amit, et al.
Published: (2024)

Event-ECC: Asynchronous Tracking of Events with Continuous Optimization
by: Zafeiri, Maria, et al.
Published: (2024)

NeuroWrite: Predictive Handwritten Digit Classification using Deep Neural Networks
by: Asish, Kottakota, et al.
Published: (2023)

FastGS: Training 3D Gaussian Splatting in 100 Seconds
by: Ren, Shiwei, et al.
Published: (2025)

Remote Verification System for Mizar Integrated with Emwiki
by: Kai, Toshiki, et al.
Published: (2024)

Tamper-Proofing with Self-Modifying Code
by: Morse, Gregory, et al.
Published: (2026)

Polygonizing Roof Segments from High-Resolution Aerial Images Using Yolov8-Based Edge Detection
by: Mei, Qipeng, et al.
Published: (2025)

Verification and Validation for Trustworthy Scientific Machine Learning
by: Jakeman, John D., et al.
Published: (2025)

Abductive explanations of classifiers under constraints: Complexity and properties
by: Cooper, Martin, et al.
Published: (2024)

Formal Methods: From Academia to Industrial Practice. A Travel Guide
by: Huisman, Marieke, et al.
Published: (2020)

Compilation of Generalized Matrix Chains with Symbolic Sizes
by: López, Francisco, et al.
Published: (2025)

Melding the Serverless Control Plane with the Conventional Cluster Manager for Speed and Resource Efficiency
by: Kondrashov, Leonid, et al.
Published: (2025)

Image and Video Compression using Generative Sparse Representation with Fidelity Controls
by: Jiang, Wei, et al.
Published: (2024)

Benchmarking Vision Language Models on German Factual Data
by: Peinl, René, et al.
Published: (2025)

Weighing Obese Timed Languages
by: Asarin, Eugene, et al.
Published: (2025)

Beyond RGB: Leveraging Vision Transformers for Thermal Weapon Segmentation
by: Kambhatla, Akhila, et al.
Published: (2025)

Computational Complexity of Determining the Assembly Index
by: Masierak, Piotr
Published: (2026)

Computing the Bandwidth of Meager Timed Automata
by: Asarin, Eugene, et al.
Published: (2024)

The Impact of Image Resolution on Face Detection: A Comparative Analysis of MTCNN, YOLOv XI and YOLOv XII models
by: Ömercikoğlu, Ahmet Can, et al.
Published: (2025)

Expectations Versus Reality: Evaluating Intrusion Detection Systems in Practice
by: Hesford, Jake, et al.
Published: (2024)

Anti-Context-Free languages
by: Cardó, Carles
Published: (2024)

DDU-Net: A Domain Decomposition-Based CNN for High-Resolution Image Segmentation on Multiple GPUs
by: Verburg, Corné, et al.
Published: (2024)

Advancing Brain Tumor Segmentation via Attention-based 3D U-Net Architecture and Digital Image Processing
by: Gad, Eyad, et al.
Published: (2025)

Machine Learning and Public Health: Identifying and Mitigating Algorithmic Bias through a Systematic Review
by: Altamirano, Sara, et al.
Published: (2025)

SLED: A Speculative LLM Decoding Framework for Efficient Edge Serving
by: Li, Xiangchen, et al.
Published: (2025)