Copertina

Comprehensive Performance Modeling and System Design Insights for Foundation Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Subramanian, Shashank, Rrapaj, Ermal, Harrington, Peter, Chheda, Smeet, Farrell, Steven, Austin, Brian, Williams, Samuel, Wright, Nicholas, Bhimji, Wahid
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Distributed, Parallel, and Cluster Computing
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

PRISM: Probabilistic Runtime Insights and Scalable Performance Modeling for Large-Scale Distributed Training
di: Golden, Alicia, et al.
Pubblicazione: (2025)

EvoSort: A Genetic-Algorithm-Based Adaptive Parallel Sorting Framework for Large-Scale High Performance Computing
di: Raj, Shashank, et al.
Pubblicazione: (2025)

The Time to Consensus in a Blockchain: Insights into Bitcoin's "6 Blocks Rule''
di: Dey, Partha S., et al.
Pubblicazione: (2025)

A New Execution Model and Executor for Adaptively Optimizing the Performance of Parallel Algorithms Using HPX Runtime System
di: Mohammadiporshokooh, Karame, et al.
Pubblicazione: (2025)

Characterizing Production GPU Workloads using System-wide Telemetry Data
di: Cankur, Onur, et al.
Pubblicazione: (2025)

Beyond Pre-Training: The Full Lifecycle of Foundation Models on HPC Systems
di: Conciatore, Dino, et al.
Pubblicazione: (2026)

Modular Foundation Model Inference at the Edge: Network-Aware Microservice Optimization
di: Zhu, Juan, et al.
Pubblicazione: (2026)

LAPIS: A Performance Portable, High Productivity Compiler Framework
di: Kelley, Brian, et al.
Pubblicazione: (2025)

Unleashing Scalable Context Parallelism for Foundation Models Pre-Training via FCP
di: Zhao, Yilong, et al.
Pubblicazione: (2026)

Large Scale Multi-GPU Based Parallel Traffic Simulation for Accelerated Traffic Assignment and Propagation
di: Jiang, Xuan, et al.
Pubblicazione: (2024)

A Comprehensive Hyperledger Fabric Performance Evaluation based on Resources Capacity Planning
di: Melo, Carlos, et al.
Pubblicazione: (2025)

Benchmarking Message Brokers for IoT Edge Computing: A Comprehensive Performance Study
di: Paul, Tapajit Chandra, et al.
Pubblicazione: (2026)

Rorqual: Speeding up Narwhal with TEEs
di: Freitas, Luciano, et al.
Pubblicazione: (2024)

System-Level Performance Modeling of Photonic In-Memory Computing
di: Arockiaraj, Jebacyril, et al.
Pubblicazione: (2026)

Performance Models for a Two-tiered Storage System
di: Sasidharan, Aparna, et al.
Pubblicazione: (2025)

ARM SVE Unleashed: Performance and Insights Across HPC Applications on Nvidia Grace
di: Shi, Ruimin, et al.
Pubblicazione: (2025)

Optimal Resource Utilization in Hyperledger Fabric: A Comprehensive SPN-Based Performance Evaluation Paradigm
di: Melo, Carlos, et al.
Pubblicazione: (2025)

Training DNN Models over Heterogeneous Clusters with Optimal Performance
di: Nie, Chengyi, et al.
Pubblicazione: (2024)

Empowering the Quantum Cloud User with QRIO
di: Chakraborty, Shmeelok, et al.
Pubblicazione: (2024)

From Attention to Disaggregation: Tracing the Evolution of LLM Inference
di: Kumar, Madabattula Rajesh, et al.
Pubblicazione: (2025)

Evaluation of Programming Models and Performance for Stencil Computation on Current GPU Architectures
di: Shan, Baodi, et al.
Pubblicazione: (2024)

Benchmarking the Performance of Large Language Models on the Cerebras Wafer Scale Engine
di: Zhang, Zuoning, et al.
Pubblicazione: (2024)

Experiences with Model Context Protocol Servers for Science and High Performance Computing
di: Pan, Haochen, et al.
Pubblicazione: (2025)

MoFa: A Unified Performance Modeling Framework for LLM Pretraining
di: Zhao, Lu, et al.
Pubblicazione: (2025)

Privacy-Preserving Sharing of Data Analytics Runtime Metrics for Performance Modeling
di: Will, Jonathan, et al.
Pubblicazione: (2024)

PICO: Performance Insights for Collective Operations
di: Pasqualoni, Saverio, et al.
Pubblicazione: (2025)

Design Principles of Dynamic Resource Management for High-Performance Parallel Programming Models
di: Huber, Dominik, et al.
Pubblicazione: (2024)

Characterizing the Performance of Accelerated Jetson Edge Devices for Training Deep Learning Models
di: K., Prashanthi S., et al.
Pubblicazione: (2025)

Efficient Training Approaches for Performance Anomaly Detection Models in Edge Computing Environments
di: Fernando, Duneesha, et al.
Pubblicazione: (2024)

ML-based Modeling to Predict I/O Performance on Different Storage Sub-systems
di: Xu, Yiheng, et al.
Pubblicazione: (2023)

Evaluating Cross-Architecture Performance Modeling of Distributed ML Workloads Using StableHLO
di: Svedas, Jonas, et al.
Pubblicazione: (2026)

Parallel Reduced Order Modeling for Digital Twins using High-Performance Computing Workflows
di: de Parga, S. Ares, et al.
Pubblicazione: (2024)

Performance Modeling and Evaluation of Hyperledger Fabric: An Analysis Based on Transaction Flow and Endorsement Policies
di: Melo, Carlos, et al.
Pubblicazione: (2025)

PALM: A Efficient Performance Simulator for Tiled Accelerators with Large-scale Model Training
di: Fang, Jiahao, et al.
Pubblicazione: (2024)

Transactional Dynamics in Hyperledger Fabric: A Stochastic Modeling and Performance Evaluation of Permissioned Blockchains
di: Melo, Carlos, et al.
Pubblicazione: (2025)

Cascadia: An Efficient Cascade Serving System for Large Language Models
di: Jiang, Youhe, et al.
Pubblicazione: (2025)

Leveraging HPC Profiling & Tracing Tools to Understand the Performance of Particle-in-Cell Monte Carlo Simulations
di: Williams, Jeremy J., et al.
Pubblicazione: (2023)

M3SA: Exploring Datacenter Performance and Climate-Impact with Multi- and Meta-Model Simulation and Analysis
di: Nicolae, Radu, et al.
Pubblicazione: (2026)

LoHan: Low-Cost High-Performance Framework to Fine-Tune 100B Model on a Consumer GPU
di: Liao, Changyue, et al.
Pubblicazione: (2024)

Optimizing Data Distribution and Kernel Performance for Efficient Training of Chemistry Foundation Models: A Case Study with MACE
di: Firoz, Jesun, et al.
Pubblicazione: (2025)