Cover Image

Training Foundation Models on a Full-Stack AMD Platform: Compute, Networking, and System Design

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Anthony, Quentin, Tokpanov, Yury, Szot, Skyler, Rajagopal, Srivatsan, Medepalli, Praneeth, Golubeva, Anna, Shyam, Vasu, Washbourne, Robert, Iyer, Rishi, Chaurasia, Ansh, Figliolia, Tomas, Yang, Xiao, Sarje, Abhinav, Thorstensen, Drew, Pearson, Amartey, Grossbart, Zack, van Patten, Jason, Barsoum, Emad, Gu, Zhenyu, Fu, Yao, Millidge, Beren
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Artificial Intelligence Distributed, Parallel, and Cluster Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

ZAYA1-8B Technical Report
by: Washbourne, Robert, et al.
Published: (2026)

Online Vector Quantized Attention
by: Alonso, Nick, et al.
Published: (2026)

Compressed Convolutional Attention: Efficient Attention in a Compressed Latent Space
by: Figliolia, Tomas, et al.
Published: (2025)

Zyda-2: a 5 Trillion Token High-Quality Dataset
by: Tokpanov, Yury, et al.
Published: (2024)

BlackMamba: Mixture of Experts for State-Space Models
by: Anthony, Quentin, et al.
Published: (2024)

Toward Conversational Agents with Context and Time Sensitive Long-term Memory
by: Alonso, Nick, et al.
Published: (2024)

Hybrid Associative Memories
by: Lufkin, Leon, et al.
Published: (2026)

Generalising E-prop to Deep Networks
by: Millidge, Beren
Published: (2025)

Equivalence of Personalized PageRank and Successor Representations
by: Millidge, Beren
Published: (2025)

The Zamba2 Suite: Technical Report
by: Glorioso, Paolo, et al.
Published: (2024)

Mixture-of-PageRanks: Replacing Long-Context with Real-Time, Sparse GraphRAG
by: Alonso, Nicholas, et al.
Published: (2024)

Zamba: A Compact 7B SSM Hybrid Model
by: Glorioso, Paolo, et al.
Published: (2024)

Zyda: A 1.3T Dataset for Open Language Modeling
by: Tokpanov, Yury, et al.
Published: (2024)

MemorySim: An RTL-level, timing accurate simulator model for the Chisel ecosystem
by: Chaurasia, Ansh
Published: (2025)

MANTA -- Model Adapter Native generations that's Affordable
by: Chaurasia, Ansh
Published: (2024)

AMD-Hummingbird: Towards an Efficient Text-to-Video Model
by: Isobe, Takashi, et al.
Published: (2025)

Folding Tensor and Sequence Parallelism for Memory-Efficient Transformer Training & Inference
by: Shyam, Vasu, et al.
Published: (2026)

ZAYA1-VL-8B Technical Report
by: Shapourian, Hassan, et al.
Published: (2026)

Exploring Action-Centric Representations Through the Lens of Rate-Distortion Theory
by: Varona, Miguel de Llanza, et al.
Published: (2024)

Translation, the ‘Folk Process’, and Socially Committed Songs of the 1960s
by: Kelly Washbourne
Published: (2013)

Deconstructing Bias: A Multifaceted Framework for Diagnosing Cultural and Compositional Inequities in Text-to-Image Generative Models
by: Said, Muna Numan, et al.
Published: (2025)

Associative Memories in the Feature Space
by: Salvatori, Tommaso, et al.
Published: (2024)

A Review of Neuroscience-Inspired Machine Learning
by: Ororbia, Alexander, et al.
Published: (2024)

Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
by: Shyam, Vasudev, et al.
Published: (2024)

ZUNA: Flexible EEG Superresolution with Position-Aware Diffusion Autoencoders
by: Warner, Christopher, et al.
Published: (2026)

Public Education Spending and Income Inequality
by: Amartey, Ishmael
Published: (2026)

Predictive Coding beyond Correlations
by: Salvatori, Tommaso, et al.
Published: (2023)

Chebyshev and The Fast Fourier Transform Methods for Signal Interpolation
by: Amartey, Ishmael N.
Published: (2024)

Collective behavior from surprise minimization
by: Heins, Conor, et al.
Published: (2023)

Ethnic Disparities of Female Infiltrating Duct and Lobular Breast Cancer Survival by Cancer Stage: Findings From SEER 2006-2010
by: Amartey, Ishmael Nii Amartei
Published: (2024)

Linking Comparative Genomics, Morphology and In Vitro Assays to Understand Deep Diving in Cetaceans
by: Matt J. Thorstensen
Published: (2025)

Produção de leis criminais e racionalidade penal moderna: Uma análise da distinção ‘conservador’ x ‘progressista’ no caso da criação da lei contra a tortura no Brasil
by: Mariana Thorstensen Possas
Published: (2015)

“A ONÇA COMEU O SUSPEITO”: REFLEXÕES SOBRE O RULE OF LAW NO ACRE ENTRE OS ANOS 1980 E 2000
by: Mariana Thorstensen Possas
Published: (2014)

An Overview of Recent Developments on Electrodes Modified with Bacteriophages
by: Katarzyna Szot‐Karpińska
Published: (2025)

LA TRANSICIÓN DEMOGRÁFICO-EPIDEMIOLÓGICA EN CHILE, 1960-2001
by: Jorge Szot Meza
Published: (2003)

A characterization of finite étale morphisms in tensor triangular geometry
by: Sanders, Beren
Published: (2021)

The tensor triangular geometry of fully faithful functors
by: Sanders, Beren
Published: (2025)

Inelastic Antideutron Interaction with Nuclei
by: Golubeva, E. S.
Published: (2025)

Comparison of Radiofrequency Microneedling and Ultrasound Delivery of Plant‐Based Derived Secretory Factor (CFa1) Hair Serum for the Cosmetic Improvement of Androgenetic Alopecia
by: Lauren S. Mohan, et al.
Published: (2026)

PARD: Accelerating LLM Inference with Low-Cost PARallel Draft Model Adaptation
by: An, Zihao, et al.
Published: (2025)