Cover Image

ScaleAcross Explorer: Exploring Communication Optimization for Scale-Across AI Model Training

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Li, Minghao, Golden, Alicia, Hsia, Samuel, Kuchnik, Michael, Gangidi, Adi, Zhang, Xu, Shetty, Ashmitha Jeevaraj, DeVito, Zachary, Chu, Weiwei, He, Dong, Zhang, Haoci, Hao, Yuchen, Pang, Ruoming, Zeng, James Hongyi, Zhang, Ying, Yu, Minlan, Wu, Carole-Jean
Format:	Preprint
Published:	2026
Subjects:	Distributed, Parallel, and Cluster Computing Artificial Intelligence Networking and Internet Architecture
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

PRISM: Probabilistic Runtime Insights and Scalable Performance Modeling for Large-Scale Distributed Training
by: Golden, Alicia, et al.
Published: (2025)

Revisiting Reliability in Large-Scale Machine Learning Research Clusters
by: Kokolis, Apostolos, et al.
Published: (2024)

MAD Max Beyond Single-Node: Enabling Large Machine Learning Model Acceleration on Distributed Systems
by: Hsia, Samuel, et al.
Published: (2023)

Is Flash Attention Stable?
by: Golden, Alicia, et al.
Published: (2024)

Generative AI Beyond LLMs: System Implications of Multi-Modal Generation
by: Golden, Alicia, et al.
Published: (2023)

Cohomogeneity two Bazaikin spaces
by: DeVito, Jason, et al.
Published: (2025)

Almost positively curved generalized Eschenburg spaces
by: DeVito, Jason, et al.
Published: (2025)

Curvature on Eschenburg spaces
by: DeVito, Jason, et al.
Published: (2023)

Rational spheres and double disk bundles
by: DeVito, Jason, et al.
Published: (2021)

Genomic Differentiation and Adaptation of Rattus nitidus Across Spatial Scales
by: Mingyu Zhang, et al.
Published: (2025)

Controls of Climate and Catchment Behaviour on Runoff Response Across Large‐Scale Sample
by: Yang Mingjuan, et al.
Published: (2025)

Anisotropy Across Fields and Scales
Published: (2021)

Empirical Analysis of the Center Across Scales
by: Jakovac, Irena
Published: (2026)

Climate Adaptation and Resilience Across Scales
Published: (2025)

Scaling Exponents Across Parameterizations and Optimizers
by: Everett, Katie, et al.
Published: (2024)

Materials Informatics Across the Length Scales
by: Nasir, Jamal Abdul, et al.
Published: (2026)

Evolution of Physical Intelligence Across Scales
by: Ke Liu, et al.
Published: (2026)

EC-DIT: Scaling Diffusion Transformers with Adaptive Expert-Choice Routing
by: Sun, Haotian, et al.
Published: (2024)

ScaleTrotter: Illustrative Visual Travels Across Negative Scales
by: Halladjian, Sarkis, et al.
Published: (2019)

Semantic Convergence: Investigating Shared Representations Across Scaled LLMs
by: Son, Daniel, et al.
Published: (2025)

Decouple and Decompose: Scaling Resource Allocation with DeDe
by: Xu, Zhiying, et al.
Published: (2024)

Temperature Dependence of Angular Momentum Transport Across Interfaces
by: Chen, Kai, et al.
Published: (2016)

Examples of biquotients whose tangent bundle is not a biquotient vector bundle
by: Albanese, Michael, et al.
Published: (2021)

Cross360: 360° Monocular Depth Estimation via Cross Projections Across Scales
by: Huang, Kun, et al.
Published: (2026)

Language Family Matters: Evaluating LLM-Based ASR Across Linguistic Boundaries
by: Zhang, Yuchen, et al.
Published: (2026)

Life as a Coherent System Across Scales
by: Lesperance, Joel Michael
Published: (2025)

Chapter 16 Scaling Up, Down, and Across
by: Druckman, Daniel
Published: (2024)

Scaling Optimal LR Across Token Horizons
by: Bjorck, Johan, et al.
Published: (2024)

Dissection of Neurochemical Pathways Across Complexity and Scale
by: Alice Abbondanza, et al.
Published: (2025)

Is Bigger and Deeper Always Better? Probing LLaMA Across Scales and Layers
by: Chen, Nuo, et al.
Published: (2023)

Versatile Ordering Network: An Attention-based Neural Network for Ordering Across Scales and Quality Metrics
by: Yu, Zehua, et al.
Published: (2024)

Detail Across Scales: Multi-Scale Enhancement for Full Spectrum Neural Representations
by: Ni, Yuan, et al.
Published: (2025)

Friends Across Time: Multi-Scale Action Segmentation Transformer for Surgical Phase Recognition
by: Zhang, Bokai, et al.
Published: (2024)

Unfolding an Atomistic World: Atomistic Simulation of Reactor Pressure Vessel Steel Across Year-and-Meter Scales
by: Han, Haozhi, et al.
Published: (2026)

DISTRIBUTEDANN: Efficient Scaling of a Single DISKANN Graph Across Thousands of Computers
by: Adams, Philip, et al.
Published: (2025)

Learning Images Across Scales Using Adversarial Training
by: Wolski, Krzysztof, et al.
Published: (2024)

LLM Circuit Analyses Are Consistent Across Training and Scale
by: Tigges, Curt, et al.
Published: (2024)

Scaling Instructable Agents Across Many Simulated Worlds
by: SIMA Team, et al.
Published: (2024)

Beyond Text Compression: Evaluating Tokenizers Across Scales
by: Lotz, Jonas F., et al.
Published: (2025)

Hierarchical Twist: Chirality Across Scales in Cellulose Cholesterics
by: N. Monge, et al.
Published: (2025)