Arrow Matrix Decomposition: A Novel Approach for Communication-Efficient Sparse Matrix Multiplication

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Gianinazzi, Lukas, Ziogas, Alexandros Nikolaos, Huang, Langwen, Luczynski, Piotr, Ashkboos, Saleh, Scheidl, Florian, Carigiet, Armon, Ge, Chio, Abubaker, Nabil, Besta, Maciej, Ben-Nun, Tal, Hoefler, Torsten
Format:	Preprint
Published:	2024
Subjects:	Distributed, Parallel, and Cluster Computing F.2.1
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Low-Depth Spatial Tree Algorithms
by: Baumann, Yves, et al.
Published: (2024)

SpaDA: A Spatial Dataflow Architecture Programming Language
by: Gianinazzi, Lukas, et al.
Published: (2025)

SpComm3D: A Framework for Enabling Sparse Communication in 3D Sparse Kernels
by: Abubaker, Nabil, et al.
Published: (2024)

Demystifying Higher-Order Graph Neural Networks
by: Besta, Maciej, et al.
Published: (2024)

Near-Optimal Wafer-Scale Reduce
by: Luczynski, Piotr, et al.
Published: (2024)

HOT: Higher-Order Dynamic Graph Representation Learning with Efficient Transformers
by: Besta, Maciej, et al.
Published: (2023)

DiffDA: a Diffusion Model for Weather-scale Data Assimilation
by: Huang, Langwen, et al.
Published: (2024)

FoldedHexaTorus: An Inter-Chiplet Interconnect Topology for Chiplet-based Systems using Organic and Glass Substrates
by: Iff, Patrick, et al.
Published: (2025)

VEIL: Reading Control Flow Graphs Like Code
by: Schaad, Philipp, et al.
Published: (2025)

EmuGEMM (Benchmark Scripts): Fused Tensor Core Kernels for Precision Emulation in Matrix Multiplication
by: Lu, Denghui, et al.
Published: (2026)

Inductive Loop Analysis for Practical HPC Application Optimization
by: Schaad, Philipp, et al.
Published: (2025)

EfQAT: An Efficient Framework for Quantization-Aware Training
by: Ashkboos, Saleh, et al.
Published: (2024)

Beyond Outliers: A Study of Optimizers Under Quantization
by: Vlassis, Georgios, et al.
Published: (2025)

Error bounded compression for weather and climate applications
by: Huang, Langwen, et al.
Published: (2025)

Graph of Thoughts: Solving Elaborate Problems with Large Language Models
by: Besta, Maciej, et al.
Published: (2023)

PlaceIT: Placement-based Inter-Chiplet Interconnect Topologies
by: Iff, Patrick, et al.
Published: (2025)

Network Design for Wafer-Scale Systems with Wafer-on-Wafer Hybrid Bonding
by: Iff, Patrick, et al.
Published: (2026)

CrossPipe: Towards Optimal Pipeline Schedules for Cross-Datacenter Training
by: Chen, Tiancheng, et al.
Published: (2025)

Scaling Laws of Global Weather Models
by: Yu, Yuejiang, et al.
Published: (2026)

SliceGPT: Compress Large Language Models by Deleting Rows and Columns
by: Ashkboos, Saleh, et al.
Published: (2024)

HALO: Hadamard-Assisted Lower-Precision Optimization for LLMs
by: Ashkboos, Saleh, et al.
Published: (2025)

Taming Unbalanced Training Workloads in Deep Learning with Partial Collective Operations
by: Li, Shigang, et al.
Published: (2019)

Benchmarking Filtered Approximate Nearest Neighbor Search Algorithms on Transformer-based Embedding Vectors
by: Iff, Patrick, et al.
Published: (2025)

Spritz: Path-Aware Load Balancing in Low-Diameter Networks
by: Bonato, Tommaso, et al.
Published: (2026)

RapidChiplet: A Toolchain for Rapid Design Space Exploration of Chiplet Architectures
by: Iff, Patrick, et al.
Published: (2023)

Quatrex SC25 AD: Simulation Inputs and Configuration Files
by: Ziogas, Alexandros Nikolaos, et al.
Published: (2025)

High Performance Unstructured SpMM Computation Using Tensor Cores
by: Okanovic, Patrik, et al.
Published: (2024)

PolarStar: Expanding the Scalability Horizon of Diameter-3 Networks
by: Lakhotia, Kartik, et al.
Published: (2023)

Near-Optimal Sparse Allreduce for Distributed Deep Learning
by: Li, Shigang, et al.
Published: (2022)

ADELIA: Automatic Differentiation for Efficient Laplace Inference Approximations
by: Boudaoud, Afif, et al.
Published: (2026)

Breaking (Global) Barriers in Parallel Stochastic Optimization with Wait-Avoiding Group Averaging
by: Li, Shigang, et al.
Published: (2020)

BLaST: High Performance Inference and Pretraining using BLock Sparse Transformers
by: Okanovic, Patrik, et al.
Published: (2025)

Ab-initio Quantum Transport with the GW Approximation, 42,240 Atoms, and Sustained Exascale Performance
by: Vetsch, Nicolas, et al.
Published: (2025)

GraphSeek: Next-Generation Graph Analytics with LLMs
by: Besta, Maciej, et al.
Published: (2026)

QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs
by: Ashkboos, Saleh, et al.
Published: (2024)

Improved Algorithms for Kernel Matrix-Vector Multiplication Under Sparsity Assumptions
by: Indyk, Piotr, et al.
Published: (2025)

Demystifying Chains, Trees, and Graphs of Thoughts
by: Besta, Maciej, et al.
Published: (2024)

Learning Large Causal Structures from Inverse Covariance Matrix via Sparse Matrix Decomposition
by: Dong, Shuyu, et al.
Published: (2022)

Higher-Order Graph Databases
by: Besta, Maciej, et al.
Published: (2025)

The Ubiquitous Sparse Matrix-Matrix Products
by: Buluç, Aydın
Published: (2025)