Salvato in:
Dettagli Bibliografici
Autori principali: Tyagi, Abhishek, Iyer, Arjun, Young, Liam, Renninger, William H, Kanan, Christopher, Zhu, Yuhao
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:https://arxiv.org/abs/2510.14812
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908597971058688
author Tyagi, Abhishek
Iyer, Arjun
Young, Liam
Renninger, William H
Kanan, Christopher
Zhu, Yuhao
author_facet Tyagi, Abhishek
Iyer, Arjun
Young, Liam
Renninger, William H
Kanan, Christopher
Zhu, Yuhao
contents Structured sparsity accelerates training and inference on modern GPUs, yet it still trails unstructured dynamic sparse training (DST) in accuracy. The shortfall stems from a loss of expressivity: whereas a dense layer can realize every possible mask obtained by choosing any $w$ active weights out of $n$, a fixed block or N:M layout explores only a subset of those possibilities. We propose to close this gap by learning, for each layer, a single permutation matrix jointly with the structured weight matrix. Applied to three canonical structures -- block, N:M, and diagonals -- we show that permutation-augmented DST (PA-DST) matches unstructured baselines (RigL, SET) at 90--95\% sparsity on ImageNet-1K (ViT-B/16) and WikiText-103 (GPT-2), yet trains up to $1.21\times$ and infers up to $2.9\times$ faster. The results position structure + learned permutation as a sweet spot between accuracy and efficiency.
format Preprint
id arxiv_https___arxiv_org_abs_2510_14812
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Efficient Dynamic Structured Sparse Training with Learned Shuffles
Tyagi, Abhishek
Iyer, Arjun
Young, Liam
Renninger, William H
Kanan, Christopher
Zhu, Yuhao
Machine Learning
Structured sparsity accelerates training and inference on modern GPUs, yet it still trails unstructured dynamic sparse training (DST) in accuracy. The shortfall stems from a loss of expressivity: whereas a dense layer can realize every possible mask obtained by choosing any $w$ active weights out of $n$, a fixed block or N:M layout explores only a subset of those possibilities. We propose to close this gap by learning, for each layer, a single permutation matrix jointly with the structured weight matrix. Applied to three canonical structures -- block, N:M, and diagonals -- we show that permutation-augmented DST (PA-DST) matches unstructured baselines (RigL, SET) at 90--95\% sparsity on ImageNet-1K (ViT-B/16) and WikiText-103 (GPT-2), yet trains up to $1.21\times$ and infers up to $2.9\times$ faster. The results position structure + learned permutation as a sweet spot between accuracy and efficiency.
title Efficient Dynamic Structured Sparse Training with Learned Shuffles
topic Machine Learning
url https://arxiv.org/abs/2510.14812