Cover Image

Dynamic Sparse Training of Diagonally Sparse Networks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Tyagi, Abhishek, Iyer, Arjun, Renninger, William H, Kanan, Christopher, Zhu, Yuhao
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Efficient Dynamic Structured Sparse Training with Learned Shuffles
by: Tyagi, Abhishek, et al.
Published: (2025)

Efficient Sparse PCA via Block-Diagonalization
by: Del Pia, Alberto, et al.
Published: (2024)

Efficient In-Memory Acceleration of Sparse Block Diagonal LLMs
by: de Lima, João Paulo Cardoso, et al.
Published: (2025)

SparseBalance: Load-Balanced Long Context Training with Dynamic Sparse Attention
by: Xu, Hongtao, et al.
Published: (2026)

Disentangling Dense Embeddings with Sparse Autoencoders
by: O'Neill, Charles, et al.
Published: (2024)

Sparse-ProxSkip: Accelerated Sparse-to-Sparse Training in Federated Learning
by: Meinhardt, Georg, et al.
Published: (2024)

Dynamic Sparse Training with Structured Sparsity
by: Lasby, Mike, et al.
Published: (2023)

Ultra-Sparse Memory Network
by: Huang, Zihao, et al.
Published: (2024)

Sparse-to-Sparse Training of Diffusion Models
by: Oliveira, Inês Cardoso, et al.
Published: (2025)

SparseOpt: Addressing Normalization-induced Gradient Skew in Sparse Training
by: Adnan, Mohammed, et al.
Published: (2026)

Sparse Spectral Training and Inference on Euclidean and Hyperbolic Neural Networks
by: Zhao, Jialin, et al.
Published: (2024)

Training Bayesian Neural Networks with Sparse Subspace Variational Inference
by: Li, Junbo, et al.
Published: (2024)

Rethinking the Role of Dynamic Sparse Training for Scalable Deep Reinforcement Learning
by: Ma, Guozheng, et al.
Published: (2025)

Comprehensive Monitoring of Air Pollution Hotspots Using Sparse Sensor Networks
by: Bhardwaj, Ankit, et al.
Published: (2024)

Efficient Sparse Training with Structured Dropout
by: Lo, Andy
Published: (2024)

Advancing On-Device Neural Network Training with TinyPropv2: Dynamic, Sparse, and Efficient Backpropagation
by: Rüb, Marcus, et al.
Published: (2024)

Value-Based Deep Multi-Agent Reinforcement Learning with Dynamic Sparse Training
by: Hu, Pihe, et al.
Published: (2024)

A Discrete Perspective Towards the Construction of Sparse Probabilistic Boolean Networks
by: Fok, Christopher H., et al.
Published: (2024)

Sparse and Structured Hopfield Networks
by: Santos, Saul, et al.
Published: (2024)

Sparse Covariance Neural Networks
by: Cavallo, Andrea, et al.
Published: (2024)

SparsyFed: Sparse Adaptive Federated Training
by: Guastella, Adriano, et al.
Published: (2025)

NeuroTrails: Training with Dynamic Sparse Heads as the Key to Effective Ensembling
by: Grooten, Bram, et al.
Published: (2025)

HASTE: Hardware-Aware Dynamic Sparse Training for Large Output Spaces
by: Ullah, Nasib, et al.
Published: (2026)

Aligned Training: A Parameter-Free Method to Improve Feature Quality and Stability of Sparse Autoencoders (SAE)
by: Brzozowski, Michał, et al.
Published: (2026)

Embedded Federated Feature Selection with Dynamic Sparse Training: Balancing Accuracy-Cost Tradeoffs
by: Mahanipour, Afsaneh, et al.
Published: (2025)

Differentiable Sparse Identification of Lagrangian Dynamics
by: Zhang, Zitong, et al.
Published: (2025)

Training Deep Boltzmann Networks with Sparse Ising Machines
by: Niazi, Shaila, et al.
Published: (2023)

Thales: Formulating and Estimating Architectural Vulnerability Factors for DNN Accelerators
by: Tyagi, Abhishek, et al.
Published: (2022)

OccamNets: Mitigating Dataset Bias by Favoring Simpler Hypotheses
by: Shrestha, Robik, et al.
Published: (2022)

SparseDM: Toward Sparse Efficient Diffusion Models
by: Wang, Kafeng, et al.
Published: (2024)

Cyclic Sparse Training: Is it Enough?
by: Gadhikar, Advait, et al.
Published: (2024)

Sparse Hybrid Linear-Morphological Networks
by: Fotopoulos, Konstantinos, et al.
Published: (2025)

Learning Neural Networks with Sparse Activations
by: Awasthi, Pranjal, et al.
Published: (2024)

HORST: Composing Optimizer Geometries for Sparse Transformer Training
by: Jacobs, Tom, et al.
Published: (2026)

Two Sparse Matrices are Better than One: Sparsifying Neural Networks with Double Sparse Factorization
by: Boža, Vladimír, et al.
Published: (2024)

Sparse and Faithful Explanations Without Sparse Models
by: Sun, Yiyang, et al.
Published: (2024)

Low Rank and Sparse Fourier Structure in Recurrent Networks Trained on Modular Addition
by: Rangamani, Akshay
Published: (2025)

Training Superior Sparse Autoencoders for Instruct Models
by: Li, Jiaming, et al.
Published: (2025)

Topology-Aware Revival for Efficient Sparse Training
by: Jin, Meiling, et al.
Published: (2026)

Gradient-Congruity Guided Federated Sparse Training
by: Tian, Chris Xing, et al.
Published: (2024)