Cover Image

Dynamic Sparse Training with Structured Sparsity

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lasby, Mike, Golubeva, Anna, Evci, Utku, Nica, Mihai, Ioannou, Yani
Format:	Preprint
Published:	2023
Subjects:	Machine Learning Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Learning Fine-grained Parameter Sharing via Sparse Tensor Decomposition
by: Üyük, Cem, et al.
Published: (2024)

Navigating Extremes: Dynamic Sparsity in Large Output Spaces
by: Ullah, Nasib, et al.
Published: (2024)

Meta-Sparsity: Learning Optimal Sparse Structures in Multi-task Networks through Meta-learning
by: Upadhyay, Richa, et al.
Published: (2025)

Deep Ensembling with No Overhead for either Training or Testing: The All-Round Blessings of Dynamic Sparsity
by: Liu, Shiwei, et al.
Published: (2021)

Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsity
by: Xi, Haocheng, et al.
Published: (2025)

Sparse-to-Sparse Training of Diffusion Models
by: Oliveira, Inês Cardoso, et al.
Published: (2025)

Cyclic Sparse Training: Is it Enough?
by: Gadhikar, Advait, et al.
Published: (2024)

OMH: Structured Sparsity via Optimally Matched Hierarchy for Unsupervised Semantic Segmentation
by: Ozaydin, Baran, et al.
Published: (2024)

Sparsity-Driven Parallel Imaging Consistency for Improved Self-Supervised MRI Reconstruction
by: Alçalar, Yaşar Utku, et al.
Published: (2025)

LAPA: Log-Domain Prediction-Driven Dynamic Sparsity Accelerator for Transformer Model
by: Wang, Huizheng, et al.
Published: (2025)

SURGEON: Memory-Adaptive Fully Test-Time Adaptation via Dynamic Activation Sparsity
by: Ma, Ke, et al.
Published: (2025)

Evaluation in Neural Style Transfer: A Review
by: Ioannou, Eleftherios, et al.
Published: (2024)

FIS-DiT: Breaking the Few-Step Video Inference Barrier via Training-Free Frame Interleaved Sparsity
by: Tang, Jian, et al.
Published: (2026)

Sign-In to the Lottery: Reparameterizing Sparse Training From Scratch
by: Gadhikar, Advait, et al.
Published: (2025)

SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse-Linear Attention
by: Zhang, Jintao, et al.
Published: (2025)

Extreme Model Compression with Structured Sparsity at Low Precision
by: Liu, Dan, et al.
Published: (2025)

TinyTrain: Resource-Aware Task-Adaptive Sparse Training of DNNs at the Data-Scarce Edge
by: Kwon, Young D., et al.
Published: (2023)

LVSA: Training-Free Sparse Attention for Long Video Diffusion
by: Glorian, Gael, et al.
Published: (2026)

Sparse-IFT: Sparse Iso-FLOP Transformations for Maximizing Training Efficiency
by: Thangarasa, Vithursan, et al.
Published: (2023)

Investigation of the Impact of Synthetic Training Data in the Industrial Application of Terminal Strip Object Detection
by: Baumgart, Nico, et al.
Published: (2024)

CRISP: Hybrid Structured Sparsity for Class-aware Model Pruning
by: Aggarwal, Shivam, et al.
Published: (2023)

SINR: Sparsity Driven Compressed Implicit Neural Representations
by: Jayasundara, Dhananjaya, et al.
Published: (2025)

Analyzing Hierarchical Structure in Vision Models with Sparse Autoencoders
by: Olson, Matthew Lyle, et al.
Published: (2025)

MosaicDiff: Training-free Structural Pruning for Diffusion Model Acceleration Reflecting Pretraining Dynamics
by: Guo, Bowei, et al.
Published: (2025)

Embracing Unknown Step by Step: Towards Reliable Sparse Training in Real World
by: Lei, Bowen, et al.
Published: (2024)

Robust Experts: the Effect of Adversarial Training on CNNs with Sparse Mixture-of-Experts Layers
by: Pavlitska, Svetlana, et al.
Published: (2025)

LASERS: LAtent Space Encoding for Representations with Sparsity for Generative Modeling
by: Li, Xin, et al.
Published: (2024)

SparVAR: Exploring Sparsity in Visual AutoRegressive Modeling for Training-Free Acceleration
by: Li, Zekun, et al.
Published: (2026)

Towards Better Alignment: Training Diffusion Models with Reinforcement Learning Against Sparse Rewards
by: Hu, Zijing, et al.
Published: (2025)

Adaptive Sharpness-Aware Pruning for Robust Sparse Networks
by: Bair, Anna, et al.
Published: (2023)

Hard ASH: Sparsity and the right optimizer make a continual learner
by: Keskinen, Santtu
Published: (2024)

Dual-Stage Invariant Continual Learning under Extreme Visual Sparsity
by: Zhang, Rangya, et al.
Published: (2026)

Training VAEs Under Structured Residuals
by: Dorta, Gara, et al.
Published: (2018)

Do Sparse Subnetworks Exhibit Cognitively Aligned Attention? Effects of Pruning on Saliency Map Fidelity, Sparsity, and Concept Coherence
by: Suwal, Sanish, et al.
Published: (2025)

CLIP-UP: A Simple and Efficient Mixture-of-Experts CLIP Training Recipe with Sparse Upcycling
by: Wang, Xinze, et al.
Published: (2025)

SoftSAE: Dynamic Top-K Selection for Adaptive Sparse Autoencoders
by: Stępień, Jakub, et al.
Published: (2026)

Evaluating Utility of Memory Efficient Medical Image Generation: A Study on Lung Nodule Segmentation
by: Khadra, Kathrin, et al.
Published: (2024)

Rethinking Pruning for Vision-Language Models: Strategies for Effective Sparsity and Performance Restoration
by: He, Shwai, et al.
Published: (2024)

Sparsity Hurts: Simple Linear Adapter Can Boost Generalized Category Discovery
by: Ye, Bo, et al.
Published: (2026)

ELSA: Exploiting Layer-wise N:M Sparsity for Vision Transformer Acceleration
by: Huang, Ning-Chi, et al.
Published: (2024)