Cover Image

Are Sparse Neural Networks Better Hard Sample Learners?

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Xiao, Qiao, Wu, Boqian, Yin, Lu, Gadzinski, Christopher Neil, Huang, Tianjin, Pechenizkiy, Mykola, Mocanu, Decebal Constantin
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

E2ENet: Dynamic Sparse Feature Fusion for Accurate and Efficient 3D Medical Image Segmentation
by: Wu, Boqian, et al.
Published: (2023)

Dynamic Sparse Training versus Dense Training: The Unexpected Winner in Image Corruption Robustness
by: Wu, Boqian, et al.
Published: (2024)

Leave it to the Specialist: Repair Sparse LLMs with Sparse Fine-Tuning via Sparsity Evolution
by: Xiao, Qiao, et al.
Published: (2025)

Addressing the Collaboration Dilemma in Low-Data Federated Learning via Transient Sparsity
by: Xiao, Qiao, et al.
Published: (2025)

Sparse-to-Sparse Training of Diffusion Models
by: Oliveira, Inês Cardoso, et al.
Published: (2025)

When Data Is Scarce: Scaling Sparse Language Models with Repeated Training
by: Wu, Boqian, et al.
Published: (2026)

Deep Ensembling with No Overhead for either Training or Testing: The All-Round Blessings of Dynamic Sparsity
by: Liu, Shiwei, et al.
Published: (2021)

You Can Have Better Graph Neural Networks by Not Training Weights at All: Finding Untrained GNNs Tickets
by: Huang, Tianjin, et al.
Published: (2022)

NeuroTrails: Training with Dynamic Sparse Heads as the Key to Effective Ensembling
by: Grooten, Bram, et al.
Published: (2025)

Unveiling the Power of Sparse Neural Networks for Feature Selection
by: Atashgahi, Zahra, et al.
Published: (2024)

Adaptive Sparsity Level during Training for Efficient Time Series Forecasting with Transformers
by: Atashgahi, Zahra, et al.
Published: (2023)

Visual Prompting Upgrades Neural Network Sparsification: A Data-Model Perspective
by: Jin, Can, et al.
Published: (2023)

Memory-Efficient LLM Training with Dynamic Sparsity: From Stability to Practical Scaling
by: Xiao, Qiao, et al.
Published: (2026)

Dynamic Data Pruning for Automatic Speech Recognition
by: Xiao, Qiao, et al.
Published: (2024)

(PASS) Visual Prompt Locates Good Structure Sparsity through a Recurrent HyperNetwork
by: Huang, Tianjin, et al.
Published: (2024)

Self-Regulated Neurogenesis for Online Data-Incremental Learning
by: Yildirim, Murat Onur, et al.
Published: (2024)

REOBench: Benchmarking Robustness of Earth Observation Foundation Models
by: Li, Xiang, et al.
Published: (2025)

LiMTR: Time Series Motion Prediction for Diverse Road Users through Multimodal Feature Integration
by: Oerlemans, Camiel, et al.
Published: (2024)

HASARD: A Benchmark for Vision-Based Safe Reinforcement Learning in Embodied Agents
by: Tomilin, Tristan, et al.
Published: (2025)

Boosting Robustness in Preference-Based Reinforcement Learning with Dynamic Sparsity
by: Muslimani, Calarina, et al.
Published: (2024)

MedFM-Robust: Benchmarking Robustness of Medical Foundation Models
by: Cui, Xiangxiang, et al.
Published: (2026)

Nerva: a Truly Sparse Implementation of Neural Networks
by: Wesselink, Wieger, et al.
Published: (2024)

Better Sampling, towards Better End-to-end Small Object Detection
by: Huang, Zile, et al.
Published: (2024)

CLIP Brings Better Features to Visual Aesthetics Learners
by: Xu, Liwu, et al.
Published: (2023)

PhysVid: Physics Aware Local Conditioning for Generative Video Models
by: Pathak, Saurabh, et al.
Published: (2026)

SparseRadNet: Sparse Perception Neural Network on Subsampled Radar Data
by: Wu, Jialong, et al.
Published: (2024)

MagShield: Towards Better Robustness in Sparse Inertial Motion Capture Under Magnetic Disturbances
by: Shao, Yunzhe, et al.
Published: (2025)

Sparse CLIP: Co-Optimizing Interpretability and Performance in Contrastive Learning
by: Qin, Chuan, et al.
Published: (2026)

Pushing the Limits of Sparsity: A Bag of Tricks for Extreme Pruning
by: Li, Andy, et al.
Published: (2024)

Deep Clustering with Diffused Sampling and Hardness-aware Self-distillation
by: Zhang, Hai-Xin, et al.
Published: (2024)

Hard Negative Sample Mining for Whole Slide Image Classification
by: Huang, Wentao, et al.
Published: (2024)

Sparse-Up: Learnable Sparse Upsampling for 3D Generation with High-Fidelity Textures
by: Xiao, Lu, et al.
Published: (2025)

MSRS: Training Multimodal Speech Recognition Models from Scratch with Sparse Mask Optimization
by: Fernandez-Lopez, Adriana, et al.
Published: (2024)

SCOPE: Scene-Contextualized Incremental Few-Shot 3D Segmentation
by: Thengane, Vishal, et al.
Published: (2026)

HDW-SR: High-Frequency Guided Diffusion Model based on Wavelet Decomposition for Image Super-Resolution
by: Yang, Chao, et al.
Published: (2025)

SSNeRF: Sparse View Semi-supervised Neural Radiance Fields with Augmentation
by: Cao, Xiao, et al.
Published: (2024)

Sparse by Rule: Probability-Based N:M Pruning for Spiking Neural Networks
by: Ye, Shuhan, et al.
Published: (2025)

K-Origins: Better Colour Quantification for Neural Networks
by: Mason, Lewis, et al.
Published: (2024)

SVASTIN: Sparse Video Adversarial Attack via Spatio-Temporal Invertible Neural Networks
by: Pan, Yi, et al.
Published: (2024)

Rendering-Aware Sparse Sampling for BRDF Acquisition
by: Cao, W., et al.
Published: (2026)