Copertina

Insights into the Lottery Ticket Hypothesis and Iterative Magnitude Pruning

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Saleem, Tausifa Jan, Ahuja, Ramanjit, Prasad, Surendra, Lall, Brejesh
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

LIB-KD: Teaching Inductive Bias for Efficient Vision Transformer Distillation and Compression
di: Habib, Gousia, et al.
Pubblicazione: (2023)

Quantization vs Pruning: Insights from the Strong Lottery Ticket Hypothesis
di: Kumar, Aakash, et al.
Pubblicazione: (2025)

Bayesian Lottery Ticket Hypothesis
di: Kuhn, Nicholas, et al.
Pubblicazione: (2026)

Knowledge Distillation in Vision Transformers: A Critical Review
di: Habib, Gousia, et al.
Pubblicazione: (2023)

On the Sparsity of the Strong Lottery Ticket Hypothesis
di: Natale, Emanuele, et al.
Pubblicazione: (2024)

A Survey of Lottery Ticket Hypothesis
di: Liu, Bohan, et al.
Pubblicazione: (2024)

Investigating the Lottery Ticket Hypothesis for Variational Quantum Circuits
di: Kölle, Michael, et al.
Pubblicazione: (2025)

The Strong Lottery Ticket Hypothesis for Multi-Head Attention Mechanisms
di: Otsuka, Hikari, et al.
Pubblicazione: (2025)

LOTUS: Improving Transformer Efficiency with Sparsity Pruning and Data Lottery Tickets
di: Upadhyay, Ojasw
Pubblicazione: (2024)

SuperTickets: Drawing Task-Agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning
di: You, Haoran, et al.
Pubblicazione: (2022)

KS-Lottery: Finding Certified Lottery Tickets for Multilingual Language Models
di: Yuan, Fei, et al.
Pubblicazione: (2024)

Generative QoE Modeling: A Lightweight Approach for Telecom Networks
di: Nayar, Vinti, et al.
Pubblicazione: (2025)

When Layers Play the Lottery, all Tickets Win at Initialization
di: Jordao, Artur, et al.
Pubblicazione: (2023)

Weisfeiler and Leman Go Gambling: Why Expressive Lottery Tickets Win
di: Kummer, Lorenz, et al.
Pubblicazione: (2025)

Grokking as Structural Inference: Transformers Need Bayesian Lottery Tickets
di: Hidajat, Kai, et al.
Pubblicazione: (2026)

Towards Scalable Lottery Ticket Networks using Genetic Algorithms
di: Schönberger, Julian, et al.
Pubblicazione: (2025)

Toy Combinatorial Interpretability Models Reveal Lottery Tickets in Early Feature Space
di: Bebchuk, Alon, et al.
Pubblicazione: (2026)

Bridging Lottery Ticket and Grokking: Understanding Grokking from Inner Structure of Networks
di: Minegishi, Gouki, et al.
Pubblicazione: (2023)

Partially Frozen Random Networks Contain Compact Strong Lottery Tickets
di: Otsuka, Hikari, et al.
Pubblicazione: (2024)

Uncovering a Winning Lottery Ticket with Continuously Relaxed Bernoulli Gates
di: Tsayag, Itamar, et al.
Pubblicazione: (2026)

On the Mechanism and Dynamics of Modular Addition: Fourier Features, Lottery Ticket, and Grokking
di: He, Jianliang, et al.
Pubblicazione: (2026)

A Comprehensive Review of Knowledge Distillation in Computer Vision
di: Habib, Gousia, et al.
Pubblicazione: (2024)

A Neural Scaling Law from Lottery Ticket Ensembling
di: Liu, Ziming, et al.
Pubblicazione: (2023)

Sparse Weight Averaging with Multiple Particles for Iterative Magnitude Pruning
di: Choi, Moonseok, et al.
Pubblicazione: (2023)

Sparse Training from Random Initialization: Aligning Lottery Ticket Masks using Weight Symmetry
di: Adnan, Mohammed, et al.
Pubblicazione: (2025)

Winning Lottery Tickets in Neural Networks via a Quantum-Inspired Classical Algorithm
di: Isogai, Natsuto, et al.
Pubblicazione: (2026)

Polynomially Over-Parameterized Convolutional Neural Networks Contain Structured Strong Winning Lottery Tickets
di: da Cunha, Arthur, et al.
Pubblicazione: (2023)

FedMap: Iterative Magnitude-Based Pruning for Communication-Efficient Federated Learning
di: Herzog, Alexander, et al.
Pubblicazione: (2024)

Winning the Lottery by Preserving Network Training Dynamics with Concrete Ticket Search
di: Arora, Tanay, et al.
Pubblicazione: (2025)

On How Iterative Magnitude Pruning Discovers Local Receptive Fields in Fully Connected Neural Networks
di: Redman, William T., et al.
Pubblicazione: (2024)

Early Transformers: A study on Efficient Training of Transformer Models through Early-Bird Lottery Tickets
di: Cheekati, Shravan
Pubblicazione: (2024)

Advancing IIoT with Over-the-Air Federated Learning: The Role of Iterative Magnitude Pruning
di: Khan, Fazal Muhammad Ali, et al.
Pubblicazione: (2024)

The Multiple Ticket Hypothesis: Random Sparse Subnetworks Suffice for RLVR
di: Adewuyi, Israel, et al.
Pubblicazione: (2026)

Spiking Layer-Adaptive Magnitude-based Pruning
di: Wang, Junqiao, et al.
Pubblicazione: (2026)

Fast Track to Winning Tickets: Repowering One-Shot Pruning for Graph Neural Networks
di: Yue, Yanwei, et al.
Pubblicazione: (2024)

The Lottery Ticket Hypothesis in Denoising: Towards Semantic-Driven Initialization
di: Mao, Jiafeng, et al.
Pubblicazione: (2023)

The Open-World Lottery Ticket Hypothesis for OOD Intent Classification
di: Zhou, Yunhua, et al.
Pubblicazione: (2022)

IPPRO: Importance-based Pruning with PRojective Offset for Magnitude-indifferent Structural Pruning
di: Jung, Jaeheun, et al.
Pubblicazione: (2025)

The Neural Pruning Law Hypothesis
di: Barbulescu, Eugen, et al.
Pubblicazione: (2025)

ASAP: Attention-Shift-Aware Pruning for Efficient LVLM Inference
di: Pathak, Surendra, et al.
Pubblicazione: (2026)