Cover Image

Sparse Weight Averaging with Multiple Particles for Iterative Magnitude Pruning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Choi, Moonseok, Lee, Hyungi, Nam, Giung, Lee, Juho
Format:	Preprint
Published:	2023
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Enhancing Transfer Learning with Flexible Nonparametric Posterior Sampling
by: Lee, Hyungi, et al.
Published: (2024)

Parameter Expanded Stochastic Gradient Markov Chain Monte Carlo
by: Kim, Hyunsu, et al.
Published: (2025)

Verbalized Confidence Triggers Self-Verification: Emergent Behavior Without Explicit Reasoning Supervision
by: Jang, Chaeyun, et al.
Published: (2025)

Ex Uno Pluria: Insights on Ensembling in Low Precision Number Systems
by: Nam, Giung, et al.
Published: (2024)

IPPRO: Importance-based Pruning with PRojective Offset for Magnitude-indifferent Structural Pruning
by: Jung, Jaeheun, et al.
Published: (2025)

Revisiting Weight Averaging for Model Merging
by: Choi, Jiho, et al.
Published: (2024)

FedMap: Iterative Magnitude-Based Pruning for Communication-Efficient Federated Learning
by: Herzog, Alexander, et al.
Published: (2024)

SAFE: Finding Sparse and Flat Minima to Improve Pruning
by: Lee, Dongyeop, et al.
Published: (2025)

Lipsum-FT: Robust Fine-Tuning of Zero-Shot Models Using Random Text Guidance
by: Nam, Giung, et al.
Published: (2024)

Advancing IIoT with Over-the-Air Federated Learning: The Role of Iterative Magnitude Pruning
by: Khan, Fazal Muhammad Ali, et al.
Published: (2024)

Variational Bayesian Pseudo-Coreset
by: Lee, Hyungi, et al.
Published: (2025)

Improving Constrained Language Generation via Self-Distilled Twisted Sequential Monte Carlo
by: Kim, Sooyeon, et al.
Published: (2025)

Sparse Model Soups: A Recipe for Improved Pruning via Model Averaging
by: Zimmer, Max, et al.
Published: (2023)

Amortized Control of Continuous State Space Feynman-Kac Model for Irregular Time Series
by: Park, Byoungwoo, et al.
Published: (2024)

Weight Concentration Regularization for Improving Pruning Robustness Under High Sparsity
by: Yun, Vincent-Daniel, et al.
Published: (2025)

Safety Alignment Backfires: Preventing the Re-emergence of Suppressed Concepts in Fine-tuned Text-to-Image Diffusion Models
by: Kim, Sanghyun, et al.
Published: (2024)

Attention-based Iterative Decomposition for Tensor Product Representation
by: Park, Taewon, et al.
Published: (2024)

Magnitude-based Neuron Pruning for Backdoor Defens
by: Li, Nan, et al.
Published: (2024)

Joint-Embedding Masked Autoencoder for Self-supervised Learning of Dynamic Functional Connectivity from the Human Brain
by: Choi, Jungwon, et al.
Published: (2024)

Dimension Agnostic Neural Processes
by: Lee, Hyungi, et al.
Published: (2025)

PrunePEFT: Iterative Hybrid Pruning for Parameter-Efficient Fine-tuning of LLMs
by: Yu, Tongzhou, et al.
Published: (2025)

Robust Weight Initialization for Tanh Neural Networks with Fixed Point Analysis
by: Lee, Hyunwoo, et al.
Published: (2024)

Model Fusion through Bayesian Optimization in Language Model Fine-Tuning
by: Jang, Chaeyun, et al.
Published: (2024)

Beyond Gaussian Initializations: Signal Preserving Weight Initialization for Odd-Sigmoid Activations
by: Lee, Hyunwoo, et al.
Published: (2025)

MagR: Weight Magnitude Reduction for Enhancing Post-Training Quantization
by: Zhang, Aozhong, et al.
Published: (2024)

Fast Ensembling with Diffusion Schrödinger Bridge
by: Kim, Hyunsu, et al.
Published: (2024)

Learning Infinitesimal Generators of Continuous Symmetries from Data
by: Ko, Gyeonghoon, et al.
Published: (2024)

SwiftPrune: Hessian-Free Weight Pruning for Large Language Models
by: Kang, Yuhan, et al.
Published: (2025)

Progressive Weight Loading: Accelerating Initial Inference and Gradually Boosting Performance on Resource-Constrained Environments
by: Kim, Hyunwoo, et al.
Published: (2025)

Multi-View Node Pruning for Accurate Graph Representation
by: Kim, Hanjin, et al.
Published: (2025)

WARP: On the Benefits of Weight Averaged Rewarded Policies
by: Ramé, Alexandre, et al.
Published: (2024)

EMA Without the Lag: Bias-Corrected Iterate Averaging Schemes
by: Block, Adam, et al.
Published: (2025)

Sparsely-Supervised Data Assimilation via Physics-Informed Schrödinger Bridge
by: Bu, Dohyun, et al.
Published: (2026)

Parallel Test-Time Scaling with Multi-Sequence Verifiers
by: Kim, Yegon, et al.
Published: (2026)

Reliable Decision Making via Calibration Oriented Retrieval Augmented Generation
by: Jang, Chaeyun, et al.
Published: (2024)

Steering Sparse Autoencoder Latents to Control Dynamic Head Pruning in Vision Transformers (Student Abstract)
by: Lee, Yousung, et al.
Published: (2026)

Realizing Unaligned Block-wise Pruning for DNN Acceleration on Mobile Devices
by: Lee, Hayun, et al.
Published: (2024)

One Shot vs. Iterative: Rethinking Pruning Strategies for Model Compression
by: Janusz, Mikołaj, et al.
Published: (2025)

Set-based Meta-Interpolation for Few-Task Meta-Learning
by: Lee, Seanie, et al.
Published: (2022)

Training-Free Restoration of Pruned Neural Networks
by: Lee, Keonho, et al.
Published: (2025)