Imagen de Portada

Always-Sparse Training by Growing Connections with Guided Stochastic Exploration

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Heddes, Mike, Srinivasa, Narayan, Givargis, Tony, Nicolau, Alexandru
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Molecular Classification Using Hyperdimensional Graph Classification
por: Verges, Pere, et al.
Publicado: (2024)

Convolution and Cross-Correlation of Count Sketches Enables Fast Cardinality Estimation of Multi-Join Queries
por: Heddes, Mike, et al.
Publicado: (2024)

Approximating Tensor Network Contraction with Sketches
por: Heddes, Mike, et al.
Publicado: (2026)

DeepCrossAttention: Supercharging Transformer Residual Connections
por: Heddes, Mike, et al.
Publicado: (2025)

Advancing Intoxication Detection: A Smartwatch-Based Approach
por: Segura, Manuel, et al.
Publicado: (2025)

Enhanced Detection of Transdermal Alcohol Levels Using Hyperdimensional Computing on Embedded Devices
por: Segura, Manuel E., et al.
Publicado: (2024)

Should We Always Train Models on Fine-Grained Classes?
por: Pirovano, Davide, et al.
Publicado: (2025)

Gradient-Congruity Guided Federated Sparse Training
por: Tian, Chris Xing, et al.
Publicado: (2024)

Dynamic Sparse Training with Structured Sparsity
por: Lasby, Mike, et al.
Publicado: (2023)

Dynamic Sparse Training of Diagonally Sparse Networks
por: Tyagi, Abhishek, et al.
Publicado: (2025)

Growing Winning Subnetworks, Not Pruning Them: A Paradigm for Density Discovery in Sparse Neural Networks
por: Yao, Qihang, et al.
Publicado: (2025)

Low-Rank Plus Sparse Matrix Transfer Learning under Growing Representations and Ambient Dimensions
por: Chai, Jinhang, et al.
Publicado: (2026)

Graph Attention is Not Always Beneficial: A Theoretical Analysis of Graph Attention Mechanisms via Contextual Stochastic Block Models
por: Ma, Zhongtian, et al.
Publicado: (2024)

HGAN-SDEs: Learning Neural Stochastic Differential Equations with Hermite-Guided Adversarial Training
por: Xu, Yuanjian, et al.
Publicado: (2025)

Let's Grow an Unbiased Community: Guiding the Fairness of Graphs via New Links
por: Lu, Jiahua, et al.
Publicado: (2025)

AALF: Almost Always Linear Forecasting
por: Jakobs, Matthias, et al.
Publicado: (2024)

Stochastic Shortest Path with Sparse Adversarial Costs
por: Johnson, Emmeran, et al.
Publicado: (2025)

FlashMap: A Flash Optimized Key-Value Store
por: Guo, Zonglin, et al.
Publicado: (2025)

Connecting Independently Trained Modes via Layer-Wise Connectivity
por: Tian, Yongding, et al.
Publicado: (2025)

Functional Encryption in Secure Neural Network Training: Data Leakage and Practical Mitigations
por: Ioniţă, Alexandru, et al.
Publicado: (2025)

Growing with Experience: Growing Neural Networks in Deep Reinforcement Learning
por: Fehring, Lukas, et al.
Publicado: (2025)

LLMs Will Always Hallucinate, and We Need to Live With This
por: Banerjee, Sourav, et al.
Publicado: (2024)

Decoupling Exploration and Policy Optimization: Uncertainty Guided Tree Search for Hard Exploration
por: Mhammedi, Zakaria, et al.
Publicado: (2026)

Robust and Sparse Regression in GLM by Stochastic Optimization
por: Kawashima, Takayuki, et al.
Publicado: (2018)

SparseOpt: Addressing Normalization-induced Gradient Skew in Sparse Training
por: Adnan, Mohammed, et al.
Publicado: (2026)

Linear Mode Connectivity in Sparse Neural Networks
por: McDermott, Luke, et al.
Publicado: (2023)

Efficient Sparse Training with Structured Dropout
por: Lo, Andy
Publicado: (2024)

Growing Visual Generative Capacity for Pre-Trained MLLMs
por: Wang, Hanyu, et al.
Publicado: (2025)

Preference-Guided Reinforcement Learning for Efficient Exploration
por: Wang, Guojian, et al.
Publicado: (2024)

UGCE: User-Guided Incremental Counterfactual Exploration
por: Fragkathoulas, Christos, et al.
Publicado: (2025)

$μ$nit Scaling: Simple and Scalable FP8 LLM Training
por: Narayan, Saaketh, et al.
Publicado: (2025)

Instance-Warp: Saliency Guided Image Warping for Unsupervised Domain Adaptation
por: Zheng, Shen, et al.
Publicado: (2024)

Incentivized Exploration of Non-Stationary Stochastic Bandits
por: Chakraborty, Sourav, et al.
Publicado: (2024)

Hierarchical Multiple Kernel K-Means Algorithm Based on Sparse Connectivity
por: Wang, Lei, et al.
Publicado: (2024)

Sparse-ProxSkip: Accelerated Sparse-to-Sparse Training in Federated Learning
por: Meinhardt, Georg, et al.
Publicado: (2024)

Training Neural Networks by Optimizing Neuron Positions
por: Erb, Laura, et al.
Publicado: (2025)

Always Skip Attention
por: Ji, Yiping, et al.
Publicado: (2025)

Attribution-Guided Distillation of Matryoshka Sparse Autoencoders
por: Martin-Linares, Cristina P., et al.
Publicado: (2025)

Always Learning, Always Mixing: Efficient and Simple Data Mixing All The Time
por: Hu, Michael Y., et al.
Publicado: (2026)

Eliminating Multi-GPU Performance Taxes: A Systems Approach to Efficient Distributed LLMs
por: Trifan, Octavian Alexandru, et al.
Publicado: (2025)