Imagen de Portada

Efficient Sparse Training with Structured Dropout

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	Lo, Andy
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Efficient Dynamic Structured Sparse Training with Learned Shuffles
por: Tyagi, Abhishek, et al.
Publicado: (2025)

Enhancing Transformer Training Efficiency with Dynamic Dropout
por: Yan, Hanrui, et al.
Publicado: (2024)

Grass: Compute Efficient Low-Memory LLM Training with Structured Sparse Gradients
por: Muhamed, Aashiq, et al.
Publicado: (2024)

Dropout-Based Rashomon Set Exploration for Efficient Predictive Multiplicity Estimation
por: Hsu, Hsiang, et al.
Publicado: (2024)

FairDropout: Using Example-Tied Dropout to Enhance Generalization of Minority Groups
por: Nanfack, Geraldin, et al.
Publicado: (2025)

DPad: Efficient Diffusion Language Models with Suffix Dropout
por: Chen, Xinhua, et al.
Publicado: (2025)

Multi-level Monte Carlo Dropout for Efficient Uncertainty Quantification
por: Pim, Aaron, et al.
Publicado: (2026)

Investigating the Synergistic Effects of Dropout and Residual Connections on Language Model Training
por: Li, Qingyang, et al.
Publicado: (2024)

Topology-Aware Revival for Efficient Sparse Training
por: Jin, Meiling, et al.
Publicado: (2026)

Toward Efficient Influence Function: Dropout as a Compression Tool
por: Zhang, Yuchen, et al.
Publicado: (2025)

BiSparse-AAS: Bilinear Sparse Attention and Adaptive Spans Framework for Scalable and Efficient Text Summarization
por: Hagos, Desta Haileselassie, et al.
Publicado: (2025)

Progressive Data Dropout: An Embarrassingly Simple Approach to Faster Training
por: Sathiyanarayanan, Shriram M, et al.
Publicado: (2025)

Dropout Neural Network Training Viewed from a Percolation Perspective
por: Devlin, Finley, et al.
Publicado: (2025)

Dynamic Sparse Training with Structured Sparsity
por: Lasby, Mike, et al.
Publicado: (2023)

FedOBD: Opportunistic Block Dropout for Efficiently Training Large-scale Neural Networks through Federated Learning
por: Chen, Yuanyuan, et al.
Publicado: (2022)

Dynamic Sparse Training of Diagonally Sparse Networks
por: Tyagi, Abhishek, et al.
Publicado: (2025)

Continuum Dropout for Neural Differential Equations
por: Lee, Jonghun, et al.
Publicado: (2025)

Mixture-of-Channels: Exploiting Sparse FFNs for Efficient LLMs Pre-Training and Inference
por: Wu, Tong, et al.
Publicado: (2025)

ZO-SAM: Zero-Order Sharpness-Aware Minimization for Efficient Sparse Training
por: Ji, Jie, et al.
Publicado: (2026)

Unreliable Uncertainty Estimates with Monte Carlo Dropout
por: Djupskås, Aslak, et al.
Publicado: (2025)

Dropout Drops Double Descent
por: Yang, Tian-Le, et al.
Publicado: (2023)

S2Aligner: Pair-Efficient and Transferable Pre-Training for Sparse Text-Attributed Graphs
por: Wang, Yuhan, et al.
Publicado: (2026)

Efficient Federated Learning with Heterogeneous Data and Adaptive Dropout
por: Liu, Ji, et al.
Publicado: (2025)

SPD-CFL: Stepwise Parameter Dropout for Efficient Continual Federated Learning
por: Yang, Yuning, et al.
Publicado: (2024)

Adaptive Tabu Dropout for Regularization of Deep Neural Network
por: Hasan, Md. Tarek, et al.
Publicado: (2024)

An Adaptive Dropout Approach for High-Dimensional Bayesian Optimization
por: Huang, Jundi, et al.
Publicado: (2025)

Dropout Induced Noise for Co-Creative GAN Systems
por: Wieluch, Sabine, et al.
Publicado: (2019)

SparseOpt: Addressing Normalization-induced Gradient Skew in Sparse Training
por: Adnan, Mohammed, et al.
Publicado: (2026)

SparseTransX: Efficient Training of Translation-Based Knowledge Graph Embeddings Using Sparse Matrix Operations
por: Anik, Md Saidul Hoque, et al.
Publicado: (2025)

Localising Dropout Variance in Twin Networks
por: Doyle, Cooper
Publicado: (2025)

Sparse-ProxSkip: Accelerated Sparse-to-Sparse Training in Federated Learning
por: Meinhardt, Georg, et al.
Publicado: (2024)

Low Rank and Sparse Fourier Structure in Recurrent Networks Trained on Modular Addition
por: Rangamani, Akshay
Publicado: (2025)

P-DROP: Poisson-Based Dropout for Graph Neural Networks
por: Yun, Hyunsik
Publicado: (2025)

Effects of Dropout on Performance in Long-range Graph Learning Tasks
por: Singh, Jasraj, et al.
Publicado: (2025)

Understanding Transformer Encoder-Decoder Representations through Bernoulli Dropout
por: Chen, Xuanzhou
Publicado: (2026)

Generative Autoencoding of Dropout Patterns
por: Maeda, Shunta
Publicado: (2023)

Sparse and Structured Hopfield Networks
por: Santos, Saul, et al.
Publicado: (2024)

SparsyFed: Sparse Adaptive Federated Training
por: Guastella, Adriano, et al.
Publicado: (2025)

Federated Dropout: Convergence Analysis and Resource Allocation
por: Xie, Sijing, et al.
Publicado: (2024)

Sparse-to-Sparse Training of Diffusion Models
por: Oliveira, Inês Cardoso, et al.
Publicado: (2025)