Imagen de Portada

Pretraining with Random Noise for Fast and Robust Learning without Weight Transport

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Cheon, Jeonghwan, Lee, Sang Wan, Paik, Se-Bum
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Neural and Evolutionary Computing
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Pretraining with random noise for uncertainty calibration
por: Cheon, Jeonghwan, et al.
Publicado: (2024)

Neuromimetic metaplasticity for adaptive continual learning
por: Cho, Suhee, et al.
Publicado: (2024)

One-Time Soft Alignment Enables Resilient Learning without Weight Transport
por: Cheon, Jeonghwan, et al.
Publicado: (2025)

Learning to Forget: Continual Learning with Adaptive Weight Decay
por: Ramesh, Aditya A., et al.
Publicado: (2026)

Expressivity of Neural Networks with Random Weights and Learned Biases
por: Williams, Ezekiel, et al.
Publicado: (2024)

Reservoir Computing via Multi-Scale Random Fourier Features for Forecasting Fast-Slow Dynamical Systems
por: Laha, S. K.
Publicado: (2025)

Towards Foundation Models on Graphs: An Analysis on Cross-Dataset Transfer of Pretrained GNNs
por: Frasca, Fabrizio, et al.
Publicado: (2024)

Learning Self-Growth Maps for Fast and Accurate Imbalanced Streaming Data Clustering
por: Zhang, Yiqun, et al.
Publicado: (2024)

R-FORCE: Robust Learning for Random Recurrent Neural Networks
por: Zheng, Yang, et al.
Publicado: (2020)

Supervised Spike Agreement Dependent Plasticity for Fast Local Learning in Spiking Neural Networks
por: S, Gouri Lakshmi, et al.
Publicado: (2026)

Recurrent Complex-Weighted Autoencoders for Unsupervised Object Discovery
por: Gopalakrishnan, Anand, et al.
Publicado: (2024)

Gated Recurrent Neural Networks with Weighted Time-Delay Feedback
por: Erichson, N. Benjamin, et al.
Publicado: (2022)

Looped Transformers are Better at Learning Learning Algorithms
por: Yang, Liu, et al.
Publicado: (2023)

Stable and Robust Deep Learning By Hyperbolic Tangent Exponential Linear Unit (TeLU)
por: Fernandez, Alfredo, et al.
Publicado: (2024)

Recursive Dynamics in Fast-Weights Homeostatic Reentry Networks: Toward Reflective Intelligence
por: Chae, B. G.
Publicado: (2025)

Bio-Inspired Adaptive Neurons for Dynamic Weighting in Artificial Neural Networks
por: Islam, Ashhadul, et al.
Publicado: (2024)

Should Under-parameterized Student Networks Copy or Average Teacher Weights?
por: Şimşek, Berfin, et al.
Publicado: (2023)

Walking the Weight Manifold: a Topological Approach to Conditioning Inspired by Neuromodulation
por: Benjamin, Ari S., et al.
Publicado: (2025)

Spiking Neural Networks with Random Network Architecture
por: Dai, Zihan, et al.
Publicado: (2025)

Linearly Constrained Weights: Reducing Activation Shift for Faster Training of Neural Networks
por: Kutsuna, Takuro
Publicado: (2024)

Dynamically Weighted Momentum with Adaptive Step Sizes for Efficient Deep Network Training
por: Wang, Zhifeng, et al.
Publicado: (2025)

Fast gradient-free activation maximization for neurons in spiking neural networks
por: Pospelov, Nikita, et al.
Publicado: (2023)

A Self-Ensemble Inspired Approach for Effective Training of Binary-Weight Spiking Neural Networks
por: Meng, Qingyan, et al.
Publicado: (2025)

ART: Actually Robust Training
por: Chwilczyński, Sebastian, et al.
Publicado: (2024)

Generalized Dynamic Brain Functional Connectivity Based on Random Convolutions
por: Duan, Yongjie, et al.
Publicado: (2024)

Improving Language Plasticity via Pretraining with Active Forgetting
por: Chen, Yihong, et al.
Publicado: (2023)

D-Score: A Synapse-Inspired Approach for Filter Pruning
por: Park, Doyoung, et al.
Publicado: (2023)

Improved Robustness and Hyperparameter Selection in the Dense Associative Memory
por: McAlister, Hayden, et al.
Publicado: (2024)

Randomly Weighted Neuromodulation in Neural Networks Facilitates Learning of Manifolds Common Across Tasks
por: Hong, Jinyung, et al.
Publicado: (2023)

Mirror Descent Policy Optimisation for Robust Constrained Markov Decision Processes
por: Bossens, David M., et al.
Publicado: (2025)

Robust MAE-Driven NAS: From Mask Reconstruction to Architecture Innovation
por: Hu, Yiming, et al.
Publicado: (2023)

Convex-Neural RRT*: Fast and Reliable Learning-Guided Sampling for High-Quality Robot Path Planning
por: Cheriet, Hichem, et al.
Publicado: (2026)

A Little Rank Goes a Long Way: Random Scaffolds with LoRA Adapters Are All You Need
por: Hazan, Hananel, et al.
Publicado: (2026)

Cultivating Archipelago of Forests: Evolving Robust Decision Trees through Island Coevolution
por: Żychowski, Adam, et al.
Publicado: (2024)

The Alpha-Alternator: Dynamic Adaptation To Varying Noise Levels In Sequences Using The Vendi Score For Improved Robustness and Performance
por: Rezaei, Mohammad Reza, et al.
Publicado: (2025)

GRASP: GRouped Activation Shared Parameterization for Parameter-Efficient Fine-Tuning and Robust Inference of Transformers
por: Bal, Malyaban, et al.
Publicado: (2025)

Meta-Black-Box Optimization with Ensemble Surrogate Modeling for Robustness-Accuracy Trade-off within SAEA
por: Jin, Xiao, et al.
Publicado: (2026)

Neuroformer: Multimodal and Multitask Generative Pretraining for Brain Data
por: Antoniades, Antonis, et al.
Publicado: (2023)

Real-time Noise Detection and Classification in Single-Channel EEG: A Lightweight Machine Learning Approach for EMG, White Noise, and EOG Artifacts
por: Enshaei, Hossein, et al.
Publicado: (2025)

AdaptiveMDL-GenClust: A Robust Clustering Framework Integrating Normalized Mutual Information and Evolutionary Algorithms
por: Jahani, H., et al.
Publicado: (2024)