Image de couverture de livre

Pretraining with Random Noise for Fast and Robust Learning without Weight Transport

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Cheon, Jeonghwan, Lee, Sang Wan, Paik, Se-Bum
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning Neural and Evolutionary Computing
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Pretraining with random noise for uncertainty calibration
par: Cheon, Jeonghwan, et autres
Publié: (2024)

Neuromimetic metaplasticity for adaptive continual learning
par: Cho, Suhee, et autres
Publié: (2024)

One-Time Soft Alignment Enables Resilient Learning without Weight Transport
par: Cheon, Jeonghwan, et autres
Publié: (2025)

Learning to Forget: Continual Learning with Adaptive Weight Decay
par: Ramesh, Aditya A., et autres
Publié: (2026)

Expressivity of Neural Networks with Random Weights and Learned Biases
par: Williams, Ezekiel, et autres
Publié: (2024)

Reservoir Computing via Multi-Scale Random Fourier Features for Forecasting Fast-Slow Dynamical Systems
par: Laha, S. K.
Publié: (2025)

Towards Foundation Models on Graphs: An Analysis on Cross-Dataset Transfer of Pretrained GNNs
par: Frasca, Fabrizio, et autres
Publié: (2024)

Learning Self-Growth Maps for Fast and Accurate Imbalanced Streaming Data Clustering
par: Zhang, Yiqun, et autres
Publié: (2024)

R-FORCE: Robust Learning for Random Recurrent Neural Networks
par: Zheng, Yang, et autres
Publié: (2020)

Supervised Spike Agreement Dependent Plasticity for Fast Local Learning in Spiking Neural Networks
par: S, Gouri Lakshmi, et autres
Publié: (2026)

Recurrent Complex-Weighted Autoencoders for Unsupervised Object Discovery
par: Gopalakrishnan, Anand, et autres
Publié: (2024)

Gated Recurrent Neural Networks with Weighted Time-Delay Feedback
par: Erichson, N. Benjamin, et autres
Publié: (2022)

Looped Transformers are Better at Learning Learning Algorithms
par: Yang, Liu, et autres
Publié: (2023)

Stable and Robust Deep Learning By Hyperbolic Tangent Exponential Linear Unit (TeLU)
par: Fernandez, Alfredo, et autres
Publié: (2024)

Recursive Dynamics in Fast-Weights Homeostatic Reentry Networks: Toward Reflective Intelligence
par: Chae, B. G.
Publié: (2025)

Bio-Inspired Adaptive Neurons for Dynamic Weighting in Artificial Neural Networks
par: Islam, Ashhadul, et autres
Publié: (2024)

Should Under-parameterized Student Networks Copy or Average Teacher Weights?
par: Şimşek, Berfin, et autres
Publié: (2023)

Walking the Weight Manifold: a Topological Approach to Conditioning Inspired by Neuromodulation
par: Benjamin, Ari S., et autres
Publié: (2025)

Spiking Neural Networks with Random Network Architecture
par: Dai, Zihan, et autres
Publié: (2025)

Linearly Constrained Weights: Reducing Activation Shift for Faster Training of Neural Networks
par: Kutsuna, Takuro
Publié: (2024)

Dynamically Weighted Momentum with Adaptive Step Sizes for Efficient Deep Network Training
par: Wang, Zhifeng, et autres
Publié: (2025)

Fast gradient-free activation maximization for neurons in spiking neural networks
par: Pospelov, Nikita, et autres
Publié: (2023)

A Self-Ensemble Inspired Approach for Effective Training of Binary-Weight Spiking Neural Networks
par: Meng, Qingyan, et autres
Publié: (2025)

ART: Actually Robust Training
par: Chwilczyński, Sebastian, et autres
Publié: (2024)

Generalized Dynamic Brain Functional Connectivity Based on Random Convolutions
par: Duan, Yongjie, et autres
Publié: (2024)

Improving Language Plasticity via Pretraining with Active Forgetting
par: Chen, Yihong, et autres
Publié: (2023)

D-Score: A Synapse-Inspired Approach for Filter Pruning
par: Park, Doyoung, et autres
Publié: (2023)

Improved Robustness and Hyperparameter Selection in the Dense Associative Memory
par: McAlister, Hayden, et autres
Publié: (2024)

Randomly Weighted Neuromodulation in Neural Networks Facilitates Learning of Manifolds Common Across Tasks
par: Hong, Jinyung, et autres
Publié: (2023)

Mirror Descent Policy Optimisation for Robust Constrained Markov Decision Processes
par: Bossens, David M., et autres
Publié: (2025)

Robust MAE-Driven NAS: From Mask Reconstruction to Architecture Innovation
par: Hu, Yiming, et autres
Publié: (2023)

Convex-Neural RRT*: Fast and Reliable Learning-Guided Sampling for High-Quality Robot Path Planning
par: Cheriet, Hichem, et autres
Publié: (2026)

A Little Rank Goes a Long Way: Random Scaffolds with LoRA Adapters Are All You Need
par: Hazan, Hananel, et autres
Publié: (2026)

Cultivating Archipelago of Forests: Evolving Robust Decision Trees through Island Coevolution
par: Żychowski, Adam, et autres
Publié: (2024)

The Alpha-Alternator: Dynamic Adaptation To Varying Noise Levels In Sequences Using The Vendi Score For Improved Robustness and Performance
par: Rezaei, Mohammad Reza, et autres
Publié: (2025)

GRASP: GRouped Activation Shared Parameterization for Parameter-Efficient Fine-Tuning and Robust Inference of Transformers
par: Bal, Malyaban, et autres
Publié: (2025)

Meta-Black-Box Optimization with Ensemble Surrogate Modeling for Robustness-Accuracy Trade-off within SAEA
par: Jin, Xiao, et autres
Publié: (2026)

Neuroformer: Multimodal and Multitask Generative Pretraining for Brain Data
par: Antoniades, Antonis, et autres
Publié: (2023)

Real-time Noise Detection and Classification in Single-Channel EEG: A Lightweight Machine Learning Approach for EMG, White Noise, and EOG Artifacts
par: Enshaei, Hossein, et autres
Publié: (2025)

AdaptiveMDL-GenClust: A Robust Clustering Framework Integrating Normalized Mutual Information and Evolutionary Algorithms
par: Jahani, H., et autres
Publié: (2024)