Cover Image

Flexible and Efficient Surrogate Gradient Modeling with Forward Gradient Injection

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Otte, Sebastian
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Neural and Evolutionary Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

SpikingGamma: Surrogate-Gradient Free and Temporally Precise Online Training of Spiking Neural Networks with Smoothed Delays
by: Koopman, Roel, et al.
Published: (2026)

Forward Direct Feedback Alignment for Online Gradient Estimates of Spiking Neural Networks
by: Bacho, Florian, et al.
Published: (2024)

On the Privacy-Preserving Properties of Spiking Neural Networks with Unique Surrogate Gradients and Quantization Levels
by: Moshruba, Ayana, et al.
Published: (2025)

Understanding the Convergence in Balanced Resonate-and-Fire Neurons
by: Higuchi, Saya, et al.
Published: (2024)

Balanced Resonate-and-Fire Neurons
by: Higuchi, Saya, et al.
Published: (2024)

Energy-Efficient Supervised Learning with a Binary Stochastic Forward-Forward Algorithm
by: Jaiswal, Risi, et al.
Published: (2025)

Correlations Are Ruining Your Gradient Descent
by: Ahmad, Nasir
Published: (2024)

Scalable Memristive-Friendly Reservoir Computing for Time Series Classification
by: Horuz, Coşku Can, et al.
Published: (2026)

Minimal Convolutional RNNs Accelerate Spatiotemporal Learning
by: Horuz, Coşku Can, et al.
Published: (2025)

Scalable Forward-Forward Algorithm
by: Krutsylo, Andrii
Published: (2025)

Improved Forward-Forward Contrastive Learning
by: R, Gananath
Published: (2024)

Towards Interpretable Deep Local Learning with Successive Gradient Reconciliation
by: Yang, Yibo, et al.
Published: (2024)

Emergent representations in networks trained with the Forward-Forward algorithm
by: Tosato, Niccolò, et al.
Published: (2023)

Gradient-based inference of abstract task representations for generalization in neural networks
by: Hummos, Ali, et al.
Published: (2024)

Gradient-Based Neuroplastic Adaptation for Concurrent Optimization of Neuro-Fuzzy Networks
by: Hostetter, John Wesley, et al.
Published: (2025)

Stochastic Forward-Forward Learning through Representational Dimensionality Compression
by: Zhu, Zhichao, et al.
Published: (2025)

AdaSwarm: Augmenting Gradient-Based optimizers in Deep Learning with Swarm Intelligence
by: Mohapatra, Rohan, et al.
Published: (2020)

Heterogeneous Connectivity in Sparse Networks: Fan-in Profiles, Gradient Hierarchy, and Topological Equilibria
by: Tomczak, Nikodem
Published: (2026)

Traces Propagation: Memory-Efficient and Scalable Forward-Only Learning in Spiking Neural Networks
by: Pes, Lorenzo, et al.
Published: (2025)

SAGRAD: A Program for Neural Network Training with Simulated Annealing and the Conjugate Gradient Method
by: Bernal, Javier, et al.
Published: (2025)

Effective Predictive Modeling for Emergency Department Visits and Evaluating Exogenous Variables Impact: Using Explainable Meta-learning Gradient Boosting
by: Neshat, Mehdi, et al.
Published: (2024)

HG2P: Hippocampus-inspired High-reward Graph and Model-Free Q-Gradient Penalty for Path Planning and Motion Control
by: Wang, Haoran, et al.
Published: (2024)

Sign Gradient Descent-based Neuronal Dynamics: ANN-to-SNN Conversion Beyond ReLU Network
by: Oh, Hyunseok, et al.
Published: (2024)

Sharpness Aware Surrogate Training for Spiking Neural Networks
by: Nicholson, Maximilian
Published: (2026)

Meta-Black-Box Optimization with Ensemble Surrogate Modeling for Robustness-Accuracy Trade-off within SAEA
by: Jin, Xiao, et al.
Published: (2026)

Surrogate Learning in Meta-Black-Box Optimization: A Preliminary Study
by: Ma, Zeyuan, et al.
Published: (2025)

Towards Code-Oriented LM Embeddings for Surrogate-Assisted Neural Architecture Search
by: Somu, Pranav, et al.
Published: (2026)

Leveraging Evolutionary Surrogate-Assisted Prescription in Multi-Objective Chlorination Control Systems
by: Monsia, Rivaaj, et al.
Published: (2025)

Surrogate Ensemble in Expensive Multi-Objective Optimization via Deep Q-Learning
by: Wu, Yuxin, et al.
Published: (2026)

Recurrent Joint Embedding Predictive Architecture with Recurrent Forward Propagation Learning
by: Velarde, Osvaldo M, et al.
Published: (2024)

Accelerating Hopfield Network Dynamics: Beyond Synchronous Updates and Forward Euler
by: Goemaere, Cédric, et al.
Published: (2023)

Understanding Transformer Optimization via Gradient Heterogeneity
by: Tomihari, Akiyoshi, et al.
Published: (2025)

Gradient Descent, Stochastic Optimization, and Other Tales
by: Lu, Jun
Published: (2022)

W-PCA Based Gradient-Free Proxy for Efficient Search of Lightweight Language Models
by: Wang, Shang
Published: (2025)

A Surrogate Model for Quay Crane Scheduling Problem
by: Park, Kikun, et al.
Published: (2024)

KAT to KANs: A Review of Kolmogorov-Arnold Networks and the Neural Leap Forward
by: Basina, Divesh, et al.
Published: (2024)

Directly Training Temporal Spiking Neural Network with Sparse Surrogate Gradient
by: Li, Yang, et al.
Published: (2024)

Surrogate Benchmarks for Model Merging Optimization
by: Akizuki, Rio, et al.
Published: (2025)

Learning Gaussian Multi-Index Models with Gradient Flow: Time Complexity and Directional Convergence
by: Şimşek, Berfin, et al.
Published: (2024)

AlphaGrad: Non-Linear Gradient Normalization Optimizer
by: Sane, Soham
Published: (2025)