Cover Image

Beyond Backpropagation: Optimization with Multi-Tangent Forward Gradients

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Flügel, Katharina, Coquelin, Daniel, Weiel, Marie, Debus, Charlotte, Streit, Achim, Götz, Markus
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Feed-Forward Optimization With Delayed Feedback for Neural Network Training
by: Flügel, Katharina, et al.
Published: (2023)

Harnessing Orthogonality to Train Low-Rank Neural Networks
by: Coquelin, Daniel, et al.
Published: (2024)

AB-Training: A Communication-Efficient Approach for Distributed Low-Rank Learning
by: Coquelin, Daniel, et al.
Published: (2024)

Differentiable Power-Flow Optimization
by: Öz, Muhammed, et al.
Published: (2026)

A Comparative Study of Pruning Methods in Transformer-based Time Series Forecasting
by: Kiefer, Nicholas, et al.
Published: (2024)

Model Fusion via Neuron Transplantation
by: Öz, Muhammed, et al.
Published: (2025)

ReCycle: Fast and Efficient Long Time Series Forecasting with Residual Cyclic Transformers
by: Weyrauch, Arvid, et al.
Published: (2024)

Energy Consumption in Parallel Neural Network Training
by: Huber, Philipp, et al.
Published: (2025)

Sampling Parallelism for Fast and Efficient Bayesian Learning
by: Özdemir, Asena Karolin, et al.
Published: (2026)

Jigsaw: Training Multi-Billion-Parameter AI Weather Models with Optimized Model Parallelism
by: Kieckhefen, Deifilia, et al.
Published: (2025)

Massively Parallel Genetic Optimization through Asynchronous Propagation of Populations
by: Taubert, Oskar, et al.
Published: (2023)

Bayesian Lottery Ticket Hypothesis
by: Kuhn, Nicholas, et al.
Published: (2026)

Backpropagation-free Spiking Neural Networks with the Forward-Forward Algorithm
by: Ghader, Mohammadnavid, et al.
Published: (2025)

GRADE: Replacing Policy Gradients with Backpropagation for LLM Alignment
by: Nel, Lukas Abrie
Published: (2025)

PETNet -- Coincident Particle Event Detection using Spiking Neural Networks
by: Debus, Jan, et al.
Published: (2025)

Inverse Design of Optical Multilayer Thin Films using Robust Masked Diffusion Models
by: Schaible, Jonas, et al.
Published: (2026)

Randomized Advantage Transformation (RAT): Computing Natural Policy Gradients via Direct Backpropagation
by: Sun, Mingfei
Published: (2026)

Local Pairwise Distance Matching for Backpropagation-Free Reinforcement Learning
by: Tanneberg, Daniel
Published: (2025)

Practical Boolean Backpropagation
by: Golbert, Simon
Published: (2025)

Beyond Gradient Averaging in Parallel Optimization: Improved Robustness through Gradient Agreement Filtering
by: Chaubard, Francois, et al.
Published: (2024)

Generalized Euler Logarithm and its Applications in Machine Learning: Natural Gradient, Backpropagation, Generalized EG, Mirror Descent and OLPS
by: Cichocki, Andrzej
Published: (2025)

FwdLLM: Efficient FedLLM using Forward Gradient
by: Xu, Mengwei, et al.
Published: (2023)

Adaptive Multi-Scale Goodness Aggregation for Forward-Forward Learning
by: Beigzad, Salar, et al.
Published: (2026)

Backpropagation-Free Metropolis-Adjusted Langevin Algorithm
by: Cobb, Adam D., et al.
Published: (2025)

Exploring Federated Learning for Thermal Urban Feature Segmentation -- A Comparison of Centralized and Decentralized Approaches
by: Duda, Leonhard, et al.
Published: (2025)

Beyond Backpropagation: Exploring Innovative Algorithms for Energy-Efficient Deep Neural Network Training
by: Spyra, Przemysław
Published: (2025)

NTKMTL: Mitigating Task Imbalance in Multi-Task Learning from Neural Tangent Kernel Perspective
by: Qin, Xiaohan, et al.
Published: (2025)

Advancing On-Device Neural Network Training with TinyPropv2: Dynamic, Sparse, and Efficient Backpropagation
by: Rüb, Marcus, et al.
Published: (2024)

HKAN: Hierarchical Kolmogorov-Arnold Network without Backpropagation
by: Dudek, Grzegorz, et al.
Published: (2025)

Dense Backpropagation Improves Training for Sparse Mixture-of-Experts
by: Panda, Ashwinee, et al.
Published: (2025)

Dynamic Spectral Backpropagation for Efficient Neural Network Training
by: Muthuraman, Mannmohan
Published: (2025)

Exploring the Performance of Perforated Backpropagation through Further Experiments
by: Brenner, Rorry, et al.
Published: (2025)

Optimizing Dense Feed-Forward Neural Networks
by: Balderas, Luis, et al.
Published: (2023)

Divergence of Empirical Neural Tangent Kernel in Classification Problems
by: Yu, Zixiong, et al.
Published: (2025)

PSMGD: Periodic Stochastic Multi-Gradient Descent for Fast Multi-Objective Optimization
by: Xu, Mingjing, et al.
Published: (2024)

Energy-Efficient Deep Learning Without Backpropagation: A Rigorous Evaluation of Forward-Only Algorithms
by: Spyra, Przemysław, et al.
Published: (2025)

Learning without Global Backpropagation via Synergistic Information Distillation
by: Ye, Chenhao, et al.
Published: (2025)

Fine-tuning Diffusion Policies with Backpropagation Through Diffusion Timesteps
by: Yang, Ningyuan, et al.
Published: (2025)

SAL: Selective Adaptive Learning for Backpropagation-Free Training with Sparsification
by: Liu, Fanping, et al.
Published: (2026)

Stochastic Layer-wise Learning: Scalable and Efficient Alternative to Backpropagation
by: Yin, Bojian, et al.
Published: (2025)