Feed-Forward Optimization With Delayed Feedback for Neural Network Training
Fuente:
arXiv
Guardado en:
| Autores principales: | Flügel, Katharina, Coquelin, Daniel, Weiel, Marie, Debus, Charlotte, Streit, Achim, Götz, Markus |
|---|---|
| Formato: | Preprint |
| Publicado: |
2023
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
Beyond Backpropagation: Optimization with Multi-Tangent Forward Gradients
por: Flügel, Katharina, et al.
Publicado: (2024)
por: Flügel, Katharina, et al.
Publicado: (2024)
Harnessing Orthogonality to Train Low-Rank Neural Networks
por: Coquelin, Daniel, et al.
Publicado: (2024)
por: Coquelin, Daniel, et al.
Publicado: (2024)
AB-Training: A Communication-Efficient Approach for Distributed Low-Rank Learning
por: Coquelin, Daniel, et al.
Publicado: (2024)
por: Coquelin, Daniel, et al.
Publicado: (2024)
Energy Consumption in Parallel Neural Network Training
por: Huber, Philipp, et al.
Publicado: (2025)
por: Huber, Philipp, et al.
Publicado: (2025)
Differentiable Power-Flow Optimization
por: Öz, Muhammed, et al.
Publicado: (2026)
por: Öz, Muhammed, et al.
Publicado: (2026)
Model Fusion via Neuron Transplantation
por: Öz, Muhammed, et al.
Publicado: (2025)
por: Öz, Muhammed, et al.
Publicado: (2025)
A Comparative Study of Pruning Methods in Transformer-based Time Series Forecasting
por: Kiefer, Nicholas, et al.
Publicado: (2024)
por: Kiefer, Nicholas, et al.
Publicado: (2024)
ReCycle: Fast and Efficient Long Time Series Forecasting with Residual Cyclic Transformers
por: Weyrauch, Arvid, et al.
Publicado: (2024)
por: Weyrauch, Arvid, et al.
Publicado: (2024)
Jigsaw: Training Multi-Billion-Parameter AI Weather Models with Optimized Model Parallelism
por: Kieckhefen, Deifilia, et al.
Publicado: (2025)
por: Kieckhefen, Deifilia, et al.
Publicado: (2025)
Sampling Parallelism for Fast and Efficient Bayesian Learning
por: Özdemir, Asena Karolin, et al.
Publicado: (2026)
por: Özdemir, Asena Karolin, et al.
Publicado: (2026)
Optimizing Dense Feed-Forward Neural Networks
por: Balderas, Luis, et al.
Publicado: (2023)
por: Balderas, Luis, et al.
Publicado: (2023)
Massively Parallel Genetic Optimization through Asynchronous Propagation of Populations
por: Taubert, Oskar, et al.
Publicado: (2023)
por: Taubert, Oskar, et al.
Publicado: (2023)
PETNet -- Coincident Particle Event Detection using Spiking Neural Networks
por: Debus, Jan, et al.
Publicado: (2025)
por: Debus, Jan, et al.
Publicado: (2025)
Bayesian Lottery Ticket Hypothesis
por: Kuhn, Nicholas, et al.
Publicado: (2026)
por: Kuhn, Nicholas, et al.
Publicado: (2026)
Feed-Forward Neural Networks as a Mixed-Integer Program
por: Aftabi, Navid, et al.
Publicado: (2024)
por: Aftabi, Navid, et al.
Publicado: (2024)
DFA-GNN: Forward Learning of Graph Neural Networks by Direct Feedback Alignment
por: Zhao, Gongpei, et al.
Publicado: (2024)
por: Zhao, Gongpei, et al.
Publicado: (2024)
Interactive Training: Feedback-Driven Neural Network Optimization
por: Zhang, Wentao, et al.
Publicado: (2025)
por: Zhang, Wentao, et al.
Publicado: (2025)
Linear and Neural Dueling Bandits with Delayed Feedback
por: Wang, Xiangyi, et al.
Publicado: (2026)
por: Wang, Xiangyi, et al.
Publicado: (2026)
Fast Training of Recurrent Neural Networks with Stationary State Feedbacks
por: Caillon, Paul, et al.
Publicado: (2025)
por: Caillon, Paul, et al.
Publicado: (2025)
Decentralized Online Convex Optimization with Unknown Feedback Delays
por: Qiu, Hao, et al.
Publicado: (2026)
por: Qiu, Hao, et al.
Publicado: (2026)
Parallel-in-Time Training of Recurrent Neural Networks for Dynamical Systems Reconstruction
por: Hess, Florian, et al.
Publicado: (2026)
por: Hess, Florian, et al.
Publicado: (2026)
Enhancing Fast Feed Forward Networks with Load Balancing and a Master Leaf Node
por: Charalampopoulos, Andreas, et al.
Publicado: (2024)
por: Charalampopoulos, Andreas, et al.
Publicado: (2024)
Revolutionizing Personalized Cancer Vaccines with NEO: Novel Epitope Optimization Using an Aggregated Feed Forward and Recurrent Neural Network with LSTM Architecture
por: Basava, Nishanth
Publicado: (2024)
por: Basava, Nishanth
Publicado: (2024)
Approximated Likelihood Ratio: A Forward-Only and Parallel Framework for Boosting Neural Network Training
por: Zhang, Zeliang, et al.
Publicado: (2024)
por: Zhang, Zeliang, et al.
Publicado: (2024)
Inverse Design of Optical Multilayer Thin Films using Robust Masked Diffusion Models
por: Schaible, Jonas, et al.
Publicado: (2026)
por: Schaible, Jonas, et al.
Publicado: (2026)
On the Role of Transformer Feed-Forward Layers in Nonlinear In-Context Learning
por: Sun, Haoyuan, et al.
Publicado: (2025)
por: Sun, Haoyuan, et al.
Publicado: (2025)
A Convexity-dependent Two-Phase Training Algorithm for Deep Neural Networks
por: Hrycej, Tomas, et al.
Publicado: (2025)
por: Hrycej, Tomas, et al.
Publicado: (2025)
A Closed-form Solution for Weight Optimization in Fully-connected Feed-forward Neural Networks
por: Tomic, Slavisa, et al.
Publicado: (2024)
por: Tomic, Slavisa, et al.
Publicado: (2024)
Flash Multi-Head Feed-Forward Network
por: Zhang, Minshen, et al.
Publicado: (2025)
por: Zhang, Minshen, et al.
Publicado: (2025)
ROOT: Robust Orthogonalized Optimizer for Neural Network Training
por: He, Wei, et al.
Publicado: (2025)
por: He, Wei, et al.
Publicado: (2025)
Forward Only Learning for Orthogonal Neural Networks of any Depth
por: Caillon, Paul, et al.
Publicado: (2025)
por: Caillon, Paul, et al.
Publicado: (2025)
Forward-Forward Learning achieves Highly Selective Latent Representations for Out-of-Distribution Detection in Fully Spiking Neural Networks
por: Terres-Escudero, Erik B., et al.
Publicado: (2024)
por: Terres-Escudero, Erik B., et al.
Publicado: (2024)
Backpropagation-free Spiking Neural Networks with the Forward-Forward Algorithm
por: Ghader, Mohammadnavid, et al.
Publicado: (2025)
por: Ghader, Mohammadnavid, et al.
Publicado: (2025)
Quantum Optimization for Training Quantum Neural Networks
por: Liao, Yidong, et al.
Publicado: (2021)
por: Liao, Yidong, et al.
Publicado: (2021)
Neural Dueling Bandits: Preference-Based Optimization with Human Feedback
por: Verma, Arun, et al.
Publicado: (2024)
por: Verma, Arun, et al.
Publicado: (2024)
Training Spiking Neural Networks via Augmented Direct Feedback Alignment
por: Zhang, Yongbo, et al.
Publicado: (2024)
por: Zhang, Yongbo, et al.
Publicado: (2024)
Cross-Entropy Optimization for Hyperparameter Optimization in Stochastic Gradient-based Approaches to Train Deep Neural Networks
por: Li, Kevin, et al.
Publicado: (2024)
por: Li, Kevin, et al.
Publicado: (2024)
Exploring Federated Learning for Thermal Urban Feature Segmentation -- A Comparison of Centralized and Decentralized Approaches
por: Duda, Leonhard, et al.
Publicado: (2025)
por: Duda, Leonhard, et al.
Publicado: (2025)
Delayed Bottlenecking: Alleviating Forgetting in Pre-trained Graph Neural Networks
por: Zhao, Zhe, et al.
Publicado: (2024)
por: Zhao, Zhe, et al.
Publicado: (2024)
RSTGCN: Railway-centric Spatio-Temporal Graph Convolutional Network for Train Delay Prediction
por: Chowdhury, Koyena, et al.
Publicado: (2025)
por: Chowdhury, Koyena, et al.
Publicado: (2025)
Ejemplares similares
-
Beyond Backpropagation: Optimization with Multi-Tangent Forward Gradients
por: Flügel, Katharina, et al.
Publicado: (2024) -
Harnessing Orthogonality to Train Low-Rank Neural Networks
por: Coquelin, Daniel, et al.
Publicado: (2024) -
AB-Training: A Communication-Efficient Approach for Distributed Low-Rank Learning
por: Coquelin, Daniel, et al.
Publicado: (2024) -
Energy Consumption in Parallel Neural Network Training
por: Huber, Philipp, et al.
Publicado: (2025) -
Differentiable Power-Flow Optimization
por: Öz, Muhammed, et al.
Publicado: (2026)