Cover Image

Forward Only Learning for Orthogonal Neural Networks of any Depth

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Caillon, Paul, Colagrande, Alex, Fagnou, Erwan, Delattre, Blaise, Allauzen, Alexandre
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Fast Training of Recurrent Neural Networks with Stationary State Feedbacks
by: Caillon, Paul, et al.
Published: (2025)

Accelerated Training through Iterative Gradient Propagation Along the Residual Path
by: Fagnou, Erwan, et al.
Published: (2025)

Trading Complexity for Expressivity Through Structured Generalized Linear Token Mixing
by: Fagnou, Erwan, et al.
Published: (2026)

Chain and Causal Attention for Efficient Entity Tracking
by: Fagnou, Erwan, et al.
Published: (2024)

Bridging the Theoretical Gap in Randomized Smoothing
by: Delattre, Blaise, et al.
Published: (2025)

Linear Attention with Global Context: A Multipole Attention Mechanism for Vision and Physics
by: Colagrande, Alex, et al.
Published: (2025)

Limits of Resolution Equivariance in Fourier Neural Operators
by: Colagrande, Alex, et al.
Published: (2026)

Structured-Sparse Attention for Entity Tracking with Subquadratic Sequence Complexity
by: Zhao, Hangyue, et al.
Published: (2026)

Conditional Distribution Quantization in Machine Learning
by: Delattre, Blaise, et al.
Published: (2025)

On the Stability of Neural Networks in Deep Learning
by: Delattre, Blaise
Published: (2025)

Spectral Norm of Convolutional Layers with Circular and Zero Paddings
by: Delattre, Blaise, et al.
Published: (2024)

The Lipschitz-Variance-Margin Tradeoff for Enhanced Randomized Smoothing
by: Delattre, Blaise, et al.
Published: (2023)

Approximated Likelihood Ratio: A Forward-Only and Parallel Framework for Boosting Neural Network Training
by: Zhang, Zeliang, et al.
Published: (2024)

On the Improvement of Generalization and Stability of Forward-Only Learning via Neural Polarization
by: Terres-Escudero, Erik B., et al.
Published: (2024)

Certified Robustness under Heterogeneous Perturbations via Hybrid Randomized Smoothing
by: Delattre, Blaise, et al.
Published: (2026)

Optimizing Dense Feed-Forward Neural Networks
by: Balderas, Luis, et al.
Published: (2023)

Forward Target Propagation: A Forward-Only Approach to Global Error Credit Assignment via Local Losses
by: As-Saquib, Nazmus Saadat, et al.
Published: (2025)

Forward-Forward Learning achieves Highly Selective Latent Representations for Out-of-Distribution Detection in Fully Spiking Neural Networks
by: Terres-Escudero, Erik B., et al.
Published: (2024)

DFA-GNN: Forward Learning of Graph Neural Networks by Direct Feedback Alignment
by: Zhao, Gongpei, et al.
Published: (2024)

On the MIA Vulnerability Gap Between Private GANs and Diffusion Models
by: Sebag, Ilana, et al.
Published: (2025)

ROOT: Robust Orthogonalized Optimizer for Neural Network Training
by: He, Wei, et al.
Published: (2025)

Harnessing Orthogonality to Train Low-Rank Neural Networks
by: Coquelin, Daniel, et al.
Published: (2024)

Feature Learning Dynamics in Infinite-Depth Neural Networks
by: Yao, Zihan, et al.
Published: (2025)

Feed-Forward Optimization With Delayed Feedback for Neural Network Training
by: Flügel, Katharina, et al.
Published: (2023)

EVA-0: Test-Time Model Evolution with Only Two Forward Passes per Sample
by: Chen, Guohao, et al.
Published: (2026)

Learning to Compile Programs to Neural Networks
by: Weber, Logan, et al.
Published: (2024)

Backpropagation-free Spiking Neural Networks with the Forward-Forward Algorithm
by: Ghader, Mohammadnavid, et al.
Published: (2025)

A KL Lens on Quantization: Fast, Forward-Only Sensitivity for Mixed-Precision SSM-Transformer Models
by: Kong, Jason, et al.
Published: (2026)

Graph-Level Label-Only Membership Inference Attack against Graph Neural Networks
by: Dai, Jiazhu, et al.
Published: (2025)

Hebbian Learning based Orthogonal Projection for Continual Learning of Spiking Neural Networks
by: Xiao, Mingqing, et al.
Published: (2024)

A&B BNN: Add&Bit-Operation-Only Hardware-Friendly Binary Neural Network
by: Ma, Ruichen, et al.
Published: (2024)

Adaptive Multi-Scale Goodness Aggregation for Forward-Forward Learning
by: Beigzad, Salar, et al.
Published: (2026)

Feed-Forward Neural Networks as a Mixed-Integer Program
by: Aftabi, Navid, et al.
Published: (2024)

Cumulative-Goodness Free-Riding in Forward-Forward Networks: Real, Repairable, but Not Accuracy-Dominant
by: Yousefiramandi, Amirhossein
Published: (2026)

any4: Learned 4-bit Numeric Representation for LLMs
by: Elhoushi, Mostafa, et al.
Published: (2025)

A Neural Network Architecture Based on Attention Gate Mechanism for 3D Magnetotelluric Forward Modeling
by: Zhong, Xin, et al.
Published: (2025)

Depth-Adaptive Graph Neural Networks via Learnable Bakry-'Emery Curvature
by: Hevapathige, Asela, et al.
Published: (2025)

TransferLight: Zero-Shot Traffic Signal Control on any Road-Network
by: Schmidt, Johann, et al.
Published: (2024)

Employing Layerwised Unsupervised Learning to Lessen Data and Loss Requirements in Forward-Forward Algorithms
by: Hwang, Taewook, et al.
Published: (2024)

FLOPS: Forward Learning with OPtimal Sampling
by: Ren, Tao, et al.
Published: (2024)